Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30040 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37190 originally caused by: Started by upstream project "master-osmo-ggsn" build number 6674 originally caused by: Started by timer Running as SYSTEM Building remotely on osmo-gsm-tester-prod (osmo-gsm-tester) in workspace /home/jenkins/workspace/osmo-gsm-tester_run-prod The recommended git tool is: NONE No credentials specified > git rev-parse --resolve-git-dir /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/.git # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url https://gerrit.osmocom.org/osmo-gsm-tester # timeout=10 Fetching upstream changes from https://gerrit.osmocom.org/osmo-gsm-tester > git --version # timeout=10 > git --version # 'git version 2.20.1' > git fetch --tags --force --progress -- https://gerrit.osmocom.org/osmo-gsm-tester +refs/heads/*:refs/remotes/origin/* # timeout=10 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 Checking out Revision bfc438bb2b17f4129018768a1f7bab52f1e96750 (refs/remotes/origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Commit message: "templates: osmo-msc: modernize" > git rev-list --no-walk bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bsc" build number 17654 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts" build number 7504 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-ggsn" build number 6679 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hlr" build number 8699 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-mgw" build number 8944 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hnbgw" build number 2949 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-msc" build number 29262 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu" build number 5150 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-sgsn" build number 30040 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-trx" build number 4675 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-nitb" build number 12967 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-stp" build number 9239 Copied 2 artifacts from "osmo-gsm-tester_build-osmocom-bb" build number 4700 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-sysmo" build number 8035 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-sysmo" build number 5189 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-oc2g" build number 5531 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-oc2g" build number 3907 Copied 2 artifacts from "osmo-gsm-tester_build-open5gs" build number 8 Copied 2 artifacts from "osmo-gsm-tester_build-srslte" build number 19 [osmo-gsm-tester_run-prod] $ /bin/sh /tmp/jenkins6622815115558628510.sh + unlink osmo-gsm-tester/sysmocom/resources.conf + ln -s resources.conf.prod osmo-gsm-tester/sysmocom/resources.conf + PATH=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src:/usr/local/bin:/usr/bin:/bin:/usr/games ./osmo-gsm-tester/contrib/jenkins-run.sh + base=/home/jenkins/workspace/osmo-gsm-tester_run-prod + dirname -- ./osmo-gsm-tester/contrib/jenkins-run.sh + CDPATH= cd -- ./osmo-gsm-tester/contrib + pwd -P + SCRIPT_DIR=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib + OSMO_GSM_TESTER_CONF=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf + date +%F %T + time_start=2022-12-09 23:11:22 + trial_dir_prefix=trial- + rm -rf trial-2365 trial-2365-bin.tgz trial-2365-run.tgz + trial_dir=trial-2366 + mkdir -p trial-2366 + mv open5gs.build-8.tgz osmo-bsc.build-17654.tgz osmo-bts-oc2g.build-5531.tgz osmo-bts-sysmo.build-8035.tgz osmo-bts.build-7504.tgz osmo-ggsn.build-6679.tgz osmo-hlr.build-8699.tgz osmo-hnbgw.build-2949.tgz osmo-mgw.build-8944.tgz osmo-msc.build-29262.tgz osmo-nitb.build-12967.tgz osmo-pcu-oc2g.build-3907.tgz osmo-pcu-sysmo.build-5189.tgz osmo-pcu.build-5150.tgz osmo-sgsn.build-30040.tgz osmo-stp.build-9239.tgz osmo-trx.build-4675.tgz osmocom-bb.build-4700.tgz srslte.build-19.tgz trial-2366 + cat open5gs.build-8.md5 osmo-bsc.build-17654.md5 osmo-bts-oc2g.build-5531.md5 osmo-bts-sysmo.build-8035.md5 osmo-bts.build-7504.md5 osmo-ggsn.build-6679.md5 osmo-hlr.build-8699.md5 osmo-hnbgw.build-2949.md5 osmo-mgw.build-8944.md5 osmo-msc.build-29262.md5 osmo-nitb.build-12967.md5 osmo-pcu-oc2g.build-3907.md5 osmo-pcu-sysmo.build-5189.md5 osmo-pcu.build-5150.md5 osmo-sgsn.build-30040.md5 osmo-stp.build-9239.md5 osmo-trx.build-4675.md5 osmocom-bb.build-4700.md5 srslte.build-19.md5 + rm open5gs.build-8.md5 osmo-bsc.build-17654.md5 osmo-bts-oc2g.build-5531.md5 osmo-bts-sysmo.build-8035.md5 osmo-bts.build-7504.md5 osmo-ggsn.build-6679.md5 osmo-hlr.build-8699.md5 osmo-hnbgw.build-2949.md5 osmo-mgw.build-8944.md5 osmo-msc.build-29262.md5 osmo-nitb.build-12967.md5 osmo-pcu-oc2g.build-3907.md5 osmo-pcu-sysmo.build-5189.md5 osmo-pcu.build-5150.md5 osmo-sgsn.build-30040.md5 osmo-stp.build-9239.md5 osmo-trx.build-4675.md5 osmocom-bb.build-4700.md5 srslte.build-19.md5 + exit_code=1 + which osmo-gsm-tester.py + python3 -u /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo-gsm-tester.py -c /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf trial-2366 combinations: None trial: 'trial-2366' tests: None Running default suites: nitb_sms:sysmo sms:sysmo nitb_ussd:sysmo ussd:sysmo voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:sysmo+mod-bts0-dynts-osmo emergency:sysmo gprs:sysmo gprs:sysmo+mod-bts0-egprs gprs:sysmo+mod-bts0-dynts-ipa gprs:sysmo+mod-bts0-dynts-osmo dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:sysmo+mod-bts0-dynts67-osmo nitb_sms:oc2g sms:oc2g nitb_ussd:oc2g ussd:oc2g voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:oc2g+mod-bts0-dynts-osmo emergency:oc2g gprs:oc2g gprs:oc2g+mod-bts0-egprs gprs:oc2g+mod-bts0-dynts-ipa gprs:oc2g+mod-bts0-dynts-osmo dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:oc2g+mod-bts0-dynts67-osmo nitb_sms:trx-b200 sms:trx-b200 nitb_ussd:trx-b200 ussd:trx-b200 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-b200+mod-bts0-dynts-osmo voice:trx-b200+mod-bts0-trxdversion0 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-b200 gprs:trx-b200 gprs:trx-b200+mod-bts0-egprs gprs:trx-b200+mod-bts0-dynts-ipa gprs:trx-b200+mod-bts0-dynts-osmo gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-b200+mod-bts0-dynts67-osmo nitb_sms:trx-sysmocell5000 sms:trx-sysmocell5000 nitb_ussd:trx-sysmocell5000 ussd:trx-sysmocell5000 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-sysmocell5000+mod-bts0-dynts-osmo emergency:trx-sysmocell5000 gprs:trx-sysmocell5000 gprs:trx-sysmocell5000+mod-bts0-egprs gprs:trx-sysmocell5000+mod-bts0-dynts-ipa gprs:trx-sysmocell5000+mod-bts0-dynts-osmo dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo nitb_sms:trx-umtrx sms:trx-umtrx nitb_ussd:trx-umtrx ussd:trx-umtrx voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-umtrx+mod-bts0-dynts-osmo voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-umtrx gprs:trx-umtrx gprs:trx-umtrx+mod-bts0-egprs gprs:trx-umtrx+mod-bts0-dynts-ipa gprs:trx-umtrx+mod-bts0-dynts-osmo gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-umtrx+mod-bts0-dynts67-osmo nitb_sms:trx-lms sms:trx-lms nitb_ussd:trx-lms ussd:trx-lms voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms+mod-bts0-dynts-osmo emergency:trx-lms gprs:trx-lms gprs:trx-lms+mod-bts0-egprs gprs:trx-lms+mod-bts0-dynts-ipa gprs:trx-lms+mod-bts0-dynts-osmo dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms+mod-bts0-dynts67-osmo nitb_sms:trx-lms-limenet-micro sms:trx-lms-limenet-micro nitb_ussd:trx-lms-limenet-micro ussd:trx-lms-limenet-micro voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo emergency:trx-lms-limenet-micro gprs:trx-lms-limenet-micro gprs:trx-lms-limenet-micro+mod-bts0-egprs gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo nitb_sms:nanobts sms:nanobts+band-1900 nitb_ussd:nanobts+band-1900 ussd:nanobts+band-1900 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any emergency:nanobts+band-1900 gprs:nanobts+band-1900 gprs:nanobts+band-1900+mod-bts0-egprs gprs:nanobts+band-1900+mod-bts0-dynts-ipa dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any sms:nanobts+band-900 nitb_ussd:nanobts+band-900 ussd:nanobts+band-900 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:nanobts+band-900 gprs:nanobts+band-900 gprs:nanobts+band-900+mod-bts0-egprs gprs:nanobts+band-900+mod-bts0-dynts-ipa gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any nitb_smpp smpp encryption 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover_2G:nanobts+bts1-oc2g handover_2G:nanobts+bts1-octphy handover_2G:nanobts+bts1-trx-lms handover_2G:nanobts+bts1-trx-lms-limenet-micro handover_2G:nanobts+bts1-trx-sysmocell5000 handover_2G:nanobts+bts1-sysmo handover_2G:nanobts+bts1-trx-b200 handover_2G:nanobts+bts1-trx-umtrx handover_2G:oc2g+bts1-octphy handover_2G:oc2g+bts1-trx-lms handover_2G:oc2g+bts1-trx-lms-limenet-micro handover_2G:oc2g+bts1-trx-sysmocell5000 handover_2G:oc2g+bts1-sysmo handover_2G:oc2g+bts1-trx-b200 handover_2G:oc2g+bts1-trx-umtrx handover_2G:octphy+bts1-trx-lms handover_2G:octphy+bts1-trx-lms-limenet-micro handover_2G:octphy+bts1-trx-sysmocell5000 handover_2G:octphy+bts1-sysmo handover_2G:octphy+bts1-trx-b200 handover_2G:octphy+bts1-trx-umtrx handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover_2G:trx-lms+bts1-trx-sysmocell5000 handover_2G:trx-lms+bts1-sysmo handover_2G:trx-lms+bts1-trx-b200 handover_2G:trx-lms+bts1-trx-umtrx handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover_2G:trx-sysmocell5000+bts1-sysmo handover_2G:trx-sysmocell5000+bts1-trx-b200 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover_2G:sysmo+bts1-trx-b200 handover_2G:sysmo+bts1-trx-umtrx handover_2G:trx-b200+bts1-trx-umtrx -------------------------------------------------------------------------------------------- trial-2366 -------------------------------------------------------------------------------------------- 23:11:33.744780 tst trial-2366: Detailed log at /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/log --------------------------------------------------------------------- trial-2366 nitb_sms:sysmo --------------------------------------------------------------------- 23:13:41.880611 tst nitb_sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:13:41.884825 tst nitb_sms:sysmo: Verifying 1 x bts (candidates: 11) 23:13:41.906546 tst nitb_sms:sysmo: Verifying 1 x ip_address (candidates: 9) 23:13:41.913640 tst nitb_sms:sysmo: Verifying 2 x modem (candidates: 12) 23:13:41.966267 tst nitb_sms:sysmo: Reserving 1 x bts (candidates: 11) 23:13:41.987747 tst nitb_sms:sysmo: Reserving 1 x ip_address (candidates: 9) 23:13:41.994792 tst nitb_sms:sysmo: Reserving 2 x modem (candidates: 12) 23:13:42.534854 tst nitb_sms:sysmo: RESERVED RESOURCES for nitb_sms: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 nitb_sms:sysmo mo_mt_sms.py ---------------------------------------------- 23:13:42.539928 tst nitb_sms:sysmo: Using 1 x ip_address (candidates: 1) 23:13:42.551219 tst nitb_sms:sysmo: Using 1 x bts (candidates: 1) 23:13:42.931212 tst mo_mt_sms.py: using LAC 24330 23:13:43.179864 tst mo_mt_sms.py: using RAC 105 23:13:43.307912 tst mo_mt_sms.py: using CellId 24330 23:13:43.433292 tst mo_mt_sms.py: using BVCI 24331 23:13:43.542325 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 23:13:43.725361 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 23:13:43.843587 tst mo_mt_sms.py:9: start nitb and bts... 23:13:44.049854 run osmo-nitb_10.42.42.2: Starting osmo-nitb 23:13:46.393710 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28426): Launched 23:13:46.740010 run osmo-nitb_10.42.42.2(pid=28427): Launched 23:13:46.943682 run osmo-nitb_10.42.42.2(pid=28427): ERR: Terminated: ERROR {rc=2} [trial-2366↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28427)] 23:13:47.082582 run osmo-nitb_10.42.42.2(pid=28427): stdout: | (launched: 2022-12-09_23:13:46.679313) 23:13:47.222595 run osmo-nitb_10.42.42.2(pid=28427): stderr: | (launched: 2022-12-09_23:13:46.728779) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:13:47.358518 run osmo-nitb_10.42.42.2(pid=28427): stdout: | (launched: 2022-12-09_23:13:46.679313) 23:13:47.488823 run osmo-nitb_10.42.42.2(pid=28427): stderr: | (launched: 2022-12-09_23:13:46.728779) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:13:47.644797 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=28427): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28427) [trial-2366↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28427)] [trial-2366↪nitb_sms:sysmo↪mo_mt_sms.py:11] 23:13:47.653844 tst mo_mt_sms.py:11: Test FAILED (5.1 sec) 23:13:47.660906 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28426): Terminating (SIGTERM) 23:13:47.872152 --- ParallelTerminationStrategy: PID 28426 died... 23:13:47.893813 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28426): Terminated: ok {rc=0} 23:13:47.983531 bus /sierra_3: Setting Powered False 23:13:49.084405 bus /sierra_3: Setting Powered False 23:13:50.202828 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 nitb_sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 sms:sysmo --------------------------------------------------------------------- 23:13:51.386786 tst sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:13:51.391539 tst sms:sysmo: Verifying 1 x bts (candidates: 11) 23:13:51.412922 tst sms:sysmo: Verifying 6 x ip_address (candidates: 9) 23:13:51.440436 tst sms:sysmo: Verifying 2 x modem (candidates: 12) 23:13:51.495046 tst sms:sysmo: Reserving 1 x bts (candidates: 11) 23:13:51.515607 tst sms:sysmo: Reserving 6 x ip_address (candidates: 9) 23:13:51.542557 tst sms:sysmo: Reserving 2 x modem (candidates: 12) 23:13:52.090280 tst sms:sysmo: RESERVED RESOURCES for sms: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 sms:sysmo mo_mt_sms.py ---------------------------------------------- 23:13:52.095285 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 23:13:52.106042 tst sms:sysmo: Using 1 x bts (candidates: 1) 23:13:52.140640 tst mo_mt_sms.py: using LAC 24331 23:13:52.274560 tst mo_mt_sms.py: using RAC 106 23:13:52.402756 tst mo_mt_sms.py: using CellId 24331 23:13:52.527784 tst mo_mt_sms.py: using BVCI 24332 23:13:52.639622 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 23:13:52.650235 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 23:13:52.660643 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 23:13:52.671093 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 23:13:52.682282 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 23:13:52.693320 tst sms:sysmo: Using 1 x modem (candidates: 2) 23:13:52.811083 tst sms:sysmo: Using 1 x modem (candidates: 2) 23:13:52.935606 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:13:54.713708 run create_hlr_db(pid=28431): Launched 23:13:54.840543 bus /sierra_2: Setting Powered False 23:13:55.906369 run create_hlr_db(pid=28431): Terminated: ok {rc=0} 23:13:56.348844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28433): Launched 23:13:56.659037 run osmo-hlr_10.42.42.2(pid=28434): Launched 23:13:56.778727 run osmo-stp_10.42.42.5: Starting osmo-stp 23:13:59.257449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28436): Launched 23:13:59.568900 run osmo-stp_10.42.42.5(pid=28437): Launched 23:13:59.686356 run osmo-msc_10.42.42.6: Starting osmo-msc 23:14:05.090640 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28439): Launched 23:14:05.400258 run osmo-msc_10.42.42.6(pid=28440): Launched 23:14:05.572429 run osmo-stp_10.42.42.5(pid=28437): ERR: Terminated: ERROR {rc=1} [trial-2366↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28437)] 23:14:05.701283 run osmo-stp_10.42.42.5(pid=28437): stdout: | (launched: 2022-12-09_23:13:59.510739) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:14:05.854700 run osmo-stp_10.42.42.5(pid=28437): stderr: | 20221209231359683 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209231359683 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209231359683 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209231359684 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209231359684 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209231359684 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209231359684 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:14:05.992325 run osmo-stp_10.42.42.5(pid=28437): stdout: | (launched: 2022-12-09_23:13:59.510739) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:14:06.123190 run osmo-stp_10.42.42.5(pid=28437): stderr: | 20221209231359683 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209231359683 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209231359683 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209231359684 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209231359684 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209231359684 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209231359684 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:14:06.279964 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=28437): Process ended prematurely: osmo-stp_10.42.42.5(pid=28437) [trial-2366↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28437)] [trial-2366↪sms:sysmo↪mo_mt_sms.py:16] 23:14:06.288934 tst mo_mt_sms.py:16: Test FAILED (14.2 sec) 23:14:06.317597 run osmo-hlr_10.42.42.2(pid=28434): ERR: Terminated: ERROR {rc=237} [trial-2366↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28434)] 23:14:06.369464 run osmo-hlr_10.42.42.2(pid=28434): stdout: | (launched: 2022-12-09_23:13:56.601340) 23:14:06.423149 run osmo-hlr_10.42.42.2(pid=28434): stderr: | 20221209231356778 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209231356778 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209231356778 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209231356778 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209231356778 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209231356778 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209231356791 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/sms:sysmo/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209231356801 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209231356801 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209231356801 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:14:06.497663 run osmo-msc_10.42.42.6(pid=28440): ERR: Terminated: ERROR {rc=2} [trial-2366↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28440)] 23:14:06.549662 run osmo-msc_10.42.42.6(pid=28440): stdout: | (launched: 2022-12-09_23:14:05.342339) 23:14:06.603213 run osmo-msc_10.42.42.6(pid=28440): stderr: | 20221209231405619 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209231405620 DLGLOBAL DEBUG validating counter group 0x7f01f3aa2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209231405620 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209231405620 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209231405620 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209231405620 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209231405622 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209231405622 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209231405622 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209231405622 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:14:06.657231 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28433): Terminating (SIGTERM) 23:14:06.700318 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28436): Terminating (SIGTERM) 23:14:06.743413 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28439): Terminating (SIGTERM) 23:14:06.787276 --- ParallelTerminationStrategy: PID 28433 died... 23:14:06.807950 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28433): Terminated: ok {rc=0} 23:14:06.856258 --- ParallelTerminationStrategy: PID 28436 died... 23:14:06.876335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28436): Terminated: ok {rc=0} 23:14:06.924767 --- ParallelTerminationStrategy: PID 28439 died... 23:14:06.945231 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28439): Terminated: ok {rc=0} 23:14:07.035750 bus /sierra_3: Setting Powered False 23:14:08.136681 bus /sierra_3: Setting Powered False 23:14:09.254858 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 nitb_ussd:sysmo --------------------------------------------------------------------- 23:14:10.474703 tst nitb_ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:14:10.478877 tst nitb_ussd:sysmo: Verifying 1 x bts (candidates: 11) 23:14:10.501844 tst nitb_ussd:sysmo: Verifying 1 x ip_address (candidates: 9) 23:14:10.509973 tst nitb_ussd:sysmo: Verifying 1 x modem (candidates: 12) 23:14:10.548050 tst nitb_ussd:sysmo: Reserving 1 x bts (candidates: 11) 23:14:10.570333 tst nitb_ussd:sysmo: Reserving 1 x ip_address (candidates: 9) 23:14:10.579372 tst nitb_ussd:sysmo: Reserving 1 x modem (candidates: 12) 23:14:11.127795 tst nitb_ussd:sysmo: RESERVED RESOURCES for nitb_ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2366 nitb_ussd:sysmo assert_extension.py ---------------------------------------------- 23:14:11.135643 tst nitb_ussd:sysmo: Using 1 x ip_address (candidates: 1) 23:14:11.151150 tst nitb_ussd:sysmo: Using 1 x bts (candidates: 1) 23:14:11.236301 tst assert_extension.py: using LAC 24332 23:14:11.377826 tst assert_extension.py: using RAC 107 23:14:11.509337 tst assert_extension.py: using CellId 24332 23:14:11.636722 tst assert_extension.py: using BVCI 24333 23:14:11.757326 tst nitb_ussd:sysmo: Using 1 x modem (candidates: 1) 23:14:11.872699 tst assert_extension.py:10: start nitb and bts... 23:14:12.079495 run osmo-nitb_10.42.42.2: Starting osmo-nitb 23:14:12.707041 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28446): Launched 23:14:13.018160 run osmo-nitb_10.42.42.2(pid=28447): Launched 23:14:13.189912 run osmo-nitb_10.42.42.2(pid=28447): ERR: Terminated: ERROR {rc=2} [trial-2366↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28447)] 23:14:13.327057 run osmo-nitb_10.42.42.2(pid=28447): stdout: | (launched: 2022-12-09_23:14:12.959332) 23:14:13.465770 run osmo-nitb_10.42.42.2(pid=28447): stderr: | (launched: 2022-12-09_23:14:13.005955) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:14:13.603926 run osmo-nitb_10.42.42.2(pid=28447): stdout: | (launched: 2022-12-09_23:14:12.959332) 23:14:13.736810 run osmo-nitb_10.42.42.2(pid=28447): stderr: | (launched: 2022-12-09_23:14:13.005955) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=28447): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28447) [trial-2366↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28447)] 23:14:14.135969 tst osmo-nitb_10.42.42.2(pid=28447): stdout: | (launched: 2022-12-09_23:14:12.959332) 23:14:14.259899 tst osmo-nitb_10.42.42.2(pid=28447): stderr: | (launched: 2022-12-09_23:14:13.005955) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:14:14.405930 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=28447): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28447) [trial-2366↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28447)] [trial-2366↪nitb_ussd:sysmo↪assert_extension.py:12] 23:14:14.414595 tst assert_extension.py:12: Test FAILED (3.3 sec) 23:14:14.421477 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28446): Terminating (SIGTERM) 23:14:14.630519 --- ParallelTerminationStrategy: PID 28446 died... 23:14:14.651663 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28446): Terminated: ok {rc=0} 23:14:14.738787 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 nitb_ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 ussd:sysmo --------------------------------------------------------------------- 23:14:15.935555 tst ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:14:15.940276 tst ussd:sysmo: Verifying 1 x bts (candidates: 11) 23:14:15.967747 tst ussd:sysmo: Verifying 6 x ip_address (candidates: 9) 23:14:16.002847 tst ussd:sysmo: Verifying 1 x modem (candidates: 12) 23:14:16.044226 tst ussd:sysmo: Reserving 1 x bts (candidates: 11) 23:14:16.065155 tst ussd:sysmo: Reserving 6 x ip_address (candidates: 9) 23:14:16.093775 tst ussd:sysmo: Reserving 1 x modem (candidates: 12) 23:14:16.619295 tst ussd:sysmo: RESERVED RESOURCES for ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2366 ussd:sysmo assert_extension.py ---------------------------------------------- 23:14:16.627970 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 23:14:16.643174 tst ussd:sysmo: Using 1 x bts (candidates: 1) 23:14:16.682460 tst assert_extension.py: using LAC 24333 23:14:16.846299 tst assert_extension.py: using RAC 108 23:14:17.001795 tst assert_extension.py: using CellId 24333 23:14:17.176388 tst assert_extension.py: using BVCI 24334 23:14:17.321877 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 23:14:17.334002 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 23:14:17.346096 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 23:14:17.358659 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 23:14:17.370414 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 23:14:17.381411 tst ussd:sysmo: Using 1 x modem (candidates: 1) 23:14:17.499351 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:14:18.013917 run create_hlr_db(pid=28451): Launched 23:14:18.142329 bus /sierra_2: Setting Powered False 23:14:19.207286 run create_hlr_db(pid=28451): Terminated: ok {rc=0} 23:14:19.649956 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28453): Launched 23:14:19.960656 run osmo-hlr_10.42.42.2(pid=28454): Launched 23:14:20.080645 run osmo-stp_10.42.42.5: Starting osmo-stp 23:14:20.619196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28456): Launched 23:14:20.929851 run osmo-stp_10.42.42.5(pid=28457): Launched 23:14:21.050531 run osmo-msc_10.42.42.6: Starting osmo-msc 23:14:21.605869 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28459): Launched 23:14:21.914637 run osmo-msc_10.42.42.6(pid=28460): Launched 23:14:22.104490 run osmo-stp_10.42.42.5(pid=28457): ERR: Terminated: ERROR {rc=1} [trial-2366↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28457)] 23:14:22.247158 run osmo-stp_10.42.42.5(pid=28457): stdout: | (launched: 2022-12-09_23:14:20.871885) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:14:22.389612 run osmo-stp_10.42.42.5(pid=28457): stderr: | 20221209231421046 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209231421046 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209231421046 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209231421046 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209231421047 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209231421047 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209231421047 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:14:22.527640 run osmo-stp_10.42.42.5(pid=28457): stdout: | (launched: 2022-12-09_23:14:20.871885) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:14:22.659504 run osmo-stp_10.42.42.5(pid=28457): stderr: | 20221209231421046 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209231421046 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209231421046 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209231421046 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209231421047 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209231421047 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209231421047 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:14:22.816906 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=28457): Process ended prematurely: osmo-stp_10.42.42.5(pid=28457) [trial-2366↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28457)] [trial-2366↪ussd:sysmo↪assert_extension.py:17] 23:14:22.826162 tst assert_extension.py:17: Test FAILED (6.2 sec) 23:14:22.854433 run osmo-hlr_10.42.42.2(pid=28454): ERR: Terminated: ERROR {rc=237} [trial-2366↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28454)] 23:14:22.905850 run osmo-hlr_10.42.42.2(pid=28454): stdout: | (launched: 2022-12-09_23:14:19.902576) 23:14:22.958883 run osmo-hlr_10.42.42.2(pid=28454): stderr: | 20221209231420080 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209231420080 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209231420080 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209231420080 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209231420080 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209231420080 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209231420092 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/ussd:sysmo/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209231420100 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209231420101 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209231420101 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:14:23.032030 run osmo-msc_10.42.42.6(pid=28460): ERR: Terminated: ERROR {rc=2} [trial-2366↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28460)] 23:14:23.083219 run osmo-msc_10.42.42.6(pid=28460): stdout: | (launched: 2022-12-09_23:14:21.856464) 23:14:23.135961 run osmo-msc_10.42.42.6(pid=28460): stderr: | 20221209231422168 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209231422168 DLGLOBAL DEBUG validating counter group 0x7f4a76389c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209231422168 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209231422168 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209231422168 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209231422169 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209231422170 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209231422171 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209231422171 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209231422171 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:14:23.189246 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28453): Terminating (SIGTERM) 23:14:23.231619 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28456): Terminating (SIGTERM) 23:14:23.274020 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28459): Terminating (SIGTERM) 23:14:23.316789 --- ParallelTerminationStrategy: PID 28453 died... 23:14:23.337209 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28453): Terminated: ok {rc=0} 23:14:23.384848 --- ParallelTerminationStrategy: PID 28456 died... 23:14:23.405344 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28456): Terminated: ok {rc=0} 23:14:23.452736 --- ParallelTerminationStrategy: PID 28459 died... 23:14:23.472566 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28459): Terminated: ok {rc=0} 23:14:23.561390 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 23:14:24.759027 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:14:24.765895 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 23:14:24.787076 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 23:14:24.813898 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 23:14:24.866305 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 23:14:24.887515 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 23:14:24.913991 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 23:14:25.464667 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 23:14:25.516206 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:14:25.527306 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 23:14:25.583296 tst mo_mt_call.py: using LAC 24334 23:14:25.716658 tst mo_mt_call.py: using RAC 109 23:14:25.850619 tst mo_mt_call.py: using CellId 24334 23:14:25.973067 tst mo_mt_call.py: using BVCI 24335 23:14:26.085806 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:14:26.097069 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:14:26.108018 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:14:26.118944 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:14:26.130054 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:14:26.140994 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:14:26.262357 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:14:26.382718 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:14:26.872056 run create_hlr_db(pid=28465): Launched 23:14:27.001448 bus /sierra_2: Setting Powered False 23:14:28.063872 run create_hlr_db(pid=28465): Terminated: ok {rc=0} 23:14:28.522929 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28467): Launched 23:14:28.860535 run osmo-hlr_10.42.42.2(pid=28468): Launched 23:14:28.990777 run osmo-stp_10.42.42.5: Starting osmo-stp 23:14:29.574198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28470): Launched 23:14:29.911702 run osmo-stp_10.42.42.5(pid=28471): Launched 23:14:30.041692 run osmo-msc_10.42.42.6: Starting osmo-msc 23:14:30.647913 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28473): Launched 23:14:30.986330 run osmo-msc_10.42.42.6(pid=28474): Launched 23:14:31.316918 run osmo-stp_10.42.42.5(pid=28471): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28471)] 23:14:31.573020 run osmo-stp_10.42.42.5(pid=28471): stdout: | (launched: 2022-12-09_23:14:29.848800) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:14:31.833961 run osmo-stp_10.42.42.5(pid=28471): stderr: | 20221209231430044 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209231430044 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209231430044 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209231430045 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209231430045 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209231430045 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209231430045 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:14:31.971239 run osmo-stp_10.42.42.5(pid=28471): stdout: | (launched: 2022-12-09_23:14:29.848800) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:14:32.098919 run osmo-stp_10.42.42.5(pid=28471): stderr: | 20221209231430044 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209231430044 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209231430044 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209231430045 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209231430045 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209231430045 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209231430045 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:14:32.254264 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28471): Process ended prematurely: osmo-stp_10.42.42.5(pid=28471) [trial-2366↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28471)] [trial-2366↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 23:14:32.263686 tst mo_mt_call.py:8: Test FAILED (6.8 sec) 23:14:32.290996 run osmo-hlr_10.42.42.2(pid=28468): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28468)] 23:14:32.340277 run osmo-hlr_10.42.42.2(pid=28468): stdout: | (launched: 2022-12-09_23:14:28.798411) 23:14:32.392318 run osmo-hlr_10.42.42.2(pid=28468): stderr: | 20221209231428999 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209231428999 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209231428999 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209231428999 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209231428999 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209231428999 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209231429012 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209231429020 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209231429020 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209231429020 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:14:32.463046 run osmo-msc_10.42.42.6(pid=28474): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28474)] 23:14:32.511451 run osmo-msc_10.42.42.6(pid=28474): stdout: | (launched: 2022-12-09_23:14:30.925392) 23:14:32.561620 run osmo-msc_10.42.42.6(pid=28474): stderr: | 20221209231431511 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209231431512 DLGLOBAL DEBUG validating counter group 0x7efc0bec5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209231431512 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209231431512 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209231431512 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209231431512 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209231431514 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209231431515 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209231431515 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209231431515 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:14:32.611672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28467): Terminating (SIGTERM) 23:14:32.651665 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28470): Terminating (SIGTERM) 23:14:32.691565 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28473): Terminating (SIGTERM) 23:14:32.731685 --- ParallelTerminationStrategy: PID 28467 died... 23:14:32.750852 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28467): Terminated: ok {rc=0} 23:14:32.795322 --- ParallelTerminationStrategy: PID 28470 died... 23:14:32.814192 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28470): Terminated: ok {rc=0} 23:14:32.858553 --- ParallelTerminationStrategy: PID 28473 died... 23:14:32.877445 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28473): Terminated: ok {rc=0} 23:14:32.964423 bus /sierra_3: Setting Powered False 23:14:34.066941 bus /sierra_3: Setting Powered False 23:14:35.185474 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 23:14:36.338066 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:14:36.350555 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 23:14:36.411810 tst mo_mt_call_osmux.py: using LAC 24335 23:14:36.542296 tst mo_mt_call_osmux.py: using RAC 110 23:14:36.672166 tst mo_mt_call_osmux.py: using CellId 24335 23:14:36.805404 tst mo_mt_call_osmux.py: using BVCI 24336 23:14:36.928773 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:14:36.940527 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:14:36.952075 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:14:36.963770 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:14:36.975753 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:14:36.987567 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:14:37.111316 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:14:37.236185 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:14:37.725911 run create_hlr_db(pid=28476): Launched 23:14:37.856849 bus /sierra_2: Setting Powered False 23:14:38.919504 run create_hlr_db(pid=28476): Terminated: ok {rc=0} 23:14:39.379999 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28478): Launched 23:14:39.718688 run osmo-hlr_10.42.42.2(pid=28479): Launched 23:14:39.848293 run osmo-stp_10.42.42.5: Starting osmo-stp 23:14:40.431744 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28481): Launched 23:14:40.768435 run osmo-stp_10.42.42.5(pid=28482): Launched 23:14:40.898000 run osmo-msc_10.42.42.6: Starting osmo-msc 23:14:41.506408 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28484): Launched 23:14:41.842466 run osmo-msc_10.42.42.6(pid=28485): Launched 23:14:42.029841 run osmo-stp_10.42.42.5(pid=28482): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28482)] 23:14:42.171796 run osmo-stp_10.42.42.5(pid=28482): stdout: | (launched: 2022-12-09_23:14:40.705933) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:14:42.313516 run osmo-stp_10.42.42.5(pid=28482): stderr: | 20221209231440900 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209231440900 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209231440900 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209231440901 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209231440901 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209231440901 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209231440901 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:14:42.454251 run osmo-stp_10.42.42.5(pid=28482): stdout: | (launched: 2022-12-09_23:14:40.705933) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:14:42.588153 run osmo-stp_10.42.42.5(pid=28482): stderr: | 20221209231440900 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209231440900 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209231440900 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209231440901 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209231440901 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209231440901 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209231440901 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:14:42.748935 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28482): Process ended prematurely: osmo-stp_10.42.42.5(pid=28482) [trial-2366↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28482)] [trial-2366↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 23:14:42.758623 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 23:14:42.786837 run osmo-hlr_10.42.42.2(pid=28479): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28479)] 23:14:42.837953 run osmo-hlr_10.42.42.2(pid=28479): stdout: | (launched: 2022-12-09_23:14:39.656134) 23:14:42.890656 run osmo-hlr_10.42.42.2(pid=28479): stderr: | 20221209231439860 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209231439860 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209231439860 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209231439860 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209231439860 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209231439860 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209231439876 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209231439886 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209231439886 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209231439886 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:14:42.964208 run osmo-msc_10.42.42.6(pid=28485): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28485)] 23:14:43.015314 run osmo-msc_10.42.42.6(pid=28485): stdout: | (launched: 2022-12-09_23:14:41.779765) 23:14:43.067891 run osmo-msc_10.42.42.6(pid=28485): stderr: | 20221209231442108 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209231442109 DLGLOBAL DEBUG validating counter group 0x7f1bef653c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209231442109 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209231442109 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209231442109 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209231442109 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209231442111 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209231442111 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209231442111 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209231442111 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:14:43.120705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28478): Terminating (SIGTERM) 23:14:43.163120 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28481): Terminating (SIGTERM) 23:14:43.205507 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28484): Terminating (SIGTERM) 23:14:43.248274 --- ParallelTerminationStrategy: PID 28478 died... 23:14:43.268396 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28478): Terminated: ok {rc=0} 23:14:43.315543 --- ParallelTerminationStrategy: PID 28481 died... 23:14:43.335310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28481): Terminated: ok {rc=0} 23:14:43.382118 --- ParallelTerminationStrategy: PID 28484 died... 23:14:43.401701 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28484): Terminated: ok {rc=0} 23:14:43.490508 bus /sierra_3: Setting Powered False 23:14:44.590464 bus /sierra_3: Setting Powered False 23:14:45.707191 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 23:14:46.960434 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:14:46.967773 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 23:14:46.994385 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 23:14:47.032405 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 23:14:47.095355 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 23:14:47.119100 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 23:14:47.154210 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 23:14:47.696273 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 23:14:47.746158 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:14:47.757263 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 23:14:47.813439 tst mo_mt_call.py: using LAC 24336 23:14:47.934904 tst mo_mt_call.py: using RAC 111 23:14:48.058558 tst mo_mt_call.py: using CellId 24336 23:14:48.182641 tst mo_mt_call.py: using BVCI 24337 23:14:48.296853 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:14:48.308020 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:14:48.318864 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:14:48.329772 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:14:48.340648 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:14:48.351690 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:14:48.474321 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:14:48.597366 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:14:49.121609 run create_hlr_db(pid=28491): Launched 23:14:49.251621 bus /sierra_2: Setting Powered False 23:14:50.318090 run create_hlr_db(pid=28491): Terminated: ok {rc=0} 23:14:50.768317 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28493): Launched 23:14:51.087292 run osmo-hlr_10.42.42.2(pid=28494): Launched 23:14:51.208770 run osmo-stp_10.42.42.5: Starting osmo-stp 23:14:51.752410 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28496): Launched 23:14:52.069329 run osmo-stp_10.42.42.5(pid=28497): Launched 23:14:52.188216 run osmo-msc_10.42.42.6: Starting osmo-msc 23:14:52.759456 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28499): Launched 23:14:53.075664 run osmo-msc_10.42.42.6(pid=28500): Launched 23:14:53.252493 run osmo-stp_10.42.42.5(pid=28497): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28497)] 23:14:53.386051 run osmo-stp_10.42.42.5(pid=28497): stdout: | (launched: 2022-12-09_23:14:52.010673) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:14:53.518456 run osmo-stp_10.42.42.5(pid=28497): stderr: | 20221209231452186 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209231452187 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209231452187 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209231452187 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209231452188 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209231452188 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209231452188 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:14:53.648413 run osmo-stp_10.42.42.5(pid=28497): stdout: | (launched: 2022-12-09_23:14:52.010673) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:14:53.773135 run osmo-stp_10.42.42.5(pid=28497): stderr: | 20221209231452186 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209231452187 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209231452187 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209231452187 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209231452188 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209231452188 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209231452188 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:14:53.922680 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28497): Process ended prematurely: osmo-stp_10.42.42.5(pid=28497) [trial-2366↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28497)] [trial-2366↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 23:14:53.931573 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 23:14:53.957695 run osmo-hlr_10.42.42.2(pid=28494): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28494)] 23:14:54.005995 run osmo-hlr_10.42.42.2(pid=28494): stdout: | (launched: 2022-12-09_23:14:51.028205) 23:14:54.055654 run osmo-hlr_10.42.42.2(pid=28494): stderr: | 20221209231451211 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209231451211 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209231451211 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209231451211 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209231451211 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209231451211 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209231451223 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209231451234 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209231451234 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209231451234 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:14:54.124559 run osmo-msc_10.42.42.6(pid=28500): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28500)] 23:14:54.172296 run osmo-msc_10.42.42.6(pid=28500): stdout: | (launched: 2022-12-09_23:14:53.016607) 23:14:54.222029 run osmo-msc_10.42.42.6(pid=28500): stderr: | 20221209231453292 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209231453293 DLGLOBAL DEBUG validating counter group 0x7f759b7e4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209231453293 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209231453293 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209231453293 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209231453293 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209231453295 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209231453295 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209231453296 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209231453296 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:14:54.271781 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28493): Terminating (SIGTERM) 23:14:54.311511 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28496): Terminating (SIGTERM) 23:14:54.351288 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28499): Terminating (SIGTERM) 23:14:54.391241 --- ParallelTerminationStrategy: PID 28493 died... 23:14:54.410280 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28493): Terminated: ok {rc=0} 23:14:54.455408 --- ParallelTerminationStrategy: PID 28496 died... 23:14:54.474087 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28496): Terminated: ok {rc=0} 23:14:54.518432 --- ParallelTerminationStrategy: PID 28499 died... 23:14:54.537169 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28499): Terminated: ok {rc=0} 23:14:54.623862 bus /sierra_3: Setting Powered False 23:14:55.723681 bus /sierra_3: Setting Powered False 23:14:56.840624 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 23:14:57.989214 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:14:58.000779 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 23:14:58.057700 tst mo_mt_call_osmux.py: using LAC 24337 23:14:58.191013 tst mo_mt_call_osmux.py: using RAC 112 23:14:58.324430 tst mo_mt_call_osmux.py: using CellId 24337 23:14:58.462434 tst mo_mt_call_osmux.py: using BVCI 24338 23:14:58.586646 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:14:58.598508 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:14:58.610093 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:14:58.621664 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:14:58.633457 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:14:58.644836 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:14:58.762886 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:14:58.880809 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:14:59.369575 run create_hlr_db(pid=28502): Launched 23:14:59.502345 bus /sierra_2: Setting Powered False 23:15:00.564655 run create_hlr_db(pid=28502): Terminated: ok {rc=0} 23:15:01.035844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28504): Launched 23:15:01.382854 run osmo-hlr_10.42.42.2(pid=28508): Launched 23:15:01.690910 run osmo-stp_10.42.42.5: Starting osmo-stp 23:15:02.320433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28510): Launched 23:15:02.664069 run osmo-stp_10.42.42.5(pid=28511): Launched 23:15:02.794506 run osmo-msc_10.42.42.6: Starting osmo-msc 23:15:03.404357 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28513): Launched 23:15:03.741644 run osmo-msc_10.42.42.6(pid=28514): Launched 23:15:03.930563 run osmo-stp_10.42.42.5(pid=28511): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28511)] 23:15:04.072473 run osmo-stp_10.42.42.5(pid=28511): stdout: | (launched: 2022-12-09_23:15:02.601462) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:15:04.214123 run osmo-stp_10.42.42.5(pid=28511): stderr: | 20221209231502797 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209231502797 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209231502797 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209231502798 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209231502798 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209231502798 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209231502798 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:15:04.354276 run osmo-stp_10.42.42.5(pid=28511): stdout: | (launched: 2022-12-09_23:15:02.601462) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:15:04.488425 run osmo-stp_10.42.42.5(pid=28511): stderr: | 20221209231502797 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209231502797 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209231502797 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209231502798 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209231502798 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209231502798 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209231502798 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:15:04.648788 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28511): Process ended prematurely: osmo-stp_10.42.42.5(pid=28511) [trial-2366↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28511)] [trial-2366↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 23:15:04.658665 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 23:15:04.686947 run osmo-hlr_10.42.42.2(pid=28508): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28508)] 23:15:04.738154 run osmo-hlr_10.42.42.2(pid=28508): stdout: | (launched: 2022-12-09_23:15:01.320764) 23:15:04.790802 run osmo-hlr_10.42.42.2(pid=28508): stderr: | 20221209231501546 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209231501546 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209231501546 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209231501546 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209231501546 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209231501546 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209231501563 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209231501571 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209231501572 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209231501572 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:15:04.863817 run osmo-msc_10.42.42.6(pid=28514): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28514)] 23:15:04.914815 run osmo-msc_10.42.42.6(pid=28514): stdout: | (launched: 2022-12-09_23:15:03.679210) 23:15:04.967650 run osmo-msc_10.42.42.6(pid=28514): stderr: | 20221209231504004 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209231504004 DLGLOBAL DEBUG validating counter group 0x7f49bbedcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209231504004 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209231504004 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209231504004 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209231504004 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209231504006 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209231504006 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209231504007 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209231504007 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:15:05.020385 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28504): Terminating (SIGTERM) 23:15:05.062419 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28510): Terminating (SIGTERM) 23:15:05.104765 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28513): Terminating (SIGTERM) 23:15:05.147347 --- ParallelTerminationStrategy: PID 28504 died... 23:15:05.167529 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28504): Terminated: ok {rc=0} 23:15:05.215179 --- ParallelTerminationStrategy: PID 28510 died... 23:15:05.235061 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28510): Terminated: ok {rc=0} 23:15:05.282034 --- ParallelTerminationStrategy: PID 28513 died... 23:15:05.301835 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28513): Terminated: ok {rc=0} 23:15:05.391194 bus /sierra_3: Setting Powered False 23:15:06.490622 bus /sierra_3: Setting Powered False 23:15:07.608572 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 23:15:08.843109 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:15:08.851304 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 23:15:08.873230 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 23:15:08.900798 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 23:15:08.954740 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 23:15:08.976172 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 23:15:09.004427 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 23:15:09.557099 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 23:15:09.611402 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:15:09.622981 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 23:15:09.680736 tst mo_mt_call.py: using LAC 24338 23:15:09.813754 tst mo_mt_call.py: using RAC 113 23:15:09.944797 tst mo_mt_call.py: using CellId 24338 23:15:10.076795 tst mo_mt_call.py: using BVCI 24339 23:15:10.199639 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:15:10.211678 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:15:10.223085 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:15:10.234764 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:15:10.246166 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:15:10.258151 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:15:10.377849 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:15:10.502392 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:15:10.992713 run create_hlr_db(pid=28519): Launched 23:15:11.122883 bus /sierra_2: Setting Powered False 23:15:12.185343 run create_hlr_db(pid=28519): Terminated: ok {rc=0} 23:15:12.646459 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28521): Launched 23:15:12.986387 run osmo-hlr_10.42.42.2(pid=28522): Launched 23:15:13.116483 run osmo-stp_10.42.42.5: Starting osmo-stp 23:15:13.695679 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28524): Launched 23:15:14.032469 run osmo-stp_10.42.42.5(pid=28525): Launched 23:15:14.162061 run osmo-msc_10.42.42.6: Starting osmo-msc 23:15:14.769752 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28527): Launched 23:15:15.111087 run osmo-msc_10.42.42.6(pid=28528): Launched 23:15:15.297797 run osmo-stp_10.42.42.5(pid=28525): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28525)] 23:15:15.439661 run osmo-stp_10.42.42.5(pid=28525): stdout: | (launched: 2022-12-09_23:15:13.969783) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:15:15.581406 run osmo-stp_10.42.42.5(pid=28525): stderr: | 20221209231514166 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209231514167 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209231514167 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209231514167 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209231514168 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209231514168 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209231514168 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:15:15.721516 run osmo-stp_10.42.42.5(pid=28525): stdout: | (launched: 2022-12-09_23:15:13.969783) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:15:15.866646 run osmo-stp_10.42.42.5(pid=28525): stderr: | 20221209231514166 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209231514167 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209231514167 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209231514167 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209231514168 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209231514168 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209231514168 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:15:16.021563 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28525): Process ended prematurely: osmo-stp_10.42.42.5(pid=28525) [trial-2366↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28525)] [trial-2366↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 23:15:16.030886 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 23:15:16.059043 run osmo-hlr_10.42.42.2(pid=28522): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28522)] 23:15:16.109157 run osmo-hlr_10.42.42.2(pid=28522): stdout: | (launched: 2022-12-09_23:15:12.923243) 23:15:16.161520 run osmo-hlr_10.42.42.2(pid=28522): stderr: | 20221209231513124 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209231513124 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209231513124 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209231513124 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209231513124 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209231513124 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209231513136 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209231513144 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209231513145 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209231513145 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:15:16.234365 run osmo-msc_10.42.42.6(pid=28528): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28528)] 23:15:16.283954 run osmo-msc_10.42.42.6(pid=28528): stdout: | (launched: 2022-12-09_23:15:15.048009) 23:15:16.335455 run osmo-msc_10.42.42.6(pid=28528): stderr: | 20221209231515375 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209231515375 DLGLOBAL DEBUG validating counter group 0x7f5b4359bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209231515375 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209231515376 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209231515376 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209231515376 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209231515378 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209231515378 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209231515378 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209231515378 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:15:16.388080 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28521): Terminating (SIGTERM) 23:15:16.429717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28524): Terminating (SIGTERM) 23:15:16.471825 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28527): Terminating (SIGTERM) 23:15:16.516698 --- ParallelTerminationStrategy: PID 28521 died... 23:15:16.536687 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28521): Terminated: ok {rc=0} 23:15:16.585122 --- ParallelTerminationStrategy: PID 28524 died... 23:15:16.604559 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28524): Terminated: ok {rc=0} 23:15:16.650155 --- ParallelTerminationStrategy: PID 28527 died... 23:15:16.669922 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28527): Terminated: ok {rc=0} 23:15:16.757959 bus /sierra_3: Setting Powered False 23:15:17.853579 bus /sierra_3: Setting Powered False 23:15:18.967923 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 23:15:20.116659 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:15:20.128644 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 23:15:20.185398 tst mo_mt_call_osmux.py: using LAC 24339 23:15:20.314773 tst mo_mt_call_osmux.py: using RAC 114 23:15:20.436832 tst mo_mt_call_osmux.py: using CellId 24339 23:15:20.559904 tst mo_mt_call_osmux.py: using BVCI 24340 23:15:20.673436 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:15:20.684475 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:15:20.695556 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:15:20.706524 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:15:20.717559 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:15:20.728474 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:15:20.846413 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:15:20.968081 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:15:21.493642 run create_hlr_db(pid=28530): Launched 23:15:21.626028 bus /sierra_2: Setting Powered False 23:15:22.688413 run create_hlr_db(pid=28530): Terminated: ok {rc=0} 23:15:23.148805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28532): Launched 23:15:23.489661 run osmo-hlr_10.42.42.2(pid=28533): Launched 23:15:23.619484 run osmo-stp_10.42.42.5: Starting osmo-stp 23:15:24.201962 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28535): Launched 23:15:24.540872 run osmo-stp_10.42.42.5(pid=28536): Launched 23:15:24.669993 run osmo-msc_10.42.42.6: Starting osmo-msc 23:15:25.279735 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28538): Launched 23:15:25.617831 run osmo-msc_10.42.42.6(pid=28540): Launched 23:15:25.806424 run osmo-stp_10.42.42.5(pid=28536): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28536)] 23:15:25.948403 run osmo-stp_10.42.42.5(pid=28536): stdout: | (launched: 2022-12-09_23:15:24.478207) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:15:26.090968 run osmo-stp_10.42.42.5(pid=28536): stderr: | 20221209231524676 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209231524676 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209231524676 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209231524677 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209231524677 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209231524677 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209231524677 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:15:26.231336 run osmo-stp_10.42.42.5(pid=28536): stdout: | (launched: 2022-12-09_23:15:24.478207) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:15:26.365454 run osmo-stp_10.42.42.5(pid=28536): stderr: | 20221209231524676 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209231524676 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209231524676 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209231524677 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209231524677 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209231524677 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209231524677 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:15:26.525810 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28536): Process ended prematurely: osmo-stp_10.42.42.5(pid=28536) [trial-2366↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28536)] [trial-2366↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 23:15:26.535753 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 23:15:26.564198 run osmo-hlr_10.42.42.2(pid=28533): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28533)] 23:15:26.615682 run osmo-hlr_10.42.42.2(pid=28533): stdout: | (launched: 2022-12-09_23:15:23.427094) 23:15:26.668421 run osmo-hlr_10.42.42.2(pid=28533): stderr: | 20221209231523632 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209231523632 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209231523632 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209231523632 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209231523632 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209231523632 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209231523644 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209231523652 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209231523652 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209231523653 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:15:26.741570 run osmo-msc_10.42.42.6(pid=28540): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28540)] 23:15:26.792407 run osmo-msc_10.42.42.6(pid=28540): stdout: | (launched: 2022-12-09_23:15:25.554776) 23:15:26.844895 run osmo-msc_10.42.42.6(pid=28540): stderr: | 20221209231525878 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209231525878 DLGLOBAL DEBUG validating counter group 0x7fc110ac5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209231525879 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209231525879 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209231525879 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209231525879 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209231525881 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209231525881 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209231525881 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209231525881 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:15:26.897635 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28532): Terminating (SIGTERM) 23:15:26.939995 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28535): Terminating (SIGTERM) 23:15:26.982773 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28538): Terminating (SIGTERM) 23:15:27.025510 --- ParallelTerminationStrategy: PID 28532 died... 23:15:27.045690 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28532): Terminated: ok {rc=0} 23:15:27.092716 --- ParallelTerminationStrategy: PID 28535 died... 23:15:27.112466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28535): Terminated: ok {rc=0} 23:15:27.159284 --- ParallelTerminationStrategy: PID 28538 died... 23:15:27.179063 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28538): Terminated: ok {rc=0} 23:15:27.268390 bus /sierra_3: Setting Powered False 23:15:28.368472 bus /sierra_3: Setting Powered False 23:15:29.484543 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 23:15:30.723647 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:15:30.730520 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 23:15:30.751625 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 23:15:30.779223 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 23:15:30.830542 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 23:15:30.851705 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 23:15:30.880721 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 23:15:31.446953 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 23:15:31.513681 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:15:31.528697 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 23:15:31.594165 tst mo_mt_call.py: using LAC 24340 23:15:31.729341 tst mo_mt_call.py: using RAC 115 23:15:31.887885 tst mo_mt_call.py: using CellId 24340 23:15:32.069381 tst mo_mt_call.py: using BVCI 24341 23:15:32.230216 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:15:32.246130 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:15:32.260480 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:15:32.273724 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:15:32.286049 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:15:32.299317 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:15:32.430757 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:15:32.551263 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:15:33.038115 run create_hlr_db(pid=28545): Launched 23:15:33.168610 bus /sierra_2: Setting Powered False 23:15:34.231180 run create_hlr_db(pid=28545): Terminated: ok {rc=0} 23:15:34.668728 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28547): Launched 23:15:34.983628 run osmo-hlr_10.42.42.2(pid=28548): Launched 23:15:35.104497 run osmo-stp_10.42.42.5: Starting osmo-stp 23:15:35.644928 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28550): Launched 23:15:35.960248 run osmo-stp_10.42.42.5(pid=28551): Launched 23:15:36.080011 run osmo-msc_10.42.42.6: Starting osmo-msc 23:15:36.647864 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28553): Launched 23:15:36.963676 run osmo-msc_10.42.42.6(pid=28554): Launched 23:15:37.139273 run osmo-stp_10.42.42.5(pid=28551): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28551)] 23:15:37.271450 run osmo-stp_10.42.42.5(pid=28551): stdout: | (launched: 2022-12-09_23:15:35.901864) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:15:37.403032 run osmo-stp_10.42.42.5(pid=28551): stderr: | 20221209231536075 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209231536075 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209231536075 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209231536075 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209231536076 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209231536076 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209231536076 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:15:37.532738 run osmo-stp_10.42.42.5(pid=28551): stdout: | (launched: 2022-12-09_23:15:35.901864) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:15:37.658089 run osmo-stp_10.42.42.5(pid=28551): stderr: | 20221209231536075 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209231536075 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209231536075 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209231536075 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209231536076 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209231536076 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209231536076 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:15:37.807383 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28551): Process ended prematurely: osmo-stp_10.42.42.5(pid=28551) [trial-2366↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28551)] [trial-2366↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 23:15:37.816315 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 23:15:37.842517 run osmo-hlr_10.42.42.2(pid=28548): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28548)] 23:15:37.890218 run osmo-hlr_10.42.42.2(pid=28548): stdout: | (launched: 2022-12-09_23:15:34.924486) 23:15:37.939881 run osmo-hlr_10.42.42.2(pid=28548): stderr: | 20221209231535104 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209231535104 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209231535104 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209231535104 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209231535104 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209231535105 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209231535120 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209231535130 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209231535130 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209231535130 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:15:38.009087 run osmo-msc_10.42.42.6(pid=28554): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28554)] 23:15:38.057212 run osmo-msc_10.42.42.6(pid=28554): stdout: | (launched: 2022-12-09_23:15:36.904741) 23:15:38.106579 run osmo-msc_10.42.42.6(pid=28554): stderr: | 20221209231537181 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209231537181 DLGLOBAL DEBUG validating counter group 0x7f174e00ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209231537181 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209231537181 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209231537181 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209231537182 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209231537183 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209231537184 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209231537184 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209231537184 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:15:38.156262 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28547): Terminating (SIGTERM) 23:15:38.195606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28550): Terminating (SIGTERM) 23:15:38.235000 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28553): Terminating (SIGTERM) 23:15:38.274812 --- ParallelTerminationStrategy: PID 28547 died... 23:15:38.293871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28547): Terminated: ok {rc=0} 23:15:38.338307 --- ParallelTerminationStrategy: PID 28550 died... 23:15:38.356851 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28550): Terminated: ok {rc=0} 23:15:38.400698 --- ParallelTerminationStrategy: PID 28553 died... 23:15:38.419675 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28553): Terminated: ok {rc=0} 23:15:38.504505 bus /sierra_3: Setting Powered False 23:15:39.600685 bus /sierra_3: Setting Powered False 23:15:40.716441 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 23:15:41.866006 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:15:41.877827 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 23:15:41.934839 tst mo_mt_call_osmux.py: using LAC 24341 23:15:42.059438 tst mo_mt_call_osmux.py: using RAC 116 23:15:42.184094 tst mo_mt_call_osmux.py: using CellId 24341 23:15:42.308587 tst mo_mt_call_osmux.py: using BVCI 24342 23:15:42.423936 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:15:42.434974 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:15:42.445934 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:15:42.456802 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:15:42.467766 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:15:42.478719 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:15:42.601191 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:15:42.721086 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:15:43.212479 run create_hlr_db(pid=28556): Launched 23:15:43.342414 bus /sierra_2: Setting Powered False 23:15:44.404903 run create_hlr_db(pid=28556): Terminated: ok {rc=0} 23:15:44.865173 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28558): Launched 23:15:45.206227 run osmo-hlr_10.42.42.2(pid=28559): Launched 23:15:45.336269 run osmo-stp_10.42.42.5: Starting osmo-stp 23:15:45.941750 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28561): Launched 23:15:46.316059 run osmo-stp_10.42.42.5(pid=28562): Launched 23:15:46.592098 run osmo-msc_10.42.42.6: Starting osmo-msc 23:15:47.281613 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28564): Launched 23:15:47.620331 run osmo-msc_10.42.42.6(pid=28565): Launched 23:15:47.808693 run osmo-stp_10.42.42.5(pid=28562): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28562)] 23:15:47.950696 run osmo-stp_10.42.42.5(pid=28562): stdout: | (launched: 2022-12-09_23:15:46.256135) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:15:48.093179 run osmo-stp_10.42.42.5(pid=28562): stderr: | 20221209231546507 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209231546507 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209231546507 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209231546508 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209231546508 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209231546508 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209231546508 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:15:48.233184 run osmo-stp_10.42.42.5(pid=28562): stdout: | (launched: 2022-12-09_23:15:46.256135) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:15:48.367144 run osmo-stp_10.42.42.5(pid=28562): stderr: | 20221209231546507 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209231546507 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209231546507 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209231546508 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209231546508 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209231546508 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209231546508 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:15:48.527533 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28562): Process ended prematurely: osmo-stp_10.42.42.5(pid=28562) [trial-2366↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28562)] [trial-2366↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 23:15:48.537562 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 23:15:48.565963 run osmo-hlr_10.42.42.2(pid=28559): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28559)] 23:15:48.617331 run osmo-hlr_10.42.42.2(pid=28559): stdout: | (launched: 2022-12-09_23:15:45.143154) 23:15:48.670076 run osmo-hlr_10.42.42.2(pid=28559): stderr: | 20221209231545346 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209231545346 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209231545346 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209231545346 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209231545346 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209231545346 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209231545359 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209231545367 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209231545368 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209231545368 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:15:48.743026 run osmo-msc_10.42.42.6(pid=28565): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28565)] 23:15:48.793783 run osmo-msc_10.42.42.6(pid=28565): stdout: | (launched: 2022-12-09_23:15:47.557872) 23:15:48.846505 run osmo-msc_10.42.42.6(pid=28565): stderr: | 20221209231547882 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209231547882 DLGLOBAL DEBUG validating counter group 0x7f8a749d9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209231547882 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209231547882 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209231547882 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209231547882 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209231547884 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209231547884 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209231547885 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209231547885 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:15:48.899479 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28558): Terminating (SIGTERM) 23:15:48.941925 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28561): Terminating (SIGTERM) 23:15:48.984714 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28564): Terminating (SIGTERM) 23:15:49.027612 --- ParallelTerminationStrategy: PID 28558 died... 23:15:49.047953 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28558): Terminated: ok {rc=0} 23:15:49.094774 --- ParallelTerminationStrategy: PID 28561 died... 23:15:49.114806 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28561): Terminated: ok {rc=0} 23:15:49.161601 --- ParallelTerminationStrategy: PID 28564 died... 23:15:49.181339 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28564): Terminated: ok {rc=0} 23:15:49.270429 bus /sierra_3: Setting Powered False 23:15:50.370133 bus /sierra_3: Setting Powered False 23:15:51.487241 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 23:15:52.725038 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:15:52.732224 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 23:15:52.754302 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 23:15:52.782726 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 23:15:52.835718 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 23:15:52.857142 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 23:15:52.885195 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 23:15:53.437630 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 23:15:53.491927 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:15:53.503701 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 23:15:53.564941 tst mo_mt_call.py: using LAC 24342 23:15:53.695432 tst mo_mt_call.py: using RAC 117 23:15:53.826393 tst mo_mt_call.py: using CellId 24342 23:15:53.956932 tst mo_mt_call.py: using BVCI 24343 23:15:54.080269 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:15:54.091908 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:15:54.103349 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:15:54.114835 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:15:54.126549 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:15:54.138271 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:15:54.256197 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:15:54.379887 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:15:54.902242 run create_hlr_db(pid=28570): Launched 23:15:55.032167 bus /sierra_2: Setting Powered False 23:15:56.097537 run create_hlr_db(pid=28570): Terminated: ok {rc=0} 23:15:56.566337 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28572): Launched 23:15:56.904441 run osmo-hlr_10.42.42.2(pid=28573): Launched 23:15:57.034582 run osmo-stp_10.42.42.5: Starting osmo-stp 23:15:57.619790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28575): Launched 23:15:57.959727 run osmo-stp_10.42.42.5(pid=28576): Launched 23:15:58.090628 run osmo-msc_10.42.42.6: Starting osmo-msc 23:15:58.699463 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28578): Launched 23:15:59.039523 run osmo-msc_10.42.42.6(pid=28579): Launched 23:15:59.228560 run osmo-stp_10.42.42.5(pid=28576): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28576)] 23:15:59.370074 run osmo-stp_10.42.42.5(pid=28576): stdout: | (launched: 2022-12-09_23:15:57.897049) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:15:59.511993 run osmo-stp_10.42.42.5(pid=28576): stderr: | 20221209231558091 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209231558091 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209231558091 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209231558092 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209231558092 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209231558092 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209231558092 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:15:59.651948 run osmo-stp_10.42.42.5(pid=28576): stdout: | (launched: 2022-12-09_23:15:57.897049) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:15:59.785722 run osmo-stp_10.42.42.5(pid=28576): stderr: | 20221209231558091 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209231558091 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209231558091 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209231558092 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209231558092 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209231558092 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209231558092 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:15:59.946183 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28576): Process ended prematurely: osmo-stp_10.42.42.5(pid=28576) [trial-2366↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28576)] [trial-2366↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 23:15:59.955889 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 23:15:59.984518 run osmo-hlr_10.42.42.2(pid=28573): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28573)] 23:16:00.035583 run osmo-hlr_10.42.42.2(pid=28573): stdout: | (launched: 2022-12-09_23:15:56.841980) 23:16:00.088131 run osmo-hlr_10.42.42.2(pid=28573): stderr: | 20221209231557046 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209231557046 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209231557046 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209231557046 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209231557046 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209231557046 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209231557068 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209231557078 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209231557078 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209231557078 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:16:00.160903 run osmo-msc_10.42.42.6(pid=28579): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28579)] 23:16:00.211594 run osmo-msc_10.42.42.6(pid=28579): stdout: | (launched: 2022-12-09_23:15:58.976715) 23:16:00.264000 run osmo-msc_10.42.42.6(pid=28579): stderr: | 20221209231559301 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209231559302 DLGLOBAL DEBUG validating counter group 0x7fa0eb9b3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209231559302 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209231559302 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209231559302 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209231559302 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209231559304 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209231559304 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209231559304 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209231559304 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:16:00.316535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28572): Terminating (SIGTERM) 23:16:00.359052 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28575): Terminating (SIGTERM) 23:16:00.401593 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28578): Terminating (SIGTERM) 23:16:00.444413 --- ParallelTerminationStrategy: PID 28572 died... 23:16:00.464752 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28572): Terminated: ok {rc=0} 23:16:00.512126 --- ParallelTerminationStrategy: PID 28575 died... 23:16:00.531812 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28575): Terminated: ok {rc=0} 23:16:00.578734 --- ParallelTerminationStrategy: PID 28578 died... 23:16:00.598894 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28578): Terminated: ok {rc=0} 23:16:00.689006 bus /sierra_3: Setting Powered False 23:16:01.792092 bus /sierra_3: Setting Powered False 23:16:02.912711 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 23:16:04.067814 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:16:04.080372 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 23:16:04.138729 tst mo_mt_call_osmux.py: using LAC 24343 23:16:04.272260 tst mo_mt_call_osmux.py: using RAC 118 23:16:04.408556 tst mo_mt_call_osmux.py: using CellId 24343 23:16:04.539541 tst mo_mt_call_osmux.py: using BVCI 24344 23:16:04.662244 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:16:04.673922 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:16:04.685327 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:16:04.696838 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:16:04.708533 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:16:04.720295 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:16:04.841714 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:16:04.966332 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:16:05.489646 run create_hlr_db(pid=28581): Launched 23:16:05.619900 bus /sierra_2: Setting Powered False 23:16:06.686566 run create_hlr_db(pid=28581): Terminated: ok {rc=0} 23:16:07.136458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28583): Launched 23:16:07.453499 run osmo-hlr_10.42.42.2(pid=28584): Launched 23:16:07.576029 run osmo-stp_10.42.42.5: Starting osmo-stp 23:16:08.137513 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28586): Launched 23:16:08.454978 run osmo-stp_10.42.42.5(pid=28587): Launched 23:16:08.576361 run osmo-msc_10.42.42.6: Starting osmo-msc 23:16:09.144403 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28589): Launched 23:16:09.461018 run osmo-msc_10.42.42.6(pid=28590): Launched 23:16:09.650890 run osmo-stp_10.42.42.5(pid=28587): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28587)] 23:16:09.795946 run osmo-stp_10.42.42.5(pid=28587): stdout: | (launched: 2022-12-09_23:16:08.395785) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:16:09.940129 run osmo-stp_10.42.42.5(pid=28587): stderr: | 20221209231608571 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209231608571 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209231608571 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209231608572 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209231608572 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209231608572 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209231608572 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:16:10.083105 run osmo-stp_10.42.42.5(pid=28587): stdout: | (launched: 2022-12-09_23:16:08.395785) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:16:10.217845 run osmo-stp_10.42.42.5(pid=28587): stderr: | 20221209231608571 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209231608571 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209231608571 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209231608572 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209231608572 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209231608572 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209231608572 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:16:10.378822 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28587): Process ended prematurely: osmo-stp_10.42.42.5(pid=28587) [trial-2366↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28587)] [trial-2366↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 23:16:10.388900 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 23:16:10.418194 run osmo-hlr_10.42.42.2(pid=28584): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28584)] 23:16:10.469592 run osmo-hlr_10.42.42.2(pid=28584): stdout: | (launched: 2022-12-09_23:16:07.394610) 23:16:10.522572 run osmo-hlr_10.42.42.2(pid=28584): stderr: | 20221209231607574 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209231607574 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209231607574 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209231607574 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209231607574 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209231607574 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209231607586 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209231607594 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209231607595 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209231607595 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:16:10.596039 run osmo-msc_10.42.42.6(pid=28590): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28590)] 23:16:10.647480 run osmo-msc_10.42.42.6(pid=28590): stdout: | (launched: 2022-12-09_23:16:09.402075) 23:16:10.700808 run osmo-msc_10.42.42.6(pid=28590): stderr: | 20221209231609723 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209231609723 DLGLOBAL DEBUG validating counter group 0x7fe50109cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209231609724 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209231609724 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209231609724 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209231609724 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209231609726 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209231609726 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209231609726 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209231609726 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:16:10.754195 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28583): Terminating (SIGTERM) 23:16:10.796873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28586): Terminating (SIGTERM) 23:16:10.839878 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28589): Terminating (SIGTERM) 23:16:10.883058 --- ParallelTerminationStrategy: PID 28583 died... 23:16:10.903285 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28583): Terminated: ok {rc=0} 23:16:10.950956 --- ParallelTerminationStrategy: PID 28586 died... 23:16:10.971158 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28586): Terminated: ok {rc=0} 23:16:11.018930 --- ParallelTerminationStrategy: PID 28589 died... 23:16:11.038840 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28589): Terminated: ok {rc=0} 23:16:11.128762 bus /sierra_3: Setting Powered False 23:16:12.228088 bus /sierra_3: Setting Powered False 23:16:13.343425 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 23:16:14.572014 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:16:14.578108 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 23:16:14.598753 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 23:16:14.625244 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 23:16:14.675355 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 23:16:14.695737 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 23:16:14.721856 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 23:16:15.275718 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 23:16:15.324179 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:16:15.335247 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 23:16:15.393029 tst mo_mt_call.py: using LAC 24344 23:16:15.511134 tst mo_mt_call.py: using RAC 119 23:16:15.629294 tst mo_mt_call.py: using CellId 24344 23:16:15.747529 tst mo_mt_call.py: using BVCI 24345 23:16:15.871248 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:16:15.883454 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:16:15.895611 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:16:15.909270 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:16:15.923951 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:16:15.936354 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:16:16.064634 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:16:16.186674 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:16:16.723790 run create_hlr_db(pid=28596): Launched 23:16:16.885800 bus /sierra_2: Setting Powered False 23:16:17.950529 run create_hlr_db(pid=28596): Terminated: ok {rc=0} 23:16:18.387471 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28598): Launched 23:16:18.690843 run osmo-hlr_10.42.42.2(pid=28599): Launched 23:16:18.805869 run osmo-stp_10.42.42.5: Starting osmo-stp 23:16:19.326154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28601): Launched 23:16:19.629448 run osmo-stp_10.42.42.5(pid=28602): Launched 23:16:19.744771 run osmo-msc_10.42.42.6: Starting osmo-msc 23:16:20.296799 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28604): Launched 23:16:20.600447 run osmo-msc_10.42.42.6(pid=28605): Launched 23:16:20.768920 run osmo-stp_10.42.42.5(pid=28602): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28602)] 23:16:20.896665 run osmo-stp_10.42.42.5(pid=28602): stdout: | (launched: 2022-12-09_23:16:19.572156) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:16:21.024603 run osmo-stp_10.42.42.5(pid=28602): stderr: | 20221209231619744 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209231619745 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209231619746 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209231619746 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209231619747 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209231619747 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209231619747 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:16:21.150496 run osmo-stp_10.42.42.5(pid=28602): stdout: | (launched: 2022-12-09_23:16:19.572156) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:16:21.271471 run osmo-stp_10.42.42.5(pid=28602): stderr: | 20221209231619744 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209231619745 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209231619746 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209231619746 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209231619747 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209231619747 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209231619747 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:16:21.415775 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28602): Process ended prematurely: osmo-stp_10.42.42.5(pid=28602) [trial-2366↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28602)] [trial-2366↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 23:16:21.424584 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 23:16:21.450740 run osmo-hlr_10.42.42.2(pid=28599): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28599)] 23:16:21.498057 run osmo-hlr_10.42.42.2(pid=28599): stdout: | (launched: 2022-12-09_23:16:18.634146) 23:16:21.547637 run osmo-hlr_10.42.42.2(pid=28599): stderr: | 20221209231618810 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209231618810 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209231618810 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209231618810 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209231618810 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209231618810 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209231618825 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209231618834 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209231618834 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209231618834 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:16:21.616229 run osmo-msc_10.42.42.6(pid=28605): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28605)] 23:16:21.663809 run osmo-msc_10.42.42.6(pid=28605): stdout: | (launched: 2022-12-09_23:16:20.543631) 23:16:21.713194 run osmo-msc_10.42.42.6(pid=28605): stderr: | 20221209231620814 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209231620815 DLGLOBAL DEBUG validating counter group 0x7ff947d88c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209231620815 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209231620815 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209231620815 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209231620815 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209231620817 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209231620817 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209231620818 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209231620818 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:16:21.762499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28598): Terminating (SIGTERM) 23:16:21.802099 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28601): Terminating (SIGTERM) 23:16:21.841759 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28604): Terminating (SIGTERM) 23:16:21.881722 --- ParallelTerminationStrategy: PID 28598 died... 23:16:21.900810 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28598): Terminated: ok {rc=0} 23:16:21.945384 --- ParallelTerminationStrategy: PID 28601 died... 23:16:21.964349 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28601): Terminated: ok {rc=0} 23:16:22.009131 --- ParallelTerminationStrategy: PID 28604 died... 23:16:22.027973 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28604): Terminated: ok {rc=0} 23:16:22.111239 bus /sierra_3: Setting Powered False 23:16:23.209768 bus /sierra_3: Setting Powered False 23:16:24.326156 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 23:16:25.475427 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:16:25.487502 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 23:16:25.545895 tst mo_mt_call_osmux.py: using LAC 24345 23:16:25.664795 tst mo_mt_call_osmux.py: using RAC 120 23:16:25.783812 tst mo_mt_call_osmux.py: using CellId 24345 23:16:25.904923 tst mo_mt_call_osmux.py: using BVCI 24346 23:16:26.016724 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:16:26.028694 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:16:26.039760 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:16:26.050741 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:16:26.061676 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:16:26.072521 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:16:26.192169 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:16:26.311997 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:16:26.818735 run create_hlr_db(pid=28607): Launched 23:16:26.942747 bus /sierra_2: Setting Powered False 23:16:28.007203 run create_hlr_db(pid=28607): Terminated: ok {rc=0} 23:16:28.443407 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28609): Launched 23:16:28.748046 run osmo-hlr_10.42.42.2(pid=28610): Launched 23:16:28.863451 run osmo-stp_10.42.42.5: Starting osmo-stp 23:16:29.404060 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28612): Launched 23:16:29.706902 run osmo-stp_10.42.42.5(pid=28613): Launched 23:16:29.820836 run osmo-msc_10.42.42.6: Starting osmo-msc 23:16:30.368363 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28615): Launched 23:16:30.671312 run osmo-msc_10.42.42.6(pid=28616): Launched 23:16:30.864595 run osmo-stp_10.42.42.5(pid=28613): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28613)] 23:16:31.113416 run osmo-stp_10.42.42.5(pid=28613): stdout: | (launched: 2022-12-09_23:16:29.650279) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:16:31.399673 run osmo-stp_10.42.42.5(pid=28613): stderr: | 20221209231629821 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209231629821 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209231629821 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209231629822 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209231629824 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209231629824 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209231629824 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:16:31.563286 run osmo-stp_10.42.42.5(pid=28613): stdout: | (launched: 2022-12-09_23:16:29.650279) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:16:31.697538 run osmo-stp_10.42.42.5(pid=28613): stderr: | 20221209231629821 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209231629821 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209231629821 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209231629822 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209231629824 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209231629824 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209231629824 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:16:31.858595 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28613): Process ended prematurely: osmo-stp_10.42.42.5(pid=28613) [trial-2366↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28613)] [trial-2366↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 23:16:31.869227 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 23:16:31.900925 run osmo-hlr_10.42.42.2(pid=28610): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28610)] 23:16:31.955005 run osmo-hlr_10.42.42.2(pid=28610): stdout: | (launched: 2022-12-09_23:16:28.691490) 23:16:32.010378 run osmo-hlr_10.42.42.2(pid=28610): stderr: | 20221209231628869 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209231628869 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209231628869 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209231628869 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209231628869 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209231628869 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209231628881 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209231628890 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209231628890 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209231628890 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:16:32.085566 run osmo-msc_10.42.42.6(pid=28616): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28616)] 23:16:32.138732 run osmo-msc_10.42.42.6(pid=28616): stdout: | (launched: 2022-12-09_23:16:30.614364) 23:16:32.193536 run osmo-msc_10.42.42.6(pid=28616): stderr: | 20221209231630944 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209231630944 DLGLOBAL DEBUG validating counter group 0x7f96fff09c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209231630944 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209231630944 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209231630945 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209231630946 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209231630952 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209231630953 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209231630953 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209231630953 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:16:32.248393 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28609): Terminating (SIGTERM) 23:16:32.292680 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28612): Terminating (SIGTERM) 23:16:32.335235 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28615): Terminating (SIGTERM) 23:16:32.378477 --- ParallelTerminationStrategy: PID 28609 died... 23:16:32.398421 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28609): Terminated: ok {rc=0} 23:16:32.446279 --- ParallelTerminationStrategy: PID 28612 died... 23:16:32.465878 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28612): Terminated: ok {rc=0} 23:16:32.513572 --- ParallelTerminationStrategy: PID 28615 died... 23:16:32.533094 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28615): Terminated: ok {rc=0} 23:16:32.622225 bus /sierra_3: Setting Powered False 23:16:33.720255 bus /sierra_3: Setting Powered False 23:16:34.837820 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 voice:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 23:16:36.075639 tst voice:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:16:36.081812 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 23:16:36.103229 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 23:16:36.131521 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 23:16:36.183728 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 23:16:36.205041 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 23:16:36.232671 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 23:16:36.782846 tst voice:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 23:16:36.835449 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:16:36.846686 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:16:36.904621 tst mo_mt_call.py: using LAC 24346 23:16:37.031913 tst mo_mt_call.py: using RAC 121 23:16:37.158808 tst mo_mt_call.py: using CellId 24346 23:16:37.289702 tst mo_mt_call.py: using BVCI 24347 23:16:37.409549 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:16:37.420849 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:16:37.431944 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:16:37.443172 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:16:37.454542 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:16:37.465973 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:16:37.587757 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:16:37.705527 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:16:38.178183 run create_hlr_db(pid=28621): Launched 23:16:38.302258 bus /sierra_2: Setting Powered False 23:16:39.362502 run create_hlr_db(pid=28621): Terminated: ok {rc=0} 23:16:39.807111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28623): Launched 23:16:40.135047 run osmo-hlr_10.42.42.2(pid=28624): Launched 23:16:40.261616 run osmo-stp_10.42.42.5: Starting osmo-stp 23:16:40.827534 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28626): Launched 23:16:41.154754 run osmo-stp_10.42.42.5(pid=28627): Launched 23:16:41.279025 run osmo-msc_10.42.42.6: Starting osmo-msc 23:16:41.868132 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28629): Launched 23:16:42.195176 run osmo-msc_10.42.42.6(pid=28630): Launched 23:16:42.377140 run osmo-stp_10.42.42.5(pid=28627): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28627)] 23:16:42.517935 run osmo-stp_10.42.42.5(pid=28627): stdout: | (launched: 2022-12-09_23:16:41.094145) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:16:42.655353 run osmo-stp_10.42.42.5(pid=28627): stderr: | 20221209231641287 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209231641287 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209231641287 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209231641288 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209231641288 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209231641288 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209231641288 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:16:42.791362 run osmo-stp_10.42.42.5(pid=28627): stdout: | (launched: 2022-12-09_23:16:41.094145) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:16:42.920814 run osmo-stp_10.42.42.5(pid=28627): stderr: | 20221209231641287 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209231641287 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209231641287 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209231641288 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209231641288 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209231641288 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209231641288 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:16:43.076438 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28627): Process ended prematurely: osmo-stp_10.42.42.5(pid=28627) [trial-2366↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28627)] [trial-2366↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 23:16:43.086046 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 23:16:43.114272 run osmo-hlr_10.42.42.2(pid=28624): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28624)] 23:16:43.164447 run osmo-hlr_10.42.42.2(pid=28624): stdout: | (launched: 2022-12-09_23:16:40.074783) 23:16:43.216377 run osmo-hlr_10.42.42.2(pid=28624): stderr: | 20221209231640274 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209231640274 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209231640274 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209231640275 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209231640275 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209231640275 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209231640287 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209231640296 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209231640296 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209231640296 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:16:43.288727 run osmo-msc_10.42.42.6(pid=28630): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28630)] 23:16:43.339188 run osmo-msc_10.42.42.6(pid=28630): stdout: | (launched: 2022-12-09_23:16:42.134276) 23:16:43.391154 run osmo-msc_10.42.42.6(pid=28630): stderr: | 20221209231642457 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209231642457 DLGLOBAL DEBUG validating counter group 0x7efc84782c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209231642457 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209231642457 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209231642457 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209231642457 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209231642459 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209231642459 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209231642459 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209231642459 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:16:43.443429 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28623): Terminating (SIGTERM) 23:16:43.485441 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28626): Terminating (SIGTERM) 23:16:43.527450 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28629): Terminating (SIGTERM) 23:16:43.569782 --- ParallelTerminationStrategy: PID 28623 died... 23:16:43.589834 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28623): Terminated: ok {rc=0} 23:16:43.636676 --- ParallelTerminationStrategy: PID 28626 died... 23:16:43.656198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28626): Terminated: ok {rc=0} 23:16:43.702765 --- ParallelTerminationStrategy: PID 28629 died... 23:16:43.722260 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28629): Terminated: ok {rc=0} 23:16:43.810695 bus /sierra_3: Setting Powered False 23:16:44.909383 bus /sierra_3: Setting Powered False 23:16:46.025006 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 23:16:47.177623 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:16:47.189981 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:16:47.247747 tst mo_mt_call_osmux.py: using LAC 24347 23:16:47.374318 tst mo_mt_call_osmux.py: using RAC 122 23:16:47.500338 tst mo_mt_call_osmux.py: using CellId 24347 23:16:47.629814 tst mo_mt_call_osmux.py: using BVCI 24348 23:16:47.748253 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:16:47.759750 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:16:47.770790 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:16:47.782135 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:16:47.793439 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:16:47.804729 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:16:47.921309 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:16:48.039450 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:16:48.507684 run create_hlr_db(pid=28632): Launched 23:16:48.632128 bus /sierra_2: Setting Powered False 23:16:49.692748 run create_hlr_db(pid=28632): Terminated: ok {rc=0} 23:16:50.136224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28634): Launched 23:16:50.459821 run osmo-hlr_10.42.42.2(pid=28635): Launched 23:16:50.582739 run osmo-stp_10.42.42.5: Starting osmo-stp 23:16:51.142484 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28637): Launched 23:16:51.465523 run osmo-stp_10.42.42.5(pid=28638): Launched 23:16:51.588634 run osmo-msc_10.42.42.6: Starting osmo-msc 23:16:52.174085 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28640): Launched 23:16:52.498389 run osmo-msc_10.42.42.6(pid=28641): Launched 23:16:52.681567 run osmo-stp_10.42.42.5(pid=28638): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28638)] 23:16:52.824098 run osmo-stp_10.42.42.5(pid=28638): stdout: | (launched: 2022-12-09_23:16:51.405885) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:16:52.960212 run osmo-stp_10.42.42.5(pid=28638): stderr: | 20221209231651601 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209231651602 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209231651602 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209231651602 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209231651603 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209231651603 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209231651603 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:16:53.110637 run osmo-stp_10.42.42.5(pid=28638): stdout: | (launched: 2022-12-09_23:16:51.405885) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:16:53.237536 run osmo-stp_10.42.42.5(pid=28638): stderr: | 20221209231651601 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209231651602 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209231651602 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209231651602 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209231651603 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209231651603 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209231651603 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:16:53.389406 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28638): Process ended prematurely: osmo-stp_10.42.42.5(pid=28638) [trial-2366↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28638)] [trial-2366↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 23:16:53.398797 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 23:16:53.426554 run osmo-hlr_10.42.42.2(pid=28635): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28635)] 23:16:53.476555 run osmo-hlr_10.42.42.2(pid=28635): stdout: | (launched: 2022-12-09_23:16:50.400011) 23:16:53.528422 run osmo-hlr_10.42.42.2(pid=28635): stderr: | 20221209231650602 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209231650602 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209231650602 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209231650602 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209231650602 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209231650602 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209231650615 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209231650625 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209231650626 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209231650626 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:16:53.600142 run osmo-msc_10.42.42.6(pid=28641): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28641)] 23:16:53.650180 run osmo-msc_10.42.42.6(pid=28641): stdout: | (launched: 2022-12-09_23:16:52.437766) 23:16:53.702297 run osmo-msc_10.42.42.6(pid=28641): stderr: | 20221209231652765 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209231652765 DLGLOBAL DEBUG validating counter group 0x7ff3e9ac4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209231652765 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209231652765 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209231652765 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209231652766 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209231652767 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209231652768 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209231652768 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209231652768 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:16:53.754389 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28634): Terminating (SIGTERM) 23:16:53.796186 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28637): Terminating (SIGTERM) 23:16:53.837860 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28640): Terminating (SIGTERM) 23:16:53.879613 --- ParallelTerminationStrategy: PID 28634 died... 23:16:53.899314 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28634): Terminated: ok {rc=0} 23:16:53.945466 --- ParallelTerminationStrategy: PID 28637 died... 23:16:53.964617 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28637): Terminated: ok {rc=0} 23:16:54.010966 --- ParallelTerminationStrategy: PID 28640 died... 23:16:54.030260 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28640): Terminated: ok {rc=0} 23:16:54.117414 bus /sierra_3: Setting Powered False 23:16:55.214859 bus /sierra_3: Setting Powered False 23:16:56.331009 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 voice:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 emergency:sysmo --------------------------------------------------------------------- 23:16:57.561795 tst emergency:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:16:57.566428 tst emergency:sysmo: Verifying 1 x bts (candidates: 11) 23:16:57.587931 tst emergency:sysmo: Verifying 6 x ip_address (candidates: 9) 23:16:57.615087 tst emergency:sysmo: Verifying 4 x modem (candidates: 12) 23:16:57.701098 tst emergency:sysmo: Reserving 1 x bts (candidates: 11) 23:16:57.722340 tst emergency:sysmo: Reserving 6 x ip_address (candidates: 9) 23:16:57.750221 tst emergency:sysmo: Reserving 4 x modem (candidates: 12) 23:16:58.331229 tst emergency:sysmo: RESERVED RESOURCES for emergency: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2366 emergency:sysmo emergency_mo_mt_call.py ---------------------------------------------- 23:16:58.336369 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 23:16:58.347071 tst emergency:sysmo: Using 1 x bts (candidates: 1) 23:16:58.382448 tst emergency_mo_mt_call.py: using LAC 24348 23:16:58.498865 tst emergency_mo_mt_call.py: using RAC 123 23:16:58.616437 tst emergency_mo_mt_call.py: using CellId 24348 23:16:58.736498 tst emergency_mo_mt_call.py: using BVCI 24349 23:16:58.843544 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 23:16:58.854060 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 23:16:58.864354 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 23:16:58.874647 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 23:16:58.884823 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 23:16:58.895114 tst emergency:sysmo: Using 1 x modem (candidates: 4) 23:16:59.010850 tst emergency:sysmo: Using 1 x modem (candidates: 4) 23:16:59.126529 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:16:59.578369 run create_hlr_db(pid=28646): Launched 23:16:59.696796 bus /sierra_2: Setting Powered False 23:17:00.755406 run create_hlr_db(pid=28646): Terminated: ok {rc=0} 23:17:01.211539 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28651): Launched 23:17:01.532790 run osmo-hlr_10.42.42.2(pid=28652): Launched 23:17:01.745510 run osmo-stp_10.42.42.5: Starting osmo-stp 23:17:02.394335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28654): Launched 23:17:02.709087 run osmo-stp_10.42.42.5(pid=28655): Launched 23:17:02.830862 tst emergency_mo_mt_call.py: using MSISDN 7432 23:17:02.998606 run osmo-msc_10.42.42.6: Starting osmo-msc 23:17:03.560321 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28657): Launched 23:17:03.871265 run osmo-msc_10.42.42.6(pid=28658): Launched 23:17:04.045161 run osmo-stp_10.42.42.5(pid=28655): ERR: Terminated: ERROR {rc=1} [trial-2366↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28655)] 23:17:04.176752 run osmo-stp_10.42.42.5(pid=28655): stdout: | (launched: 2022-12-09_23:17:02.656499) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:17:04.308852 run osmo-stp_10.42.42.5(pid=28655): stderr: | 20221209231702824 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209231702824 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209231702824 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209231702824 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209231702828 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209231702829 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209231702829 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:17:04.441163 run osmo-stp_10.42.42.5(pid=28655): stdout: | (launched: 2022-12-09_23:17:02.656499) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:17:04.565718 run osmo-stp_10.42.42.5(pid=28655): stderr: | 20221209231702824 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209231702824 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209231702824 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209231702824 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209231702828 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209231702829 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209231702829 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:17:04.714845 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=28655): Process ended prematurely: osmo-stp_10.42.42.5(pid=28655) [trial-2366↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28655)] [trial-2366↪emergency:sysmo↪emergency_mo_mt_call.py:19] 23:17:04.723781 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 23:17:04.751228 run osmo-hlr_10.42.42.2(pid=28652): ERR: Terminated: ERROR {rc=237} [trial-2366↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28652)] 23:17:04.801176 run osmo-hlr_10.42.42.2(pid=28652): stdout: | (launched: 2022-12-09_23:17:01.462239) 23:17:04.852553 run osmo-hlr_10.42.42.2(pid=28652): stderr: | 20221209231701826 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209231701826 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209231701826 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209231701826 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209231701826 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209231701826 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209231701852 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/emergency:sysmo/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209231701869 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209231701869 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209231701869 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:17:04.924155 run osmo-msc_10.42.42.6(pid=28658): ERR: Terminated: ERROR {rc=2} [trial-2366↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28658)] 23:17:04.973970 run osmo-msc_10.42.42.6(pid=28658): stdout: | (launched: 2022-12-09_23:17:03.815087) 23:17:05.025709 run osmo-msc_10.42.42.6(pid=28658): stderr: | 20221209231704135 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209231704135 DLGLOBAL DEBUG validating counter group 0x7f10730cfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209231704135 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209231704135 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209231704135 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209231704135 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209231704138 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209231704138 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209231704138 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209231704138 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:17:05.077610 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28651): Terminating (SIGTERM) 23:17:05.119181 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28654): Terminating (SIGTERM) 23:17:05.161050 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28657): Terminating (SIGTERM) 23:17:05.203112 --- ParallelTerminationStrategy: PID 28651 died... 23:17:05.223020 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28651): Terminated: ok {rc=0} 23:17:05.269559 --- ParallelTerminationStrategy: PID 28654 died... 23:17:05.289148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28654): Terminated: ok {rc=0} 23:17:05.335616 --- ParallelTerminationStrategy: PID 28657 died... 23:17:05.355308 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28657): Terminated: ok {rc=0} 23:17:05.443148 bus /sierra_3: Setting Powered False 23:17:06.542165 bus /sierra_3: Setting Powered False 23:17:07.658068 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 emergency:sysmo emergency_preemptive_call.py ---------------------------------------------- 23:17:08.745217 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 23:17:08.756862 tst emergency:sysmo: Using 1 x bts (candidates: 1) 23:17:08.795941 tst emergency_preemptive_call.py: using LAC 24349 23:17:08.920470 tst emergency_preemptive_call.py: using RAC 124 23:17:09.043371 tst emergency_preemptive_call.py: using CellId 24349 23:17:09.168064 tst emergency_preemptive_call.py: using BVCI 24350 23:17:09.283469 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 23:17:09.294689 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 23:17:09.305746 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 23:17:09.316874 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 23:17:09.327968 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 23:17:09.338965 tst emergency:sysmo: Using 1 x modem (candidates: 4) 23:17:09.454354 tst emergency:sysmo: Using 1 x modem (candidates: 4) 23:17:09.572507 tst emergency:sysmo: Using 1 x modem (candidates: 4) 23:17:09.689305 tst emergency:sysmo: Using 1 x modem (candidates: 4) 23:17:09.803627 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:17:10.255250 run create_hlr_db(pid=28660): Launched 23:17:10.374429 bus /sierra_2: Setting Powered False 23:17:11.432743 run create_hlr_db(pid=28660): Terminated: ok {rc=0} 23:17:11.859703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28662): Launched 23:17:12.173612 run osmo-hlr_10.42.42.2(pid=28663): Launched 23:17:12.294385 run osmo-stp_10.42.42.5: Starting osmo-stp 23:17:12.837331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28665): Launched 23:17:13.149919 run osmo-stp_10.42.42.5(pid=28666): Launched 23:17:13.282424 tst emergency_preemptive_call.py: using MSISDN 7433 23:17:13.445773 run osmo-msc_10.42.42.6: Starting osmo-msc 23:17:14.005589 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28668): Launched 23:17:14.317333 run osmo-msc_10.42.42.6(pid=28669): Launched 23:17:14.498112 run osmo-stp_10.42.42.5(pid=28666): ERR: Terminated: ERROR {rc=1} [trial-2366↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28666)] 23:17:14.631363 run osmo-stp_10.42.42.5(pid=28666): stdout: | (launched: 2022-12-09_23:17:13.092909) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:17:14.764875 run osmo-stp_10.42.42.5(pid=28666): stderr: | 20221209231713283 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209231713283 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209231713283 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209231713284 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209231713284 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209231713284 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209231713284 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:17:14.897641 run osmo-stp_10.42.42.5(pid=28666): stdout: | (launched: 2022-12-09_23:17:13.092909) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:17:15.023206 run osmo-stp_10.42.42.5(pid=28666): stderr: | 20221209231713283 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209231713283 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209231713283 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209231713284 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209231713284 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209231713284 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209231713284 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:17:15.172395 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=28666): Process ended prematurely: osmo-stp_10.42.42.5(pid=28666) [trial-2366↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28666)] [trial-2366↪emergency:sysmo↪emergency_preemptive_call.py:32] 23:17:15.181262 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 23:17:15.209169 run osmo-hlr_10.42.42.2(pid=28663): ERR: Terminated: ERROR {rc=237} [trial-2366↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28663)] 23:17:15.258963 run osmo-hlr_10.42.42.2(pid=28663): stdout: | (launched: 2022-12-09_23:17:12.117264) 23:17:15.310893 run osmo-hlr_10.42.42.2(pid=28663): stderr: | 20221209231712313 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209231712313 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209231712313 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209231712313 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209231712313 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209231712313 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209231712325 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/emergency:sysmo/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209231712333 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209231712333 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209231712334 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:17:15.382726 run osmo-msc_10.42.42.6(pid=28669): ERR: Terminated: ERROR {rc=2} [trial-2366↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28669)] 23:17:15.432486 run osmo-msc_10.42.42.6(pid=28669): stdout: | (launched: 2022-12-09_23:17:14.260838) 23:17:15.483815 run osmo-msc_10.42.42.6(pid=28669): stderr: | 20221209231714582 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209231714582 DLGLOBAL DEBUG validating counter group 0x7f56c8677c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209231714582 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209231714583 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209231714583 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209231714583 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209231714585 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209231714585 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209231714585 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209231714585 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:17:15.535582 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28662): Terminating (SIGTERM) 23:17:15.577182 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28665): Terminating (SIGTERM) 23:17:15.618835 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28668): Terminating (SIGTERM) 23:17:15.660493 --- ParallelTerminationStrategy: PID 28662 died... 23:17:15.680279 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28662): Terminated: ok {rc=0} 23:17:15.727020 --- ParallelTerminationStrategy: PID 28665 died... 23:17:15.746480 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28665): Terminated: ok {rc=0} 23:17:15.792923 --- ParallelTerminationStrategy: PID 28668 died... 23:17:15.812532 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28668): Terminated: ok {rc=0} 23:17:15.907227 bus /sierra_9: Setting Powered False 23:17:17.016251 bus /sierra_9: Setting Powered False 23:17:18.142207 bus /sierra_8: Setting Powered False 23:17:19.240836 bus /sierra_8: Setting Powered False 23:17:20.355432 bus /sierra_3: Setting Powered False 23:17:21.449130 bus /sierra_3: Setting Powered False 23:17:22.560776 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 emergency:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 gprs:sysmo --------------------------------------------------------------------- 23:17:23.818218 tst gprs:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:17:23.822754 tst gprs:sysmo: Verifying 1 x bts (candidates: 11) 23:17:23.844230 tst gprs:sysmo: Verifying 9 x ip_address (candidates: 9) 23:17:23.884007 tst gprs:sysmo: Verifying 4 x modem (candidates: 12) 23:17:23.971269 tst gprs:sysmo: Reserving 1 x bts (candidates: 11) 23:17:23.992393 tst gprs:sysmo: Reserving 9 x ip_address (candidates: 9) 23:17:24.032514 tst gprs:sysmo: Reserving 4 x modem (candidates: 12) 23:17:24.624916 tst gprs:sysmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2366 gprs:sysmo cs_paging_gprs_active.py ---------------------------------------------- 23:17:24.678207 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:17:24.689072 tst gprs:sysmo: Using 1 x bts (candidates: 1) 23:17:24.725303 tst cs_paging_gprs_active.py: using LAC 24350 23:17:24.851351 tst cs_paging_gprs_active.py: using RAC 125 23:17:24.974785 tst cs_paging_gprs_active.py: using CellId 24350 23:17:25.101476 tst cs_paging_gprs_active.py: using BVCI 24351 23:17:25.217261 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:17:25.227981 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:17:25.238738 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:17:25.249713 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:17:25.260608 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:17:25.271581 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:17:25.282568 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:17:25.293500 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:17:25.304516 tst gprs:sysmo: Using 1 x modem (candidates: 4) 23:17:25.420069 tst gprs:sysmo: Using 1 x modem (candidates: 4) 23:17:25.534450 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:17:25.735837 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:17:26.035466 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28674): Launched 23:17:26.295408 run iperf3-srv_10.42.42.10(pid=28675): Launched 23:17:26.406755 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:17:26.606374 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:17:26.903148 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28676): Launched 23:17:27.160857 run iperf3-srv_10.42.42.10(pid=28677): Launched 23:17:27.272214 tst cs_paging_gprs_active.py:38: start network... 23:17:27.471624 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:17:27.930544 run create_hlr_db(pid=28678): Launched 23:17:28.052631 bus /sierra_2: Setting Powered False 23:17:29.111902 run create_hlr_db(pid=28678): Terminated: ok {rc=0} 23:17:29.546084 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28680): Launched 23:17:29.864404 run osmo-hlr_10.42.42.2(pid=28681): Launched 23:17:29.986444 run osmo-stp_10.42.42.5: Starting osmo-stp 23:17:30.538481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28683): Launched 23:17:30.873755 run osmo-stp_10.42.42.5(pid=28684): Launched 23:17:31.189485 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:17:32.725734 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28686): Launched 23:17:32.839686 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:17:33.092798 run patchelf(pid=28687): Launched 23:17:33.258782 run osmo-stp_10.42.42.5(pid=28684): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28684)] 23:17:33.384201 run osmo-stp_10.42.42.5(pid=28684): stdout: | (launched: 2022-12-09_23:17:30.799047) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:17:33.511465 run osmo-stp_10.42.42.5(pid=28684): stderr: | 20221209231731052 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209231731052 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209231731052 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209231731057 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209231731058 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209231731058 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209231731058 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:17:33.638633 run osmo-stp_10.42.42.5(pid=28684): stdout: | (launched: 2022-12-09_23:17:30.799047) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:17:33.760355 run osmo-stp_10.42.42.5(pid=28684): stderr: | 20221209231731052 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209231731052 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209231731052 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209231731057 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209231731058 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209231731058 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209231731058 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:17:33.904075 run patchelf(pid=28687): Terminating (SIGINT) 23:17:34.070921 run patchelf(pid=28687): Terminated: ok {rc=0} 23:17:34.191524 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=28684): Process ended prematurely: osmo-stp_10.42.42.5(pid=28684) [trial-2366↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28684)] [trial-2366↪gprs:sysmo↪cs_paging_gprs_active.py:38] 23:17:34.200729 tst cs_paging_gprs_active.py:38: Test FAILED (9.6 sec) 23:17:34.227907 run osmo-hlr_10.42.42.2(pid=28681): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:sysmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28681)] 23:17:34.275367 run osmo-hlr_10.42.42.2(pid=28681): stdout: | (launched: 2022-12-09_23:17:29.807077) 23:17:34.324730 run osmo-hlr_10.42.42.2(pid=28681): stderr: | 20221209231730005 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209231730006 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209231730006 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209231730006 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209231730006 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209231730006 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209231730017 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:sysmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209231730026 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209231730026 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209231730026 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:17:34.374446 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28674): Terminating (SIGTERM) 23:17:34.413872 run iperf3-srv_10.42.42.10(pid=28675): Terminating (SIGTERM) 23:17:34.453251 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28676): Terminating (SIGTERM) 23:17:34.492688 run iperf3-srv_10.42.42.10(pid=28677): Terminating (SIGTERM) 23:17:34.531967 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28680): Terminating (SIGTERM) 23:17:34.571823 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28683): Terminating (SIGTERM) 23:17:34.611516 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28686): Terminating (SIGTERM) 23:17:34.651164 --- ParallelTerminationStrategy: PID 28674 died... 23:17:34.670049 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28674): Terminated: ok {rc=0} 23:17:34.713814 --- ParallelTerminationStrategy: PID 28675 died... 23:17:34.732278 run iperf3-srv_10.42.42.10(pid=28675): Terminated {rc=256} 23:17:34.775879 --- ParallelTerminationStrategy: PID 28676 died... 23:17:34.794334 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28676): Terminated: ok {rc=0} 23:17:34.837898 --- ParallelTerminationStrategy: PID 28677 died... 23:17:34.856411 run iperf3-srv_10.42.42.10(pid=28677): Terminated {rc=256} 23:17:34.899665 --- ParallelTerminationStrategy: PID 28680 died... 23:17:34.918337 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28680): Terminated: ok {rc=0} 23:17:34.961964 --- ParallelTerminationStrategy: PID 28683 died... 23:17:34.980439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28683): Terminated: ok {rc=0} 23:17:35.024670 --- ParallelTerminationStrategy: PID 28686 died... 23:17:35.043439 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28686): Terminated: ok {rc=0} 23:17:35.129855 bus /gobi_0: Setting Powered False 23:17:36.229037 bus /gobi_0: Setting Powered False 23:17:37.343548 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:sysmo iperf3.py ---------------------------------------------- 23:17:38.493275 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:17:38.504631 tst gprs:sysmo: Using 1 x bts (candidates: 1) 23:17:38.541280 tst iperf3.py: using LAC 24351 23:17:38.668017 tst iperf3.py: using RAC 126 23:17:38.791935 tst iperf3.py: using CellId 24351 23:17:38.917916 tst iperf3.py: using BVCI 24352 23:17:39.034270 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:17:39.045147 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:17:39.055829 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:17:39.066944 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:17:39.077967 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:17:39.088850 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:17:39.099939 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:17:39.110958 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:17:39.122083 tst gprs:sysmo: Using 1 x modem (candidates: 4) 23:17:39.236768 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:17:39.437391 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:17:39.735016 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28688): Launched 23:17:39.992197 run iperf3-srv_10.42.42.10(pid=28689): Launched 23:17:40.102894 tst iperf3.py:8: start network... 23:17:40.300836 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:17:40.759254 run create_hlr_db(pid=28690): Launched 23:17:40.880015 bus /gobi_6: Setting Powered False 23:17:41.938429 run create_hlr_db(pid=28690): Terminated: ok {rc=0} 23:17:42.372087 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28692): Launched 23:17:42.690370 run osmo-hlr_10.42.42.2(pid=28693): Launched 23:17:42.812477 run osmo-stp_10.42.42.5: Starting osmo-stp 23:17:43.360027 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28695): Launched 23:17:43.675539 run osmo-stp_10.42.42.5(pid=28696): Launched 23:17:43.796795 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:17:44.344473 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28698): Launched 23:17:44.466295 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:17:44.735126 run patchelf(pid=28699): Launched 23:17:44.912282 run osmo-stp_10.42.42.5(pid=28696): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28696)] 23:17:45.047283 run osmo-stp_10.42.42.5(pid=28696): stdout: | (launched: 2022-12-09_23:17:43.618543) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:17:45.184360 run osmo-stp_10.42.42.5(pid=28696): stderr: | 20221209231743809 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209231743809 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209231743809 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209231743809 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209231743810 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209231743810 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209231743810 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:17:45.321338 run osmo-stp_10.42.42.5(pid=28696): stdout: | (launched: 2022-12-09_23:17:43.618543) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:17:45.451911 run osmo-stp_10.42.42.5(pid=28696): stderr: | 20221209231743809 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209231743809 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209231743809 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209231743809 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209231743810 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209231743810 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209231743810 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:17:45.606957 run patchelf(pid=28699): Terminating (SIGINT) 23:17:45.785946 run patchelf(pid=28699): Terminated: ok {rc=0} 23:17:45.933096 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28696): Process ended prematurely: osmo-stp_10.42.42.5(pid=28696) [trial-2366↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28696)] [trial-2366↪gprs:sysmo↪iperf3.py:8] 23:17:45.943618 tst iperf3.py:8: Test FAILED (7.5 sec) 23:17:45.972745 run osmo-hlr_10.42.42.2(pid=28693): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:sysmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28693)] 23:17:46.021908 run osmo-hlr_10.42.42.2(pid=28693): stdout: | (launched: 2022-12-09_23:17:42.632720) 23:17:46.072476 run osmo-hlr_10.42.42.2(pid=28693): stderr: | 20221209231742828 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209231742828 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209231742828 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209231742828 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209231742828 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209231742828 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209231742840 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:sysmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209231742848 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209231742848 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209231742848 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:17:46.123144 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28688): Terminating (SIGTERM) 23:17:46.165502 run iperf3-srv_10.42.42.10(pid=28689): Terminating (SIGTERM) 23:17:46.209281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28692): Terminating (SIGTERM) 23:17:46.264926 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28695): Terminating (SIGTERM) 23:17:46.312916 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28698): Terminating (SIGTERM) 23:17:46.357700 --- ParallelTerminationStrategy: PID 28688 died... 23:17:46.376612 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28688): Terminated: ok {rc=0} 23:17:46.423469 --- ParallelTerminationStrategy: PID 28689 died... 23:17:46.442526 run iperf3-srv_10.42.42.10(pid=28689): Terminated {rc=256} 23:17:46.487122 --- ParallelTerminationStrategy: PID 28692 died... 23:17:46.506092 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28692): Terminated: ok {rc=0} 23:17:46.551747 --- ParallelTerminationStrategy: PID 28695 died... 23:17:46.570979 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28695): Terminated: ok {rc=0} 23:17:46.615792 --- ParallelTerminationStrategy: PID 28698 died... 23:17:46.635398 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28698): Terminated: ok {rc=0} 23:17:46.723428 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:sysmo iperf3m4.py ---------------------------------------------- 23:17:47.869532 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:17:47.880401 tst gprs:sysmo: Using 1 x bts (candidates: 1) 23:17:47.916165 tst iperf3m4.py: using LAC 24352 23:17:48.033175 tst iperf3m4.py: using RAC 127 23:17:48.147773 tst iperf3m4.py: using CellId 24352 23:17:48.262398 tst iperf3m4.py: using BVCI 24353 23:17:48.369639 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:17:48.380012 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:17:48.390370 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:17:48.400518 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:17:48.410643 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:17:48.420768 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:17:48.431137 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:17:48.441357 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:17:48.451775 tst gprs:sysmo: Using 1 x modem (candidates: 4) 23:17:48.568246 tst gprs:sysmo: Using 1 x modem (candidates: 4) 23:17:48.686070 tst gprs:sysmo: Using 1 x modem (candidates: 4) 23:17:48.801146 tst gprs:sysmo: Using 1 x modem (candidates: 4) 23:17:48.920316 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:17:49.137285 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:17:49.457315 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28700): Launched 23:17:49.734165 run iperf3-srv_10.42.42.10(pid=28701): Launched 23:17:49.853337 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:17:50.069958 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:17:50.389556 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28702): Launched 23:17:50.667331 run iperf3-srv_10.42.42.10(pid=28703): Launched 23:17:50.786463 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:17:51.001448 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:17:51.321031 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28704): Launched 23:17:51.596657 run iperf3-srv_10.42.42.10(pid=28705): Launched 23:17:51.715337 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:17:51.929972 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:17:52.249271 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28706): Launched 23:17:52.540009 run iperf3-srv_10.42.42.10(pid=28707): Launched 23:17:52.659004 tst iperf3m4.py:8: start network... 23:17:52.874217 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:17:53.371012 run create_hlr_db(pid=28708): Launched 23:17:53.492224 bus /gobi_6: Setting Powered False 23:17:54.554885 run create_hlr_db(pid=28708): Terminated: ok {rc=0} 23:17:54.999024 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28710): Launched 23:17:55.317179 run osmo-hlr_10.42.42.2(pid=28711): Launched 23:17:55.438987 run osmo-stp_10.42.42.5: Starting osmo-stp 23:17:55.992771 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28713): Launched 23:17:56.309453 run osmo-stp_10.42.42.5(pid=28714): Launched 23:17:56.431413 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:17:56.981070 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28716): Launched 23:17:57.103329 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:17:57.372127 run patchelf(pid=28717): Launched 23:17:57.548837 run osmo-stp_10.42.42.5(pid=28714): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28714)] 23:17:57.683725 run osmo-stp_10.42.42.5(pid=28714): stdout: | (launched: 2022-12-09_23:17:56.252133) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:17:57.820734 run osmo-stp_10.42.42.5(pid=28714): stderr: | 20221209231756444 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209231756444 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209231756444 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209231756444 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209231756445 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209231756445 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209231756445 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:17:57.957821 run osmo-stp_10.42.42.5(pid=28714): stdout: | (launched: 2022-12-09_23:17:56.252133) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:17:58.089024 run osmo-stp_10.42.42.5(pid=28714): stderr: | 20221209231756444 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209231756444 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209231756444 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209231756444 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209231756445 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209231756445 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209231756445 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:17:58.243913 run patchelf(pid=28717): Terminating (SIGINT) 23:17:58.422925 run patchelf(pid=28717): Terminated: ok {rc=0} 23:17:58.551779 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28714): Process ended prematurely: osmo-stp_10.42.42.5(pid=28714) [trial-2366↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28714)] [trial-2366↪gprs:sysmo↪iperf3m4.py:8] 23:17:58.561901 tst iperf3m4.py:8: Test FAILED (10.7 sec) 23:17:58.590930 run osmo-hlr_10.42.42.2(pid=28711): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:sysmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28711)] 23:17:58.641189 run osmo-hlr_10.42.42.2(pid=28711): stdout: | (launched: 2022-12-09_23:17:55.259540) 23:17:58.692727 run osmo-hlr_10.42.42.2(pid=28711): stderr: | 20221209231755456 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209231755456 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209231755456 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209231755456 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209231755456 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209231755456 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209231755468 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:sysmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209231755476 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209231755476 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209231755476 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:17:58.744898 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28700): Terminating (SIGTERM) 23:17:58.786788 run iperf3-srv_10.42.42.10(pid=28701): Terminating (SIGTERM) 23:17:58.828456 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28702): Terminating (SIGTERM) 23:17:58.870198 run iperf3-srv_10.42.42.10(pid=28703): Terminating (SIGTERM) 23:17:58.911939 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28704): Terminating (SIGTERM) 23:17:58.953755 run iperf3-srv_10.42.42.10(pid=28705): Terminating (SIGTERM) 23:17:58.995467 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28706): Terminating (SIGTERM) 23:17:59.037548 run iperf3-srv_10.42.42.10(pid=28707): Terminating (SIGTERM) 23:17:59.079240 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28710): Terminating (SIGTERM) 23:17:59.121014 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28713): Terminating (SIGTERM) 23:17:59.162944 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28716): Terminating (SIGTERM) 23:17:59.204755 --- ParallelTerminationStrategy: PID 28700 died... 23:17:59.224544 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28700): Terminated: ok {rc=0} 23:17:59.270989 --- ParallelTerminationStrategy: PID 28701 died... 23:17:59.290418 run iperf3-srv_10.42.42.10(pid=28701): Terminated {rc=256} 23:17:59.336642 --- ParallelTerminationStrategy: PID 28702 died... 23:17:59.355968 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28702): Terminated: ok {rc=0} 23:17:59.401955 --- ParallelTerminationStrategy: PID 28703 died... 23:17:59.421359 run iperf3-srv_10.42.42.10(pid=28703): Terminated {rc=256} 23:17:59.467507 --- ParallelTerminationStrategy: PID 28704 died... 23:17:59.486901 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28704): Terminated: ok {rc=0} 23:17:59.533050 --- ParallelTerminationStrategy: PID 28705 died... 23:17:59.552308 run iperf3-srv_10.42.42.10(pid=28705): Terminated {rc=256} 23:17:59.598258 --- ParallelTerminationStrategy: PID 28706 died... 23:17:59.617554 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28706): Terminated: ok {rc=0} 23:17:59.663560 --- ParallelTerminationStrategy: PID 28707 died... 23:17:59.682830 run iperf3-srv_10.42.42.10(pid=28707): Terminated {rc=256} 23:17:59.728733 --- ParallelTerminationStrategy: PID 28710 died... 23:17:59.748067 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28710): Terminated: ok {rc=0} 23:17:59.794205 --- ParallelTerminationStrategy: PID 28713 died... 23:17:59.813565 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28713): Terminated: ok {rc=0} 23:17:59.859799 --- ParallelTerminationStrategy: PID 28716 died... 23:17:59.879295 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28716): Terminated: ok {rc=0} 23:17:59.967345 bus /gobi_4: Setting Powered False 23:18:01.065800 bus /gobi_4: Setting Powered False 23:18:02.190892 bus /gobi_1: Setting Powered False 23:18:03.290082 bus /gobi_1: Setting Powered False 23:18:04.403867 bus /gobi_0: Setting Powered False 23:18:05.502185 bus /gobi_0: Setting Powered False 23:18:06.617417 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:sysmo ping.py ---------------------------------------------- 23:18:07.718945 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:18:07.730604 tst gprs:sysmo: Using 1 x bts (candidates: 1) 23:18:07.766355 tst ping.py: using LAC 24353 23:18:07.888857 tst ping.py: using RAC 128 23:18:08.010628 tst ping.py: using CellId 24353 23:18:08.134701 tst ping.py: using BVCI 24354 23:18:08.248826 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:18:08.259729 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:18:08.270656 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:18:08.281616 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:18:08.292411 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:18:08.303264 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:18:08.314352 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:18:08.325351 tst gprs:sysmo: Using 1 x modem (candidates: 4) 23:18:08.438157 tst ping.py:19: start network... 23:18:08.632489 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:18:09.084314 run create_hlr_db(pid=28718): Launched 23:18:09.203430 bus /gobi_6: Setting Powered False 23:18:10.263403 run create_hlr_db(pid=28718): Terminated: ok {rc=0} 23:18:10.670073 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28720): Launched 23:18:10.960641 run osmo-hlr_10.42.42.2(pid=28721): Launched 23:18:11.070926 run osmo-stp_10.42.42.5: Starting osmo-stp 23:18:11.586589 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28723): Launched 23:18:11.874566 run osmo-stp_10.42.42.5(pid=28724): Launched 23:18:11.984722 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:18:12.485749 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28726): Launched 23:18:12.597233 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:18:12.842978 run patchelf(pid=28727): Launched 23:18:13.005251 run osmo-stp_10.42.42.5(pid=28724): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28724)] 23:18:13.128840 run osmo-stp_10.42.42.5(pid=28724): stdout: | (launched: 2022-12-09_23:18:11.822030) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:18:13.253751 run osmo-stp_10.42.42.5(pid=28724): stderr: | 20221209231811992 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209231811992 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209231811993 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209231811993 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209231811995 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209231811995 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209231811995 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:18:13.378728 run osmo-stp_10.42.42.5(pid=28724): stdout: | (launched: 2022-12-09_23:18:11.822030) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:18:13.498019 run osmo-stp_10.42.42.5(pid=28724): stderr: | 20221209231811992 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209231811992 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209231811993 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209231811993 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209231811995 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209231811995 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209231811995 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:18:13.639393 run patchelf(pid=28727): Terminating (SIGINT) 23:18:13.802462 run patchelf(pid=28727): Terminated: ok {rc=0} 23:18:13.920027 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=28724): Process ended prematurely: osmo-stp_10.42.42.5(pid=28724) [trial-2366↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28724)] [trial-2366↪gprs:sysmo↪ping.py:22] 23:18:13.928935 tst ping.py:22: Test FAILED (6.2 sec) 23:18:13.955154 run osmo-hlr_10.42.42.2(pid=28721): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:sysmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28721)] 23:18:14.002089 run osmo-hlr_10.42.42.2(pid=28721): stdout: | (launched: 2022-12-09_23:18:10.907652) 23:18:14.050998 run osmo-hlr_10.42.42.2(pid=28721): stderr: | 20221209231811081 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209231811081 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209231811081 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209231811081 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209231811081 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209231811081 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209231811094 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:sysmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209231811102 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209231811102 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209231811102 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:18:14.100391 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28720): Terminating (SIGTERM) 23:18:14.139710 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28723): Terminating (SIGTERM) 23:18:14.179260 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28726): Terminating (SIGTERM) 23:18:14.219129 --- ParallelTerminationStrategy: PID 28720 died... 23:18:14.238260 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28720): Terminated: ok {rc=0} 23:18:14.282178 --- ParallelTerminationStrategy: PID 28723 died... 23:18:14.300906 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28723): Terminated: ok {rc=0} 23:18:14.344843 --- ParallelTerminationStrategy: PID 28726 died... 23:18:14.363640 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28726): Terminated: ok {rc=0} 23:18:14.449448 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:sysmo ping_idle_ping.py ---------------------------------------------- 23:18:15.535207 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:18:15.546369 tst gprs:sysmo: Using 1 x bts (candidates: 1) 23:18:15.582173 tst ping_idle_ping.py: using LAC 24354 23:18:15.699016 tst ping_idle_ping.py: using RAC 129 23:18:15.821817 tst ping_idle_ping.py: using CellId 24354 23:18:15.962300 tst ping_idle_ping.py: using BVCI 24355 23:18:16.091500 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:18:16.103483 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:18:16.115501 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:18:16.127737 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:18:16.140237 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:18:16.154607 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:18:16.167408 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 23:18:16.179251 tst gprs:sysmo: Using 1 x modem (candidates: 4) 23:18:16.313454 tst ping_idle_ping.py:24: start network... 23:18:16.541133 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:18:17.127245 run create_hlr_db(pid=28728): Launched 23:18:17.286635 bus /gobi_6: Setting Powered False 23:18:18.348712 run create_hlr_db(pid=28728): Terminated: ok {rc=0} 23:18:18.767017 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28730): Launched 23:18:19.058104 run osmo-hlr_10.42.42.2(pid=28731): Launched 23:18:19.168487 run osmo-stp_10.42.42.5: Starting osmo-stp 23:18:19.684361 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28733): Launched 23:18:19.973367 run osmo-stp_10.42.42.5(pid=28734): Launched 23:18:20.084587 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:18:20.589634 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28736): Launched 23:18:20.700497 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:18:20.946475 run patchelf(pid=28737): Launched 23:18:21.108139 run osmo-stp_10.42.42.5(pid=28734): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28734)] 23:18:21.231472 run osmo-stp_10.42.42.5(pid=28734): stdout: | (launched: 2022-12-09_23:18:19.920644) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:18:21.356587 run osmo-stp_10.42.42.5(pid=28734): stderr: | 20221209231820090 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209231820090 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209231820090 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209231820091 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209231820091 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209231820091 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209231820091 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:18:21.481408 run osmo-stp_10.42.42.5(pid=28734): stdout: | (launched: 2022-12-09_23:18:19.920644) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:18:21.600468 run osmo-stp_10.42.42.5(pid=28734): stderr: | 20221209231820090 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209231820090 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209231820090 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209231820091 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209231820091 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209231820091 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209231820091 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:18:21.741929 run patchelf(pid=28737): Terminating (SIGINT) 23:18:21.905213 run patchelf(pid=28737): Terminated: ok {rc=0} 23:18:22.023094 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=28734): Process ended prematurely: osmo-stp_10.42.42.5(pid=28734) [trial-2366↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28734)] [trial-2366↪gprs:sysmo↪ping_idle_ping.py:27] 23:18:22.031616 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 23:18:22.057726 run osmo-hlr_10.42.42.2(pid=28731): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:sysmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28731)] 23:18:22.105052 run osmo-hlr_10.42.42.2(pid=28731): stdout: | (launched: 2022-12-09_23:18:19.005139) 23:18:22.153814 run osmo-hlr_10.42.42.2(pid=28731): stderr: | 20221209231819180 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209231819180 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209231819180 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209231819181 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209231819181 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209231819181 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209231819193 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:sysmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209231819201 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209231819202 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209231819202 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:18:22.202877 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28730): Terminating (SIGTERM) 23:18:22.242107 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28733): Terminating (SIGTERM) 23:18:22.282119 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28736): Terminating (SIGTERM) 23:18:22.321493 --- ParallelTerminationStrategy: PID 28730 died... 23:18:22.340292 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28730): Terminated: ok {rc=0} 23:18:22.384342 --- ParallelTerminationStrategy: PID 28733 died... 23:18:22.402954 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28733): Terminated: ok {rc=0} 23:18:22.446939 --- ParallelTerminationStrategy: PID 28736 died... 23:18:22.465448 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28736): Terminated: ok {rc=0} 23:18:22.548421 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2366 gprs:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 gprs:sysmo+mod-bts0-egprs --------------------------------------------------------------------- 23:18:23.838170 tst gprs:sysmo+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:18:23.844110 tst gprs:sysmo+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 23:18:23.866269 tst gprs:sysmo+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 23:18:23.908254 tst gprs:sysmo+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 23:18:23.994357 tst gprs:sysmo+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 23:18:24.015446 tst gprs:sysmo+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 23:18:24.057054 tst gprs:sysmo+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 23:18:24.652584 tst gprs:sysmo+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2366 gprs:sysmo+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 23:18:24.706042 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:18:24.717351 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:18:24.753350 tst cs_paging_gprs_active.py: using LAC 24355 23:18:24.877234 tst cs_paging_gprs_active.py: using RAC 130 23:18:25.005394 tst cs_paging_gprs_active.py: using CellId 24355 23:18:25.130635 tst cs_paging_gprs_active.py: using BVCI 24356 23:18:25.247407 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:18:25.258818 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:18:25.269950 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:18:25.281535 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:18:25.293030 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:18:25.304357 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:18:25.316050 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:18:25.327808 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:18:25.339711 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:18:25.456786 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:18:25.574766 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:18:25.775814 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:18:26.074581 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28741): Launched 23:18:26.333518 run iperf3-srv_10.42.42.10(pid=28742): Launched 23:18:26.445939 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:18:26.646384 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:18:26.946506 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28743): Launched 23:18:27.226601 run iperf3-srv_10.42.42.10(pid=28744): Launched 23:18:27.346374 tst cs_paging_gprs_active.py:38: start network... 23:18:27.562853 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:18:28.057312 run create_hlr_db(pid=28745): Launched 23:18:28.179111 bus /gobi_6: Setting Powered False 23:18:29.242335 run create_hlr_db(pid=28745): Terminated: ok {rc=0} 23:18:29.686911 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28747): Launched 23:18:30.005591 run osmo-hlr_10.42.42.2(pid=28748): Launched 23:18:30.128712 run osmo-stp_10.42.42.5: Starting osmo-stp 23:18:30.679366 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28750): Launched 23:18:31.019222 run osmo-stp_10.42.42.5(pid=28751): Launched 23:18:31.374636 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:18:31.974775 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28753): Launched 23:18:32.109234 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:18:32.382244 run patchelf(pid=28754): Launched 23:18:32.559692 run osmo-stp_10.42.42.5(pid=28751): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28751)] 23:18:32.695560 run osmo-stp_10.42.42.5(pid=28751): stdout: | (launched: 2022-12-09_23:18:30.957126) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:18:32.833136 run osmo-stp_10.42.42.5(pid=28751): stderr: | 20221209231831195 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209231831195 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209231831196 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209231831197 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209231831198 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209231831198 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209231831199 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:18:32.970617 run osmo-stp_10.42.42.5(pid=28751): stdout: | (launched: 2022-12-09_23:18:30.957126) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:18:33.103100 run osmo-stp_10.42.42.5(pid=28751): stderr: | 20221209231831195 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209231831195 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209231831196 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209231831197 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209231831198 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209231831198 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209231831199 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:18:33.259021 run patchelf(pid=28754): Terminating (SIGINT) 23:18:33.438828 run patchelf(pid=28754): Terminated: ok {rc=0} 23:18:33.568534 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=28751): Process ended prematurely: osmo-stp_10.42.42.5(pid=28751) [trial-2366↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28751)] [trial-2366↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 23:18:33.578763 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 23:18:33.607852 run osmo-hlr_10.42.42.2(pid=28748): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28748)] 23:18:33.658214 run osmo-hlr_10.42.42.2(pid=28748): stdout: | (launched: 2022-12-09_23:18:29.948249) 23:18:33.710547 run osmo-hlr_10.42.42.2(pid=28748): stderr: | 20221209231830144 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209231830144 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209231830144 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209231830144 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209231830144 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209231830144 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209231830155 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:sysmo+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209231830164 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209231830164 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209231830164 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:18:33.763255 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28741): Terminating (SIGTERM) 23:18:33.805955 run iperf3-srv_10.42.42.10(pid=28742): Terminating (SIGTERM) 23:18:33.848262 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28743): Terminating (SIGTERM) 23:18:33.890575 run iperf3-srv_10.42.42.10(pid=28744): Terminating (SIGTERM) 23:18:33.932605 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28747): Terminating (SIGTERM) 23:18:33.974945 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28750): Terminating (SIGTERM) 23:18:34.017225 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28753): Terminating (SIGTERM) 23:18:34.059915 --- ParallelTerminationStrategy: PID 28741 died... 23:18:34.080055 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28741): Terminated: ok {rc=0} 23:18:34.127131 --- ParallelTerminationStrategy: PID 28742 died... 23:18:34.146783 run iperf3-srv_10.42.42.10(pid=28742): Terminated {rc=256} 23:18:34.193481 --- ParallelTerminationStrategy: PID 28743 died... 23:18:34.213193 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28743): Terminated: ok {rc=0} 23:18:34.259646 --- ParallelTerminationStrategy: PID 28744 died... 23:18:34.279288 run iperf3-srv_10.42.42.10(pid=28744): Terminated {rc=256} 23:18:34.325887 --- ParallelTerminationStrategy: PID 28747 died... 23:18:34.345468 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28747): Terminated: ok {rc=0} 23:18:34.392635 --- ParallelTerminationStrategy: PID 28750 died... 23:18:34.412330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28750): Terminated: ok {rc=0} 23:18:34.459530 --- ParallelTerminationStrategy: PID 28753 died... 23:18:34.479204 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28753): Terminated: ok {rc=0} 23:18:34.567445 bus /gobi_0: Setting Powered False 23:18:35.665601 bus /gobi_0: Setting Powered False 23:18:36.781161 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:sysmo+mod-bts0-egprs iperf3.py ---------------------------------------------- 23:18:37.929325 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:18:37.941587 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:18:37.980721 tst iperf3.py: using LAC 24356 23:18:38.108048 tst iperf3.py: using RAC 131 23:18:38.234165 tst iperf3.py: using CellId 24356 23:18:38.359039 tst iperf3.py: using BVCI 24357 23:18:38.475023 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:18:38.486595 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:18:38.497885 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:18:38.509576 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:18:38.521133 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:18:38.532469 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:18:38.544166 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:18:38.555623 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:18:38.567337 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:18:38.685581 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:18:38.886502 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:18:39.183792 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28755): Launched 23:18:39.440409 run iperf3-srv_10.42.42.10(pid=28756): Launched 23:18:39.550893 tst iperf3.py:8: start network... 23:18:39.749002 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:18:40.207081 run create_hlr_db(pid=28757): Launched 23:18:40.327764 bus /gobi_6: Setting Powered False 23:18:41.387953 run create_hlr_db(pid=28757): Terminated: ok {rc=0} 23:18:41.821825 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28759): Launched 23:18:42.140165 run osmo-hlr_10.42.42.2(pid=28760): Launched 23:18:42.262413 run osmo-stp_10.42.42.5: Starting osmo-stp 23:18:42.815901 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28762): Launched 23:18:43.134190 run osmo-stp_10.42.42.5(pid=28763): Launched 23:18:43.255039 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:18:43.804835 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28765): Launched 23:18:43.926648 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:18:44.196221 run patchelf(pid=28766): Launched 23:18:44.373712 run osmo-stp_10.42.42.5(pid=28763): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28763)] 23:18:44.508546 run osmo-stp_10.42.42.5(pid=28763): stdout: | (launched: 2022-12-09_23:18:43.076591) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:18:44.645733 run osmo-stp_10.42.42.5(pid=28763): stderr: | 20221209231843267 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209231843267 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209231843268 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209231843268 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209231843269 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209231843269 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209231843269 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:18:44.782619 run osmo-stp_10.42.42.5(pid=28763): stdout: | (launched: 2022-12-09_23:18:43.076591) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:18:44.913497 run osmo-stp_10.42.42.5(pid=28763): stderr: | 20221209231843267 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209231843267 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209231843268 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209231843268 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209231843269 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209231843269 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209231843269 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:18:45.068658 run patchelf(pid=28766): Terminating (SIGINT) 23:18:45.248106 run patchelf(pid=28766): Terminated: ok {rc=0} 23:18:45.377665 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28763): Process ended prematurely: osmo-stp_10.42.42.5(pid=28763) [trial-2366↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28763)] [trial-2366↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8] 23:18:45.387661 tst iperf3.py:8: Test FAILED (7.5 sec) 23:18:45.416814 run osmo-hlr_10.42.42.2(pid=28760): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:sysmo+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28760)] 23:18:45.467410 run osmo-hlr_10.42.42.2(pid=28760): stdout: | (launched: 2022-12-09_23:18:42.082843) 23:18:45.519649 run osmo-hlr_10.42.42.2(pid=28760): stderr: | 20221209231842280 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209231842280 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209231842280 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209231842280 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209231842281 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209231842281 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209231842298 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:sysmo+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209231842307 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209231842307 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209231842307 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:18:45.572311 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28755): Terminating (SIGTERM) 23:18:45.614699 run iperf3-srv_10.42.42.10(pid=28756): Terminating (SIGTERM) 23:18:45.657081 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28759): Terminating (SIGTERM) 23:18:45.699563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28762): Terminating (SIGTERM) 23:18:45.741810 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28765): Terminating (SIGTERM) 23:18:45.784477 --- ParallelTerminationStrategy: PID 28755 died... 23:18:45.804614 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28755): Terminated: ok {rc=0} 23:18:45.861746 --- ParallelTerminationStrategy: PID 28756 died... 23:18:45.888797 run iperf3-srv_10.42.42.10(pid=28756): Terminated {rc=256} 23:18:45.952178 --- ParallelTerminationStrategy: PID 28759 died... 23:18:45.971371 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28759): Terminated: ok {rc=0} 23:18:46.018928 --- ParallelTerminationStrategy: PID 28762 died... 23:18:46.038424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28762): Terminated: ok {rc=0} 23:18:46.085258 --- ParallelTerminationStrategy: PID 28765 died... 23:18:46.104795 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28765): Terminated: ok {rc=0} 23:18:46.197464 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:sysmo+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 23:18:47.357868 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:18:47.369804 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:18:47.406361 tst iperf3m4.py: using LAC 24357 23:18:47.529535 tst iperf3m4.py: using RAC 132 23:18:47.654989 tst iperf3m4.py: using CellId 24357 23:18:47.778330 tst iperf3m4.py: using BVCI 24358 23:18:47.895504 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:18:47.906741 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:18:47.917828 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:18:47.928901 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:18:47.940632 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:18:47.952041 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:18:47.963591 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:18:47.974691 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:18:47.986132 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:18:48.102677 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:18:48.223171 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:18:48.338442 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:18:48.456757 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:18:48.673665 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:18:48.995124 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28767): Launched 23:18:49.273218 run iperf3-srv_10.42.42.10(pid=28768): Launched 23:18:49.392777 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:18:49.608145 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:18:49.928269 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28769): Launched 23:18:50.205346 run iperf3-srv_10.42.42.10(pid=28770): Launched 23:18:50.324782 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:18:50.540734 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:18:50.861169 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28771): Launched 23:18:51.138488 run iperf3-srv_10.42.42.10(pid=28772): Launched 23:18:51.258029 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:18:51.473398 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:18:51.792814 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28773): Launched 23:18:52.069535 run iperf3-srv_10.42.42.10(pid=28774): Launched 23:18:52.189647 tst iperf3m4.py:8: start network... 23:18:52.406418 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:18:52.904589 run create_hlr_db(pid=28775): Launched 23:18:53.026596 bus /gobi_6: Setting Powered False 23:18:54.090419 run create_hlr_db(pid=28775): Terminated: ok {rc=0} 23:18:54.536142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28777): Launched 23:18:54.853954 run osmo-hlr_10.42.42.2(pid=28778): Launched 23:18:54.975378 run osmo-stp_10.42.42.5: Starting osmo-stp 23:18:55.525666 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28780): Launched 23:18:55.844585 run osmo-stp_10.42.42.5(pid=28781): Launched 23:18:55.966299 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:18:56.516548 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28783): Launched 23:18:56.638409 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:18:56.907283 run patchelf(pid=28784): Launched 23:18:57.084627 run osmo-stp_10.42.42.5(pid=28781): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28781)] 23:18:57.220004 run osmo-stp_10.42.42.5(pid=28781): stdout: | (launched: 2022-12-09_23:18:55.786512) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:18:57.358047 run osmo-stp_10.42.42.5(pid=28781): stderr: | 20221209231855977 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209231855977 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209231855978 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209231855978 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209231855980 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209231855980 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209231855980 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:18:57.495480 run osmo-stp_10.42.42.5(pid=28781): stdout: | (launched: 2022-12-09_23:18:55.786512) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:18:57.626886 run osmo-stp_10.42.42.5(pid=28781): stderr: | 20221209231855977 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209231855977 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209231855978 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209231855978 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209231855980 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209231855980 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209231855980 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:18:57.782044 run patchelf(pid=28784): Terminating (SIGINT) 23:18:57.961043 run patchelf(pid=28784): Terminated: ok {rc=0} 23:18:58.090829 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28781): Process ended prematurely: osmo-stp_10.42.42.5(pid=28781) [trial-2366↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28781)] [trial-2366↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8] 23:18:58.101026 tst iperf3m4.py:8: Test FAILED (10.8 sec) 23:18:58.130242 run osmo-hlr_10.42.42.2(pid=28778): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28778)] 23:18:58.180770 run osmo-hlr_10.42.42.2(pid=28778): stdout: | (launched: 2022-12-09_23:18:54.796706) 23:18:58.232895 run osmo-hlr_10.42.42.2(pid=28778): stderr: | 20221209231854992 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209231854992 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209231854993 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209231854993 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209231854993 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209231854993 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209231855005 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:sysmo+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209231855014 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209231855014 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209231855014 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:18:58.285489 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28767): Terminating (SIGTERM) 23:18:58.327583 run iperf3-srv_10.42.42.10(pid=28768): Terminating (SIGTERM) 23:18:58.369634 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28769): Terminating (SIGTERM) 23:18:58.411701 run iperf3-srv_10.42.42.10(pid=28770): Terminating (SIGTERM) 23:18:58.453598 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28771): Terminating (SIGTERM) 23:18:58.495519 run iperf3-srv_10.42.42.10(pid=28772): Terminating (SIGTERM) 23:18:58.537530 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28773): Terminating (SIGTERM) 23:18:58.579588 run iperf3-srv_10.42.42.10(pid=28774): Terminating (SIGTERM) 23:18:58.621560 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28777): Terminating (SIGTERM) 23:18:58.663679 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28780): Terminating (SIGTERM) 23:18:58.705586 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28783): Terminating (SIGTERM) 23:18:58.748159 --- ParallelTerminationStrategy: PID 28767 died... 23:18:58.768364 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28767): Terminated: ok {rc=0} 23:18:58.815322 --- ParallelTerminationStrategy: PID 28768 died... 23:18:58.834985 run iperf3-srv_10.42.42.10(pid=28768): Terminated {rc=256} 23:18:58.881469 --- ParallelTerminationStrategy: PID 28769 died... 23:18:58.900775 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28769): Terminated: ok {rc=0} 23:18:58.947733 --- ParallelTerminationStrategy: PID 28770 died... 23:18:58.967414 run iperf3-srv_10.42.42.10(pid=28770): Terminated {rc=256} 23:18:59.013743 --- ParallelTerminationStrategy: PID 28771 died... 23:18:59.033175 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28771): Terminated: ok {rc=0} 23:18:59.080115 --- ParallelTerminationStrategy: PID 28772 died... 23:18:59.099934 run iperf3-srv_10.42.42.10(pid=28772): Terminated {rc=256} 23:18:59.146507 --- ParallelTerminationStrategy: PID 28773 died... 23:18:59.166232 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28773): Terminated: ok {rc=0} 23:18:59.212910 --- ParallelTerminationStrategy: PID 28774 died... 23:18:59.232400 run iperf3-srv_10.42.42.10(pid=28774): Terminated {rc=256} 23:18:59.279910 --- ParallelTerminationStrategy: PID 28777 died... 23:18:59.299529 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28777): Terminated: ok {rc=0} 23:18:59.346061 --- ParallelTerminationStrategy: PID 28780 died... 23:18:59.365810 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28780): Terminated: ok {rc=0} 23:18:59.412344 --- ParallelTerminationStrategy: PID 28783 died... 23:18:59.432075 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28783): Terminated: ok {rc=0} 23:18:59.520702 bus /gobi_4: Setting Powered False 23:19:00.620631 bus /gobi_4: Setting Powered False 23:19:01.739317 bus /gobi_1: Setting Powered False 23:19:02.838949 bus /gobi_1: Setting Powered False 23:19:03.953379 bus /gobi_0: Setting Powered False 23:19:05.052490 bus /gobi_0: Setting Powered False 23:19:06.170861 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:sysmo+mod-bts0-egprs ping.py ---------------------------------------------- 23:19:07.273687 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:19:07.285673 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:19:07.324310 tst ping.py: using LAC 24358 23:19:07.449465 tst ping.py: using RAC 133 23:19:07.572593 tst ping.py: using CellId 24358 23:19:07.697204 tst ping.py: using BVCI 24359 23:19:07.804902 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:19:07.815804 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:19:07.826991 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:19:07.838088 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:19:07.849237 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:19:07.860264 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:19:07.871770 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:19:07.882516 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:19:07.998191 tst ping.py:19: start network... 23:19:08.195655 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:19:08.649187 run create_hlr_db(pid=28785): Launched 23:19:08.768905 bus /gobi_6: Setting Powered False 23:19:09.832208 run create_hlr_db(pid=28785): Terminated: ok {rc=0} 23:19:10.271198 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28787): Launched 23:19:10.583779 run osmo-hlr_10.42.42.2(pid=28788): Launched 23:19:10.703942 run osmo-stp_10.42.42.5: Starting osmo-stp 23:19:11.245667 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28790): Launched 23:19:11.557984 run osmo-stp_10.42.42.5(pid=28791): Launched 23:19:11.677985 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:19:12.217507 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28793): Launched 23:19:12.337586 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:19:12.602999 run patchelf(pid=28794): Launched 23:19:12.776846 run osmo-stp_10.42.42.5(pid=28791): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28791)] 23:19:12.909350 run osmo-stp_10.42.42.5(pid=28791): stdout: | (launched: 2022-12-09_23:19:11.501447) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:19:13.043957 run osmo-stp_10.42.42.5(pid=28791): stderr: | 20221209231911690 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209231911690 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209231911690 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209231911690 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209231911693 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209231911693 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209231911693 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:19:13.179325 run osmo-stp_10.42.42.5(pid=28791): stdout: | (launched: 2022-12-09_23:19:11.501447) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:19:13.307803 run osmo-stp_10.42.42.5(pid=28791): stderr: | 20221209231911690 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209231911690 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209231911690 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209231911690 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209231911693 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209231911693 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209231911693 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:19:13.460665 run patchelf(pid=28794): Terminating (SIGINT) 23:19:13.636218 run patchelf(pid=28794): Terminated: ok {rc=0} 23:19:13.762714 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=28791): Process ended prematurely: osmo-stp_10.42.42.5(pid=28791) [trial-2366↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28791)] [trial-2366↪gprs:sysmo+mod-bts0-egprs↪ping.py:22] 23:19:13.772138 tst ping.py:22: Test FAILED (6.5 sec) 23:19:13.800782 run osmo-hlr_10.42.42.2(pid=28788): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:sysmo+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28788)] 23:19:13.851599 run osmo-hlr_10.42.42.2(pid=28788): stdout: | (launched: 2022-12-09_23:19:10.527092) 23:19:13.904031 run osmo-hlr_10.42.42.2(pid=28788): stderr: | 20221209231910723 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209231910724 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209231910724 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209231910724 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209231910724 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209231910724 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209231910736 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:sysmo+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209231910745 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209231910745 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209231910745 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:19:13.956924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28787): Terminating (SIGTERM) 23:19:13.999064 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28790): Terminating (SIGTERM) 23:19:14.041199 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28793): Terminating (SIGTERM) 23:19:14.083830 --- ParallelTerminationStrategy: PID 28787 died... 23:19:14.103965 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28787): Terminated: ok {rc=0} 23:19:14.151080 --- ParallelTerminationStrategy: PID 28790 died... 23:19:14.171086 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28790): Terminated: ok {rc=0} 23:19:14.217990 --- ParallelTerminationStrategy: PID 28793 died... 23:19:14.237791 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28793): Terminated: ok {rc=0} 23:19:14.325587 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:sysmo+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 23:19:15.412291 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:19:15.424140 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:19:15.466745 tst ping_idle_ping.py: using LAC 24359 23:19:15.583480 tst ping_idle_ping.py: using RAC 134 23:19:15.699592 tst ping_idle_ping.py: using CellId 24359 23:19:15.814138 tst ping_idle_ping.py: using BVCI 24360 23:19:15.943874 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:19:15.957247 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:19:15.970272 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:19:15.983187 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:19:15.995434 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:19:16.008051 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:19:16.020621 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:19:16.033155 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:19:16.158384 tst ping_idle_ping.py:24: start network... 23:19:16.414991 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:19:16.922771 run create_hlr_db(pid=28795): Launched 23:19:17.067672 bus /gobi_6: Setting Powered False 23:19:18.130511 run create_hlr_db(pid=28795): Terminated: ok {rc=0} 23:19:18.568721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28797): Launched 23:19:18.882473 run osmo-hlr_10.42.42.2(pid=28798): Launched 23:19:19.002133 run osmo-stp_10.42.42.5: Starting osmo-stp 23:19:19.545411 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28800): Launched 23:19:19.858598 run osmo-stp_10.42.42.5(pid=28801): Launched 23:19:19.978102 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:19:20.520248 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28803): Launched 23:19:20.636714 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:19:20.882901 run patchelf(pid=28804): Launched 23:19:21.044295 run osmo-stp_10.42.42.5(pid=28801): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28801)] 23:19:21.167728 run osmo-stp_10.42.42.5(pid=28801): stdout: | (launched: 2022-12-09_23:19:19.801878) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:19:21.292467 run osmo-stp_10.42.42.5(pid=28801): stderr: | 20221209231919995 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209231919995 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209231919995 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209231919995 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209231919996 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209231919996 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209231919996 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:19:21.418363 run osmo-stp_10.42.42.5(pid=28801): stdout: | (launched: 2022-12-09_23:19:19.801878) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:19:21.538286 run osmo-stp_10.42.42.5(pid=28801): stderr: | 20221209231919995 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209231919995 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209231919995 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209231919995 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209231919996 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209231919996 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209231919996 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:19:21.679871 run patchelf(pid=28804): Terminating (SIGINT) 23:19:21.843437 run patchelf(pid=28804): Terminated: ok {rc=0} 23:19:21.961727 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=28801): Process ended prematurely: osmo-stp_10.42.42.5(pid=28801) [trial-2366↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28801)] [trial-2366↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27] 23:19:21.970441 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 23:19:21.996434 run osmo-hlr_10.42.42.2(pid=28798): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28798)] 23:19:22.043377 run osmo-hlr_10.42.42.2(pid=28798): stdout: | (launched: 2022-12-09_23:19:18.825805) 23:19:22.092876 run osmo-hlr_10.42.42.2(pid=28798): stderr: | 20221209231919023 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209231919024 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209231919024 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209231919024 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209231919024 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209231919024 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209231919036 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:sysmo+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209231919046 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209231919046 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209231919046 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:19:22.142320 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28797): Terminating (SIGTERM) 23:19:22.181686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28800): Terminating (SIGTERM) 23:19:22.221119 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28803): Terminating (SIGTERM) 23:19:22.260846 --- ParallelTerminationStrategy: PID 28797 died... 23:19:22.280022 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28797): Terminated: ok {rc=0} 23:19:22.323983 --- ParallelTerminationStrategy: PID 28800 died... 23:19:22.342647 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28800): Terminated: ok {rc=0} 23:19:22.387217 --- ParallelTerminationStrategy: PID 28803 died... 23:19:22.405841 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28803): Terminated: ok {rc=0} 23:19:22.491448 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2366 gprs:sysmo+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 gprs:sysmo+mod-bts0-dynts-ipa --------------------------------------------------------------------- 23:19:23.782585 tst gprs:sysmo+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:19:23.789138 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 23:19:23.810995 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 23:19:23.850966 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 23:19:23.937159 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 23:19:23.958637 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 23:19:23.998791 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 23:19:24.595792 tst gprs:sysmo+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2366 gprs:sysmo+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 23:19:24.648205 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:19:24.659768 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:19:24.716180 tst cs_paging_gprs_active.py: using LAC 24360 23:19:24.839761 tst cs_paging_gprs_active.py: using RAC 135 23:19:24.959623 tst cs_paging_gprs_active.py: using CellId 24360 23:19:25.076768 tst cs_paging_gprs_active.py: using BVCI 24361 23:19:25.184003 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:19:25.194902 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:19:25.205664 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:19:25.216432 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:19:25.226942 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:19:25.237455 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:19:25.248051 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:19:25.258521 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:19:25.269167 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:19:25.384057 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:19:25.502600 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:19:25.719253 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:19:26.038275 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28808): Launched 23:19:26.314697 run iperf3-srv_10.42.42.10(pid=28809): Launched 23:19:26.433756 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:19:26.648476 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:19:26.966717 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28810): Launched 23:19:27.242856 run iperf3-srv_10.42.42.10(pid=28811): Launched 23:19:27.361731 tst cs_paging_gprs_active.py:38: start network... 23:19:27.576653 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:19:28.068286 run create_hlr_db(pid=28812): Launched 23:19:28.190510 bus /gobi_6: Setting Powered False 23:19:29.253982 run create_hlr_db(pid=28812): Terminated: ok {rc=0} 23:19:29.681093 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28814): Launched 23:19:29.977719 run osmo-hlr_10.42.42.2(pid=28815): Launched 23:19:30.091314 run osmo-stp_10.42.42.5: Starting osmo-stp 23:19:30.618699 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28817): Launched 23:19:30.939057 run osmo-stp_10.42.42.5(pid=28818): Launched 23:19:31.238022 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:19:31.886657 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28820): Launched 23:19:32.014555 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:19:32.280207 run patchelf(pid=28821): Launched 23:19:32.455639 run osmo-stp_10.42.42.5(pid=28818): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28818)] 23:19:32.581458 run osmo-stp_10.42.42.5(pid=28818): stdout: | (launched: 2022-12-09_23:19:30.862376) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:19:32.709098 run osmo-stp_10.42.42.5(pid=28818): stderr: | 20221209231931102 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209231931102 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209231931102 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209231931104 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209231931104 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209231931105 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209231931105 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:19:32.837445 run osmo-stp_10.42.42.5(pid=28818): stdout: | (launched: 2022-12-09_23:19:30.862376) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:19:32.958685 run osmo-stp_10.42.42.5(pid=28818): stderr: | 20221209231931102 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209231931102 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209231931102 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209231931104 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209231931104 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209231931105 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209231931105 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:19:33.102862 run patchelf(pid=28821): Terminating (SIGINT) 23:19:33.269747 run patchelf(pid=28821): Terminated: ok {rc=0} 23:19:33.390456 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=28818): Process ended prematurely: osmo-stp_10.42.42.5(pid=28818) [trial-2366↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28818)] [trial-2366↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 23:19:33.399797 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 23:19:33.426840 run osmo-hlr_10.42.42.2(pid=28815): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28815)] 23:19:33.473923 run osmo-hlr_10.42.42.2(pid=28815): stdout: | (launched: 2022-12-09_23:19:29.923671) 23:19:33.522797 run osmo-hlr_10.42.42.2(pid=28815): stderr: | 20221209231930099 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209231930099 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209231930099 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209231930099 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209231930099 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209231930099 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209231930111 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:sysmo+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209231930122 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209231930122 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209231930122 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:19:33.572344 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28808): Terminating (SIGTERM) 23:19:33.611764 run iperf3-srv_10.42.42.10(pid=28809): Terminating (SIGTERM) 23:19:33.650943 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28810): Terminating (SIGTERM) 23:19:33.690305 run iperf3-srv_10.42.42.10(pid=28811): Terminating (SIGTERM) 23:19:33.729665 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28814): Terminating (SIGTERM) 23:19:33.769130 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28817): Terminating (SIGTERM) 23:19:33.808322 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28820): Terminating (SIGTERM) 23:19:33.847820 --- ParallelTerminationStrategy: PID 28808 died... 23:19:33.866689 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28808): Terminated: ok {rc=0} 23:19:33.910363 --- ParallelTerminationStrategy: PID 28809 died... 23:19:33.928643 run iperf3-srv_10.42.42.10(pid=28809): Terminated {rc=256} 23:19:33.971868 --- ParallelTerminationStrategy: PID 28810 died... 23:19:33.990346 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28810): Terminated: ok {rc=0} 23:19:34.033491 --- ParallelTerminationStrategy: PID 28811 died... 23:19:34.051770 run iperf3-srv_10.42.42.10(pid=28811): Terminated {rc=256} 23:19:34.095526 --- ParallelTerminationStrategy: PID 28814 died... 23:19:34.113919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28814): Terminated: ok {rc=0} 23:19:34.157027 --- ParallelTerminationStrategy: PID 28817 died... 23:19:34.175346 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28817): Terminated: ok {rc=0} 23:19:34.218437 --- ParallelTerminationStrategy: PID 28820 died... 23:19:34.236684 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28820): Terminated: ok {rc=0} 23:19:34.321490 bus /gobi_0: Setting Powered False 23:19:35.419738 bus /gobi_0: Setting Powered False 23:19:36.534020 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:sysmo+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 23:19:37.678812 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:19:37.690196 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:19:37.748520 tst iperf3.py: using LAC 24361 23:19:37.866895 tst iperf3.py: using RAC 136 23:19:37.984036 tst iperf3.py: using CellId 24361 23:19:38.111350 tst iperf3.py: using BVCI 24362 23:19:38.228019 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:19:38.239531 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:19:38.250863 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:19:38.262851 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:19:38.275206 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:19:38.287031 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:19:38.299202 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:19:38.311195 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:19:38.323434 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:19:38.439662 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:19:38.639881 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:19:38.937323 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28822): Launched 23:19:39.195300 run iperf3-srv_10.42.42.10(pid=28823): Launched 23:19:39.306127 tst iperf3.py:8: start network... 23:19:39.505148 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:19:39.963541 run create_hlr_db(pid=28824): Launched 23:19:40.084253 bus /gobi_6: Setting Powered False 23:19:41.144209 run create_hlr_db(pid=28824): Terminated: ok {rc=0} 23:19:41.578148 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28826): Launched 23:19:41.896529 run osmo-hlr_10.42.42.2(pid=28827): Launched 23:19:42.018158 run osmo-stp_10.42.42.5: Starting osmo-stp 23:19:42.566089 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28829): Launched 23:19:42.883158 run osmo-stp_10.42.42.5(pid=28830): Launched 23:19:43.004442 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:19:43.553634 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28832): Launched 23:19:43.675532 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:19:43.945671 run patchelf(pid=28833): Launched 23:19:44.124043 run osmo-stp_10.42.42.5(pid=28830): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28830)] 23:19:44.259789 run osmo-stp_10.42.42.5(pid=28830): stdout: | (launched: 2022-12-09_23:19:42.825481) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:19:44.398194 run osmo-stp_10.42.42.5(pid=28830): stderr: | 20221209231943015 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209231943015 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209231943016 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209231943016 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209231943018 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209231943018 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209231943018 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:19:44.536774 run osmo-stp_10.42.42.5(pid=28830): stdout: | (launched: 2022-12-09_23:19:42.825481) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:19:44.668328 run osmo-stp_10.42.42.5(pid=28830): stderr: | 20221209231943015 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209231943015 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209231943016 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209231943016 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209231943018 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209231943018 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209231943018 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:19:44.824102 run patchelf(pid=28833): Terminating (SIGINT) 23:19:45.004068 run patchelf(pid=28833): Terminated: ok {rc=0} 23:19:45.134706 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28830): Process ended prematurely: osmo-stp_10.42.42.5(pid=28830) [trial-2366↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28830)] [trial-2366↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8] 23:19:45.145079 tst iperf3.py:8: Test FAILED (7.5 sec) 23:19:45.174747 run osmo-hlr_10.42.42.2(pid=28827): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28827)] 23:19:45.225681 run osmo-hlr_10.42.42.2(pid=28827): stdout: | (launched: 2022-12-09_23:19:41.838941) 23:19:45.278038 run osmo-hlr_10.42.42.2(pid=28827): stderr: | 20221209231942037 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209231942037 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209231942037 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209231942037 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209231942037 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209231942037 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209231942049 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:sysmo+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209231942057 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209231942057 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209231942058 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:19:45.331027 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28822): Terminating (SIGTERM) 23:19:45.373280 run iperf3-srv_10.42.42.10(pid=28823): Terminating (SIGTERM) 23:19:45.415701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28826): Terminating (SIGTERM) 23:19:45.458158 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28829): Terminating (SIGTERM) 23:19:45.500469 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28832): Terminating (SIGTERM) 23:19:45.542860 --- ParallelTerminationStrategy: PID 28822 died... 23:19:45.562902 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28822): Terminated: ok {rc=0} 23:19:45.610613 --- ParallelTerminationStrategy: PID 28823 died... 23:19:45.630563 run iperf3-srv_10.42.42.10(pid=28823): Terminated {rc=256} 23:19:45.677736 --- ParallelTerminationStrategy: PID 28826 died... 23:19:45.697505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28826): Terminated: ok {rc=0} 23:19:45.744425 --- ParallelTerminationStrategy: PID 28829 died... 23:19:45.764198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28829): Terminated: ok {rc=0} 23:19:45.811132 --- ParallelTerminationStrategy: PID 28832 died... 23:19:45.840403 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28832): Terminated: ok {rc=0} 23:19:45.934514 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:sysmo+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 23:19:47.099275 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:19:47.114898 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:19:47.182210 tst iperf3m4.py: using LAC 24362 23:19:47.309286 tst iperf3m4.py: using RAC 137 23:19:47.434194 tst iperf3m4.py: using CellId 24362 23:19:47.558620 tst iperf3m4.py: using BVCI 24363 23:19:47.675046 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:19:47.686766 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:19:47.698019 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:19:47.709565 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:19:47.720923 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:19:47.732714 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:19:47.744434 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:19:47.756527 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:19:47.768389 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:19:47.884660 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:19:48.006332 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:19:48.120126 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:19:48.238237 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:19:48.456223 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:19:48.777896 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28835): Launched 23:19:49.055469 run iperf3-srv_10.42.42.10(pid=28836): Launched 23:19:49.176025 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:19:49.392170 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:19:49.713473 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28837): Launched 23:19:49.991977 run iperf3-srv_10.42.42.10(pid=28838): Launched 23:19:50.112189 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:19:50.328686 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:19:50.648924 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28839): Launched 23:19:50.925353 run iperf3-srv_10.42.42.10(pid=28840): Launched 23:19:51.045424 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:19:51.263265 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:19:51.585620 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28841): Launched 23:19:51.863798 run iperf3-srv_10.42.42.10(pid=28842): Launched 23:19:51.982948 tst iperf3m4.py:8: start network... 23:19:52.198885 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:19:52.692567 run create_hlr_db(pid=28843): Launched 23:19:52.814633 bus /gobi_6: Setting Powered False 23:19:53.877825 run create_hlr_db(pid=28843): Terminated: ok {rc=0} 23:19:54.302952 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28845): Launched 23:19:54.599668 run osmo-hlr_10.42.42.2(pid=28846): Launched 23:19:54.712733 run osmo-stp_10.42.42.5: Starting osmo-stp 23:19:55.222687 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28848): Launched 23:19:55.517415 run osmo-stp_10.42.42.5(pid=28849): Launched 23:19:55.630195 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:19:56.143999 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28851): Launched 23:19:56.256584 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:19:56.506625 run patchelf(pid=28852): Launched 23:19:56.671279 run osmo-stp_10.42.42.5(pid=28849): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28849)] 23:19:56.796367 run osmo-stp_10.42.42.5(pid=28849): stdout: | (launched: 2022-12-09_23:19:55.463651) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:19:56.923760 run osmo-stp_10.42.42.5(pid=28849): stderr: | 20221209231955634 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209231955634 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209231955634 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209231955635 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209231955635 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209231955635 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209231955635 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:19:57.050779 run osmo-stp_10.42.42.5(pid=28849): stdout: | (launched: 2022-12-09_23:19:55.463651) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:19:57.172052 run osmo-stp_10.42.42.5(pid=28849): stderr: | 20221209231955634 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209231955634 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209231955634 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209231955635 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209231955635 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209231955635 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209231955635 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:19:57.315546 run patchelf(pid=28852): Terminating (SIGINT) 23:19:57.482039 run patchelf(pid=28852): Terminated: ok {rc=0} 23:19:57.602290 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28849): Process ended prematurely: osmo-stp_10.42.42.5(pid=28849) [trial-2366↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28849)] [trial-2366↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8] 23:19:57.611650 tst iperf3m4.py:8: Test FAILED (10.6 sec) 23:19:57.638716 run osmo-hlr_10.42.42.2(pid=28846): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28846)] 23:19:57.685899 run osmo-hlr_10.42.42.2(pid=28846): stdout: | (launched: 2022-12-09_23:19:54.545730) 23:19:57.734857 run osmo-hlr_10.42.42.2(pid=28846): stderr: | 20221209231954722 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209231954722 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209231954722 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209231954722 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209231954722 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209231954722 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209231954740 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:sysmo+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209231954749 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209231954750 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209231954750 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:19:57.783948 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28835): Terminating (SIGTERM) 23:19:57.823010 run iperf3-srv_10.42.42.10(pid=28836): Terminating (SIGTERM) 23:19:57.861972 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28837): Terminating (SIGTERM) 23:19:57.901088 run iperf3-srv_10.42.42.10(pid=28838): Terminating (SIGTERM) 23:19:57.940058 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28839): Terminating (SIGTERM) 23:19:57.979126 run iperf3-srv_10.42.42.10(pid=28840): Terminating (SIGTERM) 23:19:58.018049 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28841): Terminating (SIGTERM) 23:19:58.057306 run iperf3-srv_10.42.42.10(pid=28842): Terminating (SIGTERM) 23:19:58.096247 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28845): Terminating (SIGTERM) 23:19:58.135131 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28848): Terminating (SIGTERM) 23:19:58.174057 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28851): Terminating (SIGTERM) 23:19:58.213206 --- ParallelTerminationStrategy: PID 28835 died... 23:19:58.232032 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28835): Terminated: ok {rc=0} 23:19:58.275518 --- ParallelTerminationStrategy: PID 28836 died... 23:19:58.293900 run iperf3-srv_10.42.42.10(pid=28836): Terminated {rc=256} 23:19:58.336914 --- ParallelTerminationStrategy: PID 28837 died... 23:19:58.355931 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28837): Terminated: ok {rc=0} 23:19:58.399378 --- ParallelTerminationStrategy: PID 28838 died... 23:19:58.417865 run iperf3-srv_10.42.42.10(pid=28838): Terminated {rc=256} 23:19:58.461257 --- ParallelTerminationStrategy: PID 28839 died... 23:19:58.479765 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28839): Terminated: ok {rc=0} 23:19:58.523241 --- ParallelTerminationStrategy: PID 28840 died... 23:19:58.541750 run iperf3-srv_10.42.42.10(pid=28840): Terminated {rc=256} 23:19:58.585304 --- ParallelTerminationStrategy: PID 28841 died... 23:19:58.603759 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28841): Terminated: ok {rc=0} 23:19:58.647027 --- ParallelTerminationStrategy: PID 28842 died... 23:19:58.665514 run iperf3-srv_10.42.42.10(pid=28842): Terminated {rc=256} 23:19:58.708701 --- ParallelTerminationStrategy: PID 28845 died... 23:19:58.727338 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28845): Terminated: ok {rc=0} 23:19:58.770855 --- ParallelTerminationStrategy: PID 28848 died... 23:19:58.789284 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28848): Terminated: ok {rc=0} 23:19:58.832772 --- ParallelTerminationStrategy: PID 28851 died... 23:19:58.851227 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28851): Terminated: ok {rc=0} 23:19:58.933569 bus /gobi_4: Setting Powered False 23:20:00.031238 bus /gobi_4: Setting Powered False 23:20:01.181493 bus /gobi_1: Setting Powered False 23:20:02.285788 bus /gobi_1: Setting Powered False 23:20:03.401803 bus /gobi_0: Setting Powered False 23:20:04.500561 bus /gobi_0: Setting Powered False 23:20:05.616275 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:sysmo+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 23:20:06.719618 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:20:06.730940 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:20:06.787592 tst ping.py: using LAC 24363 23:20:06.904771 tst ping.py: using RAC 138 23:20:07.021141 tst ping.py: using CellId 24363 23:20:07.136402 tst ping.py: using BVCI 24364 23:20:07.242521 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:20:07.253391 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:20:07.263918 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:20:07.274565 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:20:07.285020 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:20:07.295448 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:20:07.306158 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:20:07.316600 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:20:07.432644 tst ping.py:19: start network... 23:20:07.644709 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:20:08.130172 run create_hlr_db(pid=28856): Launched 23:20:08.249611 bus /gobi_6: Setting Powered False 23:20:09.312182 run create_hlr_db(pid=28856): Terminated: ok {rc=0} 23:20:09.732120 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28858): Launched 23:20:10.025600 run osmo-hlr_10.42.42.2(pid=28859): Launched 23:20:10.137480 run osmo-stp_10.42.42.5: Starting osmo-stp 23:20:10.647623 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28861): Launched 23:20:10.937078 run osmo-stp_10.42.42.5(pid=28862): Launched 23:20:11.047575 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:20:11.549628 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28864): Launched 23:20:11.661274 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:20:11.908480 run patchelf(pid=28865): Launched 23:20:12.069256 run osmo-stp_10.42.42.5(pid=28862): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28862)] 23:20:12.191964 run osmo-stp_10.42.42.5(pid=28862): stdout: | (launched: 2022-12-09_23:20:10.884203) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:20:12.316674 run osmo-stp_10.42.42.5(pid=28862): stderr: | 20221209232011055 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232011055 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232011055 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232011056 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232011056 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232011056 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232011056 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:20:12.441519 run osmo-stp_10.42.42.5(pid=28862): stdout: | (launched: 2022-12-09_23:20:10.884203) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:20:12.560331 run osmo-stp_10.42.42.5(pid=28862): stderr: | 20221209232011055 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232011055 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232011055 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232011056 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232011056 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232011056 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232011056 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:20:12.701456 run patchelf(pid=28865): Terminating (SIGINT) 23:20:12.864517 run patchelf(pid=28865): Terminated: ok {rc=0} 23:20:12.981871 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=28862): Process ended prematurely: osmo-stp_10.42.42.5(pid=28862) [trial-2366↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28862)] [trial-2366↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22] 23:20:12.990416 tst ping.py:22: Test FAILED (6.3 sec) 23:20:13.016586 run osmo-hlr_10.42.42.2(pid=28859): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28859)] 23:20:13.064024 run osmo-hlr_10.42.42.2(pid=28859): stdout: | (launched: 2022-12-09_23:20:09.971828) 23:20:13.112792 run osmo-hlr_10.42.42.2(pid=28859): stderr: | 20221209232010145 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209232010145 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209232010146 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209232010146 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209232010146 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209232010146 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209232010163 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:sysmo+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209232010172 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209232010172 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209232010172 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:20:13.161985 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28858): Terminating (SIGTERM) 23:20:13.201322 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28861): Terminating (SIGTERM) 23:20:13.240562 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28864): Terminating (SIGTERM) 23:20:13.280049 --- ParallelTerminationStrategy: PID 28858 died... 23:20:13.299084 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28858): Terminated: ok {rc=0} 23:20:13.342570 --- ParallelTerminationStrategy: PID 28861 died... 23:20:13.361941 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28861): Terminated: ok {rc=0} 23:20:13.405308 --- ParallelTerminationStrategy: PID 28864 died... 23:20:13.423683 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28864): Terminated: ok {rc=0} 23:20:13.508397 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:sysmo+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 23:20:14.596794 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:20:14.608465 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:20:14.665432 tst ping_idle_ping.py: using LAC 24364 23:20:14.781313 tst ping_idle_ping.py: using RAC 139 23:20:14.896756 tst ping_idle_ping.py: using CellId 24364 23:20:15.012273 tst ping_idle_ping.py: using BVCI 24365 23:20:15.129142 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:20:15.140522 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:20:15.151642 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:20:15.163450 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:20:15.175172 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:20:15.186756 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:20:15.199007 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:20:15.210744 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:20:15.331728 tst ping_idle_ping.py:24: start network... 23:20:15.543839 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:20:16.044695 run create_hlr_db(pid=28866): Launched 23:20:16.175472 bus /gobi_6: Setting Powered False 23:20:17.233862 run create_hlr_db(pid=28866): Terminated: ok {rc=0} 23:20:17.658726 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28868): Launched 23:20:17.952644 run osmo-hlr_10.42.42.2(pid=28869): Launched 23:20:18.064487 run osmo-stp_10.42.42.5: Starting osmo-stp 23:20:18.567640 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28871): Launched 23:20:18.858971 run osmo-stp_10.42.42.5(pid=28872): Launched 23:20:18.970272 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:20:19.474261 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28874): Launched 23:20:19.585614 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:20:19.831726 run patchelf(pid=28875): Launched 23:20:19.994002 run osmo-stp_10.42.42.5(pid=28872): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28872)] 23:20:20.117982 run osmo-stp_10.42.42.5(pid=28872): stdout: | (launched: 2022-12-09_23:20:18.805573) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:20:20.243089 run osmo-stp_10.42.42.5(pid=28872): stderr: | 20221209232018975 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232018975 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232018975 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232018975 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232018976 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232018976 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232018976 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:20:20.368495 run osmo-stp_10.42.42.5(pid=28872): stdout: | (launched: 2022-12-09_23:20:18.805573) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:20:20.487904 run osmo-stp_10.42.42.5(pid=28872): stderr: | 20221209232018975 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232018975 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232018975 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232018975 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232018976 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232018976 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232018976 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:20:20.629690 run patchelf(pid=28875): Terminating (SIGINT) 23:20:20.792887 run patchelf(pid=28875): Terminated: ok {rc=0} 23:20:20.910678 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=28872): Process ended prematurely: osmo-stp_10.42.42.5(pid=28872) [trial-2366↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28872)] [trial-2366↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 23:20:20.919329 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 23:20:20.945409 run osmo-hlr_10.42.42.2(pid=28869): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28869)] 23:20:20.992197 run osmo-hlr_10.42.42.2(pid=28869): stdout: | (launched: 2022-12-09_23:20:17.899368) 23:20:21.041177 run osmo-hlr_10.42.42.2(pid=28869): stderr: | 20221209232018076 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209232018076 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209232018076 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209232018077 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209232018077 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209232018077 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209232018089 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:sysmo+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209232018098 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209232018098 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209232018098 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:20:21.090448 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28868): Terminating (SIGTERM) 23:20:21.129729 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28871): Terminating (SIGTERM) 23:20:21.168919 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28874): Terminating (SIGTERM) 23:20:21.208317 --- ParallelTerminationStrategy: PID 28868 died... 23:20:21.227166 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28868): Terminated: ok {rc=0} 23:20:21.270821 --- ParallelTerminationStrategy: PID 28871 died... 23:20:21.289169 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28871): Terminated: ok {rc=0} 23:20:21.332274 --- ParallelTerminationStrategy: PID 28874 died... 23:20:21.350529 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28874): Terminated: ok {rc=0} 23:20:21.434859 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2366 gprs:sysmo+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 gprs:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 23:20:22.726449 tst gprs:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:20:22.732734 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 23:20:22.754339 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 23:20:22.794846 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 23:20:22.882644 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 23:20:22.903895 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 23:20:22.943752 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 23:20:23.540203 tst gprs:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2366 gprs:sysmo+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 23:20:23.592554 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:20:23.603506 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:20:23.661414 tst cs_paging_gprs_active.py: using LAC 24365 23:20:23.780204 tst cs_paging_gprs_active.py: using RAC 140 23:20:23.897376 tst cs_paging_gprs_active.py: using CellId 24365 23:20:24.017383 tst cs_paging_gprs_active.py: using BVCI 24366 23:20:24.125222 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:20:24.135862 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:20:24.146589 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:20:24.157056 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:20:24.167401 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:20:24.177978 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:20:24.188430 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:20:24.198817 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:20:24.209418 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:20:24.327538 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:20:24.447334 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:20:24.664396 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:20:24.984839 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28882): Launched 23:20:25.263181 run iperf3-srv_10.42.42.10(pid=28883): Launched 23:20:25.382510 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:20:25.598399 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:20:25.918953 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28884): Launched 23:20:26.196657 run iperf3-srv_10.42.42.10(pid=28885): Launched 23:20:26.316118 tst cs_paging_gprs_active.py:38: start network... 23:20:26.531783 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:20:27.025644 run create_hlr_db(pid=28886): Launched 23:20:27.148206 bus /gobi_6: Setting Powered False 23:20:28.208219 run create_hlr_db(pid=28886): Terminated: ok {rc=0} 23:20:28.652046 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28888): Launched 23:20:28.972611 run osmo-hlr_10.42.42.2(pid=28889): Launched 23:20:29.095653 run osmo-stp_10.42.42.5: Starting osmo-stp 23:20:29.649254 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28891): Launched 23:20:29.968582 run osmo-stp_10.42.42.5(pid=28892): Launched 23:20:30.091085 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:20:30.641659 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28894): Launched 23:20:30.764534 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:20:31.050793 run patchelf(pid=28895): Launched 23:20:31.235567 run osmo-stp_10.42.42.5(pid=28892): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28892)] 23:20:31.366532 run osmo-stp_10.42.42.5(pid=28892): stdout: | (launched: 2022-12-09_23:20:29.909995) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:20:31.498598 run osmo-stp_10.42.42.5(pid=28892): stderr: | 20221209232030101 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232030101 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232030101 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232030102 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232030102 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232030102 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232030102 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:20:31.632649 run osmo-stp_10.42.42.5(pid=28892): stdout: | (launched: 2022-12-09_23:20:29.909995) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:20:31.759834 run osmo-stp_10.42.42.5(pid=28892): stderr: | 20221209232030101 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232030101 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232030101 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232030102 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232030102 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232030102 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232030102 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:20:31.909111 run patchelf(pid=28895): Terminating (SIGINT) 23:20:32.091733 run patchelf(pid=28895): Terminated: ok {rc=0} 23:20:32.227051 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=28892): Process ended prematurely: osmo-stp_10.42.42.5(pid=28892) [trial-2366↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28892)] [trial-2366↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 23:20:32.237793 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 23:20:32.268567 run osmo-hlr_10.42.42.2(pid=28889): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28889)] 23:20:32.319788 run osmo-hlr_10.42.42.2(pid=28889): stdout: | (launched: 2022-12-09_23:20:28.914384) 23:20:32.372894 run osmo-hlr_10.42.42.2(pid=28889): stderr: | 20221209232029111 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209232029111 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209232029111 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209232029111 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209232029111 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209232029111 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209232029123 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:sysmo+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209232029131 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209232029131 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209232029132 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:20:32.426074 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28882): Terminating (SIGTERM) 23:20:32.468310 run iperf3-srv_10.42.42.10(pid=28883): Terminating (SIGTERM) 23:20:32.512228 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28884): Terminating (SIGTERM) 23:20:32.555061 run iperf3-srv_10.42.42.10(pid=28885): Terminating (SIGTERM) 23:20:32.598131 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28888): Terminating (SIGTERM) 23:20:32.640934 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28891): Terminating (SIGTERM) 23:20:32.683781 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28894): Terminating (SIGTERM) 23:20:32.726906 --- ParallelTerminationStrategy: PID 28882 died... 23:20:32.747085 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28882): Terminated: ok {rc=0} 23:20:32.795607 --- ParallelTerminationStrategy: PID 28883 died... 23:20:32.815318 run iperf3-srv_10.42.42.10(pid=28883): Terminated {rc=256} 23:20:32.863477 --- ParallelTerminationStrategy: PID 28884 died... 23:20:32.883224 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28884): Terminated: ok {rc=0} 23:20:32.931333 --- ParallelTerminationStrategy: PID 28885 died... 23:20:32.951068 run iperf3-srv_10.42.42.10(pid=28885): Terminated {rc=256} 23:20:32.999407 --- ParallelTerminationStrategy: PID 28888 died... 23:20:33.019231 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28888): Terminated: ok {rc=0} 23:20:33.067088 --- ParallelTerminationStrategy: PID 28891 died... 23:20:33.086779 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28891): Terminated: ok {rc=0} 23:20:33.135013 --- ParallelTerminationStrategy: PID 28894 died... 23:20:33.154795 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28894): Terminated: ok {rc=0} 23:20:33.243948 bus /gobi_0: Setting Powered False 23:20:34.343089 bus /gobi_0: Setting Powered False 23:20:35.459368 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:sysmo+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 23:20:36.608292 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:20:36.620178 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:20:36.681918 tst iperf3.py: using LAC 24366 23:20:36.808725 tst iperf3.py: using RAC 141 23:20:36.937776 tst iperf3.py: using CellId 24366 23:20:37.062844 tst iperf3.py: using BVCI 24367 23:20:37.181483 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:20:37.192711 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:20:37.203771 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:20:37.215091 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:20:37.226456 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:20:37.237823 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:20:37.249132 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:20:37.260219 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:20:37.271653 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:20:37.386286 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:20:37.603701 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:20:37.925039 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28897): Launched 23:20:38.204475 run iperf3-srv_10.42.42.10(pid=28898): Launched 23:20:38.324330 tst iperf3.py:8: start network... 23:20:38.540509 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:20:39.036030 run create_hlr_db(pid=28899): Launched 23:20:39.157346 bus /gobi_6: Setting Powered False 23:20:40.220737 run create_hlr_db(pid=28899): Terminated: ok {rc=0} 23:20:40.648325 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28901): Launched 23:20:40.945431 run osmo-hlr_10.42.42.2(pid=28902): Launched 23:20:41.059145 run osmo-stp_10.42.42.5: Starting osmo-stp 23:20:41.573700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28904): Launched 23:20:41.870318 run osmo-stp_10.42.42.5(pid=28905): Launched 23:20:41.983495 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:20:42.496598 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28907): Launched 23:20:42.610514 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:20:42.861512 run patchelf(pid=28908): Launched 23:20:43.027312 run osmo-stp_10.42.42.5(pid=28905): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28905)] 23:20:43.153816 run osmo-stp_10.42.42.5(pid=28905): stdout: | (launched: 2022-12-09_23:20:41.816294) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:20:43.282043 run osmo-stp_10.42.42.5(pid=28905): stderr: | 20221209232041985 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232041985 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232041985 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232041986 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232041986 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232041986 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232041986 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:20:43.410355 run osmo-stp_10.42.42.5(pid=28905): stdout: | (launched: 2022-12-09_23:20:41.816294) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:20:43.532343 run osmo-stp_10.42.42.5(pid=28905): stderr: | 20221209232041985 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232041985 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232041985 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232041986 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232041986 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232041986 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232041986 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:20:43.677378 run patchelf(pid=28908): Terminating (SIGINT) 23:20:43.845640 run patchelf(pid=28908): Terminated: ok {rc=0} 23:20:43.966832 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28905): Process ended prematurely: osmo-stp_10.42.42.5(pid=28905) [trial-2366↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28905)] [trial-2366↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8] 23:20:43.976171 tst iperf3.py:8: Test FAILED (7.4 sec) 23:20:44.002870 run osmo-hlr_10.42.42.2(pid=28902): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28902)] 23:20:44.049698 run osmo-hlr_10.42.42.2(pid=28902): stdout: | (launched: 2022-12-09_23:20:40.891682) 23:20:44.098853 run osmo-hlr_10.42.42.2(pid=28902): stderr: | 20221209232041068 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209232041068 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209232041068 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209232041068 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209232041068 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209232041068 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209232041080 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:sysmo+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209232041089 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209232041089 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209232041089 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:20:44.147874 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28897): Terminating (SIGTERM) 23:20:44.187053 run iperf3-srv_10.42.42.10(pid=28898): Terminating (SIGTERM) 23:20:44.226423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28901): Terminating (SIGTERM) 23:20:44.265689 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28904): Terminating (SIGTERM) 23:20:44.304737 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28907): Terminating (SIGTERM) 23:20:44.344071 --- ParallelTerminationStrategy: PID 28897 died... 23:20:44.362885 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28897): Terminated: ok {rc=0} 23:20:44.406581 --- ParallelTerminationStrategy: PID 28898 died... 23:20:44.425083 run iperf3-srv_10.42.42.10(pid=28898): Terminated {rc=256} 23:20:44.468581 --- ParallelTerminationStrategy: PID 28901 died... 23:20:44.487041 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28901): Terminated: ok {rc=0} 23:20:44.530579 --- ParallelTerminationStrategy: PID 28904 died... 23:20:44.549071 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28904): Terminated: ok {rc=0} 23:20:44.592513 --- ParallelTerminationStrategy: PID 28907 died... 23:20:44.611044 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28907): Terminated: ok {rc=0} 23:20:44.695966 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:sysmo+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 23:20:45.846606 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:20:45.858595 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:20:45.924440 tst iperf3m4.py: using LAC 24367 23:20:46.043225 tst iperf3m4.py: using RAC 142 23:20:46.183527 tst iperf3m4.py: using CellId 24367 23:20:46.312855 tst iperf3m4.py: using BVCI 24368 23:20:46.423411 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:20:46.434942 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:20:46.446307 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:20:46.457761 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:20:46.468810 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:20:46.480043 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:20:46.492245 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:20:46.503500 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:20:46.514909 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:20:46.631802 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:20:46.771521 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:20:46.887876 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:20:47.006000 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:20:47.210442 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:20:47.510438 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28909): Launched 23:20:47.767944 run iperf3-srv_10.42.42.10(pid=28910): Launched 23:20:47.878483 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:20:48.077222 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:20:48.375978 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28911): Launched 23:20:48.633657 run iperf3-srv_10.42.42.10(pid=28912): Launched 23:20:48.744766 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:20:48.944092 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:20:49.242572 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28913): Launched 23:20:49.499931 run iperf3-srv_10.42.42.10(pid=28914): Launched 23:20:49.610677 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:20:49.809267 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:20:50.106554 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28915): Launched 23:20:50.365269 run iperf3-srv_10.42.42.10(pid=28916): Launched 23:20:50.475789 tst iperf3m4.py:8: start network... 23:20:50.673882 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:20:51.133258 run create_hlr_db(pid=28917): Launched 23:20:51.255282 bus /gobi_6: Setting Powered False 23:20:52.314617 run create_hlr_db(pid=28917): Terminated: ok {rc=0} 23:20:52.728286 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28919): Launched 23:20:53.024805 run osmo-hlr_10.42.42.2(pid=28920): Launched 23:20:53.137914 run osmo-stp_10.42.42.5: Starting osmo-stp 23:20:53.671242 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28922): Launched 23:20:53.967366 run osmo-stp_10.42.42.5(pid=28923): Launched 23:20:54.079308 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:20:54.592936 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28925): Launched 23:20:54.706989 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:20:54.958980 run patchelf(pid=28926): Launched 23:20:55.124402 run osmo-stp_10.42.42.5(pid=28923): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28923)] 23:20:55.250634 run osmo-stp_10.42.42.5(pid=28923): stdout: | (launched: 2022-12-09_23:20:53.913598) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:20:55.378996 run osmo-stp_10.42.42.5(pid=28923): stderr: | 20221209232054081 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232054081 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232054081 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232054082 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232054084 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232054084 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232054084 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:20:55.507430 run osmo-stp_10.42.42.5(pid=28923): stdout: | (launched: 2022-12-09_23:20:53.913598) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:20:55.629675 run osmo-stp_10.42.42.5(pid=28923): stderr: | 20221209232054081 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232054081 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232054081 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232054082 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232054084 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232054084 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232054084 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:20:55.774400 run patchelf(pid=28926): Terminating (SIGINT) 23:20:55.942987 run patchelf(pid=28926): Terminated: ok {rc=0} 23:20:56.063714 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28923): Process ended prematurely: osmo-stp_10.42.42.5(pid=28923) [trial-2366↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28923)] [trial-2366↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8] 23:20:56.073215 tst iperf3m4.py:8: Test FAILED (10.3 sec) 23:20:56.100375 run osmo-hlr_10.42.42.2(pid=28920): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28920)] 23:20:56.147474 run osmo-hlr_10.42.42.2(pid=28920): stdout: | (launched: 2022-12-09_23:20:52.970750) 23:20:56.196823 run osmo-hlr_10.42.42.2(pid=28920): stderr: | 20221209232053143 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209232053143 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209232053143 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209232053144 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209232053144 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209232053144 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209232053156 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:sysmo+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209232053165 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209232053165 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209232053166 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:20:56.245946 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28909): Terminating (SIGTERM) 23:20:56.285129 run iperf3-srv_10.42.42.10(pid=28910): Terminating (SIGTERM) 23:20:56.324156 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28911): Terminating (SIGTERM) 23:20:56.363418 run iperf3-srv_10.42.42.10(pid=28912): Terminating (SIGTERM) 23:20:56.402425 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28913): Terminating (SIGTERM) 23:20:56.441500 run iperf3-srv_10.42.42.10(pid=28914): Terminating (SIGTERM) 23:20:56.480452 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28915): Terminating (SIGTERM) 23:20:56.519449 run iperf3-srv_10.42.42.10(pid=28916): Terminating (SIGTERM) 23:20:56.558594 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28919): Terminating (SIGTERM) 23:20:56.597736 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28922): Terminating (SIGTERM) 23:20:56.637029 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28925): Terminating (SIGTERM) 23:20:56.676651 --- ParallelTerminationStrategy: PID 28909 died... 23:20:56.695569 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28909): Terminated: ok {rc=0} 23:20:56.739185 --- ParallelTerminationStrategy: PID 28910 died... 23:20:56.757577 run iperf3-srv_10.42.42.10(pid=28910): Terminated {rc=256} 23:20:56.800897 --- ParallelTerminationStrategy: PID 28911 died... 23:20:56.819896 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28911): Terminated: ok {rc=0} 23:20:56.863300 --- ParallelTerminationStrategy: PID 28912 died... 23:20:56.881730 run iperf3-srv_10.42.42.10(pid=28912): Terminated {rc=256} 23:20:56.925086 --- ParallelTerminationStrategy: PID 28913 died... 23:20:56.943525 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28913): Terminated: ok {rc=0} 23:20:56.986983 --- ParallelTerminationStrategy: PID 28914 died... 23:20:57.005408 run iperf3-srv_10.42.42.10(pid=28914): Terminated {rc=256} 23:20:57.048886 --- ParallelTerminationStrategy: PID 28915 died... 23:20:57.067776 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28915): Terminated: ok {rc=0} 23:20:57.111302 --- ParallelTerminationStrategy: PID 28916 died... 23:20:57.129840 run iperf3-srv_10.42.42.10(pid=28916): Terminated {rc=256} 23:20:57.173233 --- ParallelTerminationStrategy: PID 28919 died... 23:20:57.191676 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28919): Terminated: ok {rc=0} 23:20:57.235789 --- ParallelTerminationStrategy: PID 28922 died... 23:20:57.254261 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28922): Terminated: ok {rc=0} 23:20:57.297684 --- ParallelTerminationStrategy: PID 28925 died... 23:20:57.316184 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28925): Terminated: ok {rc=0} 23:20:57.400684 bus /gobi_4: Setting Powered False 23:20:58.500362 bus /gobi_4: Setting Powered False 23:20:59.611171 bus /gobi_1: Setting Powered False 23:21:00.705439 bus /gobi_1: Setting Powered False 23:21:01.822908 bus /gobi_0: Setting Powered False 23:21:02.923237 bus /gobi_0: Setting Powered False 23:21:04.039692 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:sysmo+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 23:21:05.141203 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:21:05.152833 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:21:05.213393 tst ping.py: using LAC 24368 23:21:05.329348 tst ping.py: using RAC 143 23:21:05.444588 tst ping.py: using CellId 24368 23:21:05.569153 tst ping.py: using BVCI 24369 23:21:05.683422 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:21:05.695087 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:21:05.706492 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:21:05.718000 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:21:05.729489 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:21:05.740794 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:21:05.752278 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:21:05.763569 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:21:05.878664 tst ping.py:19: start network... 23:21:06.089770 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:21:06.579554 run create_hlr_db(pid=28927): Launched 23:21:06.700582 bus /gobi_6: Setting Powered False 23:21:07.760327 run create_hlr_db(pid=28927): Terminated: ok {rc=0} 23:21:08.168782 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28929): Launched 23:21:08.461229 run osmo-hlr_10.42.42.2(pid=28930): Launched 23:21:08.572797 run osmo-stp_10.42.42.5: Starting osmo-stp 23:21:09.077732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28932): Launched 23:21:09.368160 run osmo-stp_10.42.42.5(pid=28933): Launched 23:21:09.479712 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:21:09.984102 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28935): Launched 23:21:10.095986 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:21:10.343295 run patchelf(pid=28936): Launched 23:21:10.505510 run osmo-stp_10.42.42.5(pid=28933): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28933)] 23:21:10.628745 run osmo-stp_10.42.42.5(pid=28933): stdout: | (launched: 2022-12-09_23:21:09.315137) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:21:10.754058 run osmo-stp_10.42.42.5(pid=28933): stderr: | 20221209232109484 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232109484 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232109484 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232109485 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232109485 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232109485 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232109485 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:21:10.879147 run osmo-stp_10.42.42.5(pid=28933): stdout: | (launched: 2022-12-09_23:21:09.315137) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:21:10.999002 run osmo-stp_10.42.42.5(pid=28933): stderr: | 20221209232109484 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232109484 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232109484 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232109485 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232109485 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232109485 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232109485 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:21:11.141405 run patchelf(pid=28936): Terminating (SIGINT) 23:21:11.305708 run patchelf(pid=28936): Terminated: ok {rc=0} 23:21:11.423452 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=28933): Process ended prematurely: osmo-stp_10.42.42.5(pid=28933) [trial-2366↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28933)] [trial-2366↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22] 23:21:11.432206 tst ping.py:22: Test FAILED (6.3 sec) 23:21:11.458567 run osmo-hlr_10.42.42.2(pid=28930): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28930)] 23:21:11.505727 run osmo-hlr_10.42.42.2(pid=28930): stdout: | (launched: 2022-12-09_23:21:08.407798) 23:21:11.554542 run osmo-hlr_10.42.42.2(pid=28930): stderr: | 20221209232108581 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209232108582 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209232108582 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209232108582 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209232108582 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209232108582 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209232108594 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:sysmo+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209232108605 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209232108605 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209232108605 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:21:11.603738 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28929): Terminating (SIGTERM) 23:21:11.643499 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28932): Terminating (SIGTERM) 23:21:11.682841 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28935): Terminating (SIGTERM) 23:21:11.722559 --- ParallelTerminationStrategy: PID 28929 died... 23:21:11.741460 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28929): Terminated: ok {rc=0} 23:21:11.785526 --- ParallelTerminationStrategy: PID 28932 died... 23:21:11.803874 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28932): Terminated: ok {rc=0} 23:21:11.848133 --- ParallelTerminationStrategy: PID 28935 died... 23:21:11.866923 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28935): Terminated: ok {rc=0} 23:21:11.953784 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:sysmo+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 23:21:13.042096 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:21:13.054107 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:21:13.112030 tst ping_idle_ping.py: using LAC 24369 23:21:13.229364 tst ping_idle_ping.py: using RAC 144 23:21:13.348817 tst ping_idle_ping.py: using CellId 24369 23:21:13.465330 tst ping_idle_ping.py: using BVCI 24370 23:21:13.572351 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:21:13.583310 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:21:13.593922 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:21:13.604412 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:21:13.614928 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:21:13.625450 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:21:13.636066 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:21:13.646602 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:21:13.760205 tst ping_idle_ping.py:24: start network... 23:21:13.957566 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:21:14.415760 run create_hlr_db(pid=28937): Launched 23:21:14.535283 bus /gobi_6: Setting Powered False 23:21:15.597826 run create_hlr_db(pid=28937): Terminated: ok {rc=0} 23:21:16.066990 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28939): Launched 23:21:16.418809 run osmo-hlr_10.42.42.2(pid=28940): Launched 23:21:16.658589 run osmo-stp_10.42.42.5: Starting osmo-stp 23:21:17.261017 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28942): Launched 23:21:17.575607 run osmo-stp_10.42.42.5(pid=28943): Launched 23:21:17.696333 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:21:18.240547 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28945): Launched 23:21:18.360639 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:21:18.625897 run patchelf(pid=28946): Launched 23:21:18.800759 run osmo-stp_10.42.42.5(pid=28943): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28943)] 23:21:18.934779 run osmo-stp_10.42.42.5(pid=28943): stdout: | (launched: 2022-12-09_23:21:17.518759) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:21:19.070566 run osmo-stp_10.42.42.5(pid=28943): stderr: | 20221209232117707 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232117707 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232117707 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232117708 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232117708 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232117708 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232117708 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:21:19.207462 run osmo-stp_10.42.42.5(pid=28943): stdout: | (launched: 2022-12-09_23:21:17.518759) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:21:19.337033 run osmo-stp_10.42.42.5(pid=28943): stderr: | 20221209232117707 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232117707 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232117707 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232117708 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232117708 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232117708 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232117708 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:21:19.490720 run patchelf(pid=28946): Terminating (SIGINT) 23:21:19.667515 run patchelf(pid=28946): Terminated: ok {rc=0} 23:21:19.795104 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=28943): Process ended prematurely: osmo-stp_10.42.42.5(pid=28943) [trial-2366↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28943)] [trial-2366↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 23:21:19.804618 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 23:21:19.833214 run osmo-hlr_10.42.42.2(pid=28940): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28940)] 23:21:19.883418 run osmo-hlr_10.42.42.2(pid=28940): stdout: | (launched: 2022-12-09_23:21:16.343808) 23:21:19.935299 run osmo-hlr_10.42.42.2(pid=28940): stderr: | 20221209232116593 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209232116593 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209232116593 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209232116593 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209232116594 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209232116594 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209232116620 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:sysmo+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209232116637 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209232116637 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209232116637 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:21:19.987835 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28939): Terminating (SIGTERM) 23:21:20.029804 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28942): Terminating (SIGTERM) 23:21:20.071758 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28945): Terminating (SIGTERM) 23:21:20.113886 --- ParallelTerminationStrategy: PID 28939 died... 23:21:20.134055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28939): Terminated: ok {rc=0} 23:21:20.180763 --- ParallelTerminationStrategy: PID 28942 died... 23:21:20.200407 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28942): Terminated: ok {rc=0} 23:21:20.247055 --- ParallelTerminationStrategy: PID 28945 died... 23:21:20.266816 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28945): Terminated: ok {rc=0} 23:21:20.355015 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2366 gprs:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 23:21:21.642000 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:21:21.648738 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 23:21:21.669406 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 23:21:21.704014 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 23:21:21.760327 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 23:21:21.781102 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 23:21:21.815327 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 23:21:22.371891 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2366 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 23:21:22.377594 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:21:22.389637 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 23:21:22.449748 tst switch_tch_pdch.py: using LAC 24370 23:21:22.573660 tst switch_tch_pdch.py: using RAC 145 23:21:22.687779 tst switch_tch_pdch.py: using CellId 24370 23:21:22.804037 tst switch_tch_pdch.py: using BVCI 24371 23:21:22.921915 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:21:22.933773 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:21:22.945466 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:21:22.957338 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:21:22.969637 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:21:22.981924 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:21:22.994595 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:21:23.006186 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:21:23.123413 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:21:23.243809 tst switch_tch_pdch.py:51: start network... 23:21:23.455317 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:21:23.940763 run create_hlr_db(pid=28952): Launched 23:21:24.060705 bus /gobi_6: Setting Powered False 23:21:25.123616 run create_hlr_db(pid=28952): Terminated: ok {rc=0} 23:21:25.542810 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28954): Launched 23:21:25.834295 run osmo-hlr_10.42.42.2(pid=28955): Launched 23:21:25.945533 run osmo-stp_10.42.42.5: Starting osmo-stp 23:21:26.446417 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28957): Launched 23:21:26.738048 run osmo-stp_10.42.42.5(pid=28958): Launched 23:21:26.848700 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:21:27.351155 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28960): Launched 23:21:27.462768 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:21:27.709139 run patchelf(pid=28961): Launched 23:21:27.871000 run osmo-stp_10.42.42.5(pid=28958): ERR: Terminated: ERROR {rc=1} [trial-2366↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28958)] 23:21:27.994583 run osmo-stp_10.42.42.5(pid=28958): stdout: | (launched: 2022-12-09_23:21:26.684588) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:21:28.119969 run osmo-stp_10.42.42.5(pid=28958): stderr: | 20221209232126853 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232126853 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232126854 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232126854 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232126855 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232126855 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232126855 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:21:28.245401 run osmo-stp_10.42.42.5(pid=28958): stdout: | (launched: 2022-12-09_23:21:26.684588) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:21:28.364886 run osmo-stp_10.42.42.5(pid=28958): stderr: | 20221209232126853 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232126853 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232126854 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232126854 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232126855 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232126855 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232126855 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:21:28.507174 run patchelf(pid=28961): Terminating (SIGINT) 23:21:28.672144 run patchelf(pid=28961): Terminated: ok {rc=0} 23:21:28.790338 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=28958): Process ended prematurely: osmo-stp_10.42.42.5(pid=28958) [trial-2366↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28958)] [trial-2366↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 23:21:28.799254 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 23:21:28.826032 run osmo-hlr_10.42.42.2(pid=28955): ERR: Terminated: ERROR {rc=237} [trial-2366↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28955)] 23:21:28.873375 run osmo-hlr_10.42.42.2(pid=28955): stdout: | (launched: 2022-12-09_23:21:25.781365) 23:21:28.922709 run osmo-hlr_10.42.42.2(pid=28955): stderr: | 20221209232125957 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209232125957 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209232125957 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209232125957 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209232125957 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209232125957 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209232125972 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209232125982 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209232125982 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209232125982 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:21:28.972405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28954): Terminating (SIGTERM) 23:21:29.012193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28957): Terminating (SIGTERM) 23:21:29.051651 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28960): Terminating (SIGTERM) 23:21:29.091713 --- ParallelTerminationStrategy: PID 28954 died... 23:21:29.110881 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28954): Terminated: ok {rc=0} 23:21:29.154794 --- ParallelTerminationStrategy: PID 28957 died... 23:21:29.173415 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28957): Terminated: ok {rc=0} 23:21:29.217364 --- ParallelTerminationStrategy: PID 28960 died... 23:21:29.236162 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28960): Terminated: ok {rc=0} 23:21:29.320083 bus /gobi_0: Setting Powered False 23:21:30.414664 bus /gobi_0: Setting Powered False 23:21:31.532638 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2366 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 dynts:sysmo+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 23:21:32.768533 tst dynts:sysmo+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:21:32.774316 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 23:21:32.794605 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 23:21:32.829489 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 23:21:32.882851 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 23:21:32.903562 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 23:21:32.937578 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 23:21:33.491909 tst dynts:sysmo+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2366 dynts:sysmo+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 23:21:33.496727 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:21:33.507604 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 23:21:33.562777 tst switch_tch_pdch.py: using LAC 24371 23:21:33.680078 tst switch_tch_pdch.py: using RAC 146 23:21:33.795417 tst switch_tch_pdch.py: using CellId 24371 23:21:33.911214 tst switch_tch_pdch.py: using BVCI 24372 23:21:34.017374 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:21:34.028234 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:21:34.038863 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:21:34.049442 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:21:34.059900 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:21:34.070429 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:21:34.081134 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:21:34.091760 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 23:21:34.209838 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 23:21:34.325191 tst switch_tch_pdch.py:51: start network... 23:21:34.522782 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:21:34.951624 run create_hlr_db(pid=28965): Launched 23:21:35.069918 bus /gobi_6: Setting Powered False 23:21:36.128635 run create_hlr_db(pid=28965): Terminated: ok {rc=0} 23:21:36.530845 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28967): Launched 23:21:36.845524 run osmo-hlr_10.42.42.2(pid=28968): Launched 23:21:36.966561 run osmo-stp_10.42.42.5: Starting osmo-stp 23:21:37.484551 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28970): Launched 23:21:37.798422 run osmo-stp_10.42.42.5(pid=28971): Launched 23:21:37.918336 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:21:38.436009 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28973): Launched 23:21:38.556936 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:21:38.822384 run patchelf(pid=28974): Launched 23:21:38.996831 run osmo-stp_10.42.42.5(pid=28971): ERR: Terminated: ERROR {rc=1} [trial-2366↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28971)] 23:21:39.130596 run osmo-stp_10.42.42.5(pid=28971): stdout: | (launched: 2022-12-09_23:21:37.741399) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:21:39.265941 run osmo-stp_10.42.42.5(pid=28971): stderr: | 20221209232137930 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232137930 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232137930 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232137931 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232137933 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232137933 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232137933 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:21:39.401396 run osmo-stp_10.42.42.5(pid=28971): stdout: | (launched: 2022-12-09_23:21:37.741399) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:21:39.530546 run osmo-stp_10.42.42.5(pid=28971): stderr: | 20221209232137930 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232137930 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232137930 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232137931 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232137933 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232137933 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232137933 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:21:39.683952 run patchelf(pid=28974): Terminating (SIGINT) 23:21:39.860632 run patchelf(pid=28974): Terminated: ok {rc=0} 23:21:39.988685 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=28971): Process ended prematurely: osmo-stp_10.42.42.5(pid=28971) [trial-2366↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28971)] [trial-2366↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 23:21:39.998268 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 23:21:40.026612 run osmo-hlr_10.42.42.2(pid=28968): ERR: Terminated: ERROR {rc=237} [trial-2366↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28968)] 23:21:40.077184 run osmo-hlr_10.42.42.2(pid=28968): stdout: | (launched: 2022-12-09_23:21:36.788807) 23:21:40.129629 run osmo-hlr_10.42.42.2(pid=28968): stderr: | 20221209232136987 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209232136987 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209232136987 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209232136987 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209232136987 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209232136987 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209232136999 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/dynts:sysmo+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209232137007 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209232137008 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209232137008 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:21:40.182321 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28967): Terminating (SIGTERM) 23:21:40.224221 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28970): Terminating (SIGTERM) 23:21:40.266084 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28973): Terminating (SIGTERM) 23:21:40.308053 --- ParallelTerminationStrategy: PID 28967 died... 23:21:40.328097 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28967): Terminated: ok {rc=0} 23:21:40.374970 --- ParallelTerminationStrategy: PID 28970 died... 23:21:40.394539 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28970): Terminated: ok {rc=0} 23:21:40.441248 --- ParallelTerminationStrategy: PID 28973 died... 23:21:40.460794 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28973): Terminated: ok {rc=0} 23:21:40.548523 bus /gobi_0: Setting Powered False 23:21:41.647773 bus /gobi_0: Setting Powered False 23:21:42.763468 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2366 dynts:sysmo+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 nitb_sms:oc2g --------------------------------------------------------------------- 23:21:43.999340 tst nitb_sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:21:44.003159 tst nitb_sms:oc2g: Verifying 1 x bts (candidates: 11) 23:21:44.023317 tst nitb_sms:oc2g: Verifying 1 x ip_address (candidates: 9) 23:21:44.030406 tst nitb_sms:oc2g: Verifying 2 x modem (candidates: 12) 23:21:44.082142 tst nitb_sms:oc2g: Reserving 1 x bts (candidates: 11) 23:21:44.102751 tst nitb_sms:oc2g: Reserving 1 x ip_address (candidates: 9) 23:21:44.109496 tst nitb_sms:oc2g: Reserving 2 x modem (candidates: 12) 23:21:44.647637 tst nitb_sms:oc2g: RESERVED RESOURCES for nitb_sms: bts OC-2G ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 nitb_sms:oc2g mo_mt_sms.py ---------------------------------------------- 23:21:44.653213 tst nitb_sms:oc2g: Using 1 x ip_address (candidates: 1) 23:21:44.664320 tst nitb_sms:oc2g: Using 1 x bts (candidates: 1) 23:21:44.699649 tst mo_mt_sms.py: using LAC 24372 23:21:44.823115 tst mo_mt_sms.py: using RAC 147 23:21:44.946691 tst mo_mt_sms.py: using CellId 24372 23:21:45.070243 tst mo_mt_sms.py: using BVCI 24373 23:21:45.187021 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 23:21:45.301544 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 23:21:45.414188 tst mo_mt_sms.py:9: start nitb and bts... 23:21:45.610605 run osmo-nitb_10.42.42.2: Starting osmo-nitb 23:21:46.274463 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28978): Launched 23:21:46.622468 run osmo-nitb_10.42.42.2(pid=28979): Launched 23:21:46.811187 run osmo-nitb_10.42.42.2(pid=28979): ERR: Terminated: ERROR {rc=2} [trial-2366↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28979)] 23:21:46.957272 run osmo-nitb_10.42.42.2(pid=28979): stdout: | (launched: 2022-12-09_23:21:46.545605) 23:21:47.103936 run osmo-nitb_10.42.42.2(pid=28979): stderr: | (launched: 2022-12-09_23:21:46.595207) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:21:47.249388 run osmo-nitb_10.42.42.2(pid=28979): stdout: | (launched: 2022-12-09_23:21:46.545605) 23:21:47.386269 run osmo-nitb_10.42.42.2(pid=28979): stderr: | (launched: 2022-12-09_23:21:46.595207) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=28979): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28979) [trial-2366↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28979)] 23:21:47.753740 tst osmo-nitb_10.42.42.2(pid=28979): stdout: | (launched: 2022-12-09_23:21:46.545605) 23:21:47.880636 tst osmo-nitb_10.42.42.2(pid=28979): stderr: | (launched: 2022-12-09_23:21:46.595207) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:21:48.030550 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=28979): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28979) [trial-2366↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28979)] [trial-2366↪nitb_sms:oc2g↪mo_mt_sms.py:11] 23:21:48.039452 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 23:21:48.046459 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28978): Terminating (SIGTERM) 23:21:48.258662 --- ParallelTerminationStrategy: PID 28978 died... 23:21:48.280108 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28978): Terminated: ok {rc=0} 23:21:48.368339 bus /sierra_3: Setting Powered False 23:21:49.468178 bus /sierra_3: Setting Powered False 23:21:50.586746 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 nitb_sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 sms:oc2g --------------------------------------------------------------------- 23:21:51.763609 tst sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:21:51.767524 tst sms:oc2g: Verifying 1 x bts (candidates: 11) 23:21:51.787593 tst sms:oc2g: Verifying 6 x ip_address (candidates: 9) 23:21:51.814374 tst sms:oc2g: Verifying 2 x modem (candidates: 12) 23:21:51.866370 tst sms:oc2g: Reserving 1 x bts (candidates: 11) 23:21:51.887387 tst sms:oc2g: Reserving 6 x ip_address (candidates: 9) 23:21:51.913852 tst sms:oc2g: Reserving 2 x modem (candidates: 12) 23:21:52.459160 tst sms:oc2g: RESERVED RESOURCES for sms: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 sms:oc2g mo_mt_sms.py ---------------------------------------------- 23:21:52.464088 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 23:21:52.474616 tst sms:oc2g: Using 1 x bts (candidates: 1) 23:21:52.506997 tst mo_mt_sms.py: using LAC 24373 23:21:52.619981 tst mo_mt_sms.py: using RAC 148 23:21:52.734064 tst mo_mt_sms.py: using CellId 24373 23:21:52.848102 tst mo_mt_sms.py: using BVCI 24374 23:21:52.954419 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 23:21:52.964804 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 23:21:52.975088 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 23:21:52.985480 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 23:21:52.995650 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 23:21:53.005990 tst sms:oc2g: Using 1 x modem (candidates: 2) 23:21:53.122313 tst sms:oc2g: Using 1 x modem (candidates: 2) 23:21:53.242739 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:21:53.730096 run create_hlr_db(pid=28983): Launched 23:21:53.850105 bus /sierra_2: Setting Powered False 23:21:54.912627 run create_hlr_db(pid=28983): Terminated: ok {rc=0} 23:21:55.351687 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28985): Launched 23:21:55.664682 run osmo-hlr_10.42.42.2(pid=28986): Launched 23:21:55.785619 run osmo-stp_10.42.42.5: Starting osmo-stp 23:21:56.329931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28988): Launched 23:21:56.643434 run osmo-stp_10.42.42.5(pid=28989): Launched 23:21:56.764560 run osmo-msc_10.42.42.6: Starting osmo-msc 23:21:57.334056 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28991): Launched 23:21:57.648050 run osmo-msc_10.42.42.6(pid=28992): Launched 23:21:57.825803 run osmo-stp_10.42.42.5(pid=28989): ERR: Terminated: ERROR {rc=1} [trial-2366↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28989)] 23:21:57.959313 run osmo-stp_10.42.42.5(pid=28989): stdout: | (launched: 2022-12-09_23:21:56.586497) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:21:58.093415 run osmo-stp_10.42.42.5(pid=28989): stderr: | 20221209232156777 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232156777 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232156778 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232156778 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232156778 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232156778 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232156779 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:21:58.227148 run osmo-stp_10.42.42.5(pid=28989): stdout: | (launched: 2022-12-09_23:21:56.586497) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:21:58.353098 run osmo-stp_10.42.42.5(pid=28989): stderr: | 20221209232156777 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232156777 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232156778 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232156778 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232156778 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232156778 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232156779 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:21:58.503389 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=28989): Process ended prematurely: osmo-stp_10.42.42.5(pid=28989) [trial-2366↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28989)] [trial-2366↪sms:oc2g↪mo_mt_sms.py:16] 23:21:58.512506 tst mo_mt_sms.py:16: Test FAILED (6.0 sec) 23:21:58.540761 run osmo-hlr_10.42.42.2(pid=28986): ERR: Terminated: ERROR {rc=237} [trial-2366↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28986)] 23:21:58.591724 run osmo-hlr_10.42.42.2(pid=28986): stdout: | (launched: 2022-12-09_23:21:55.607820) 23:21:58.644194 run osmo-hlr_10.42.42.2(pid=28986): stderr: | 20221209232155805 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209232155806 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209232155806 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209232155806 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209232155806 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209232155806 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209232155817 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/sms:oc2g/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209232155826 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209232155826 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209232155826 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:21:58.717718 run osmo-msc_10.42.42.6(pid=28992): ERR: Terminated: ERROR {rc=2} [trial-2366↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28992)] 23:21:58.768612 run osmo-msc_10.42.42.6(pid=28992): stdout: | (launched: 2022-12-09_23:21:57.591250) 23:21:58.820910 run osmo-msc_10.42.42.6(pid=28992): stderr: | 20221209232157911 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209232157911 DLGLOBAL DEBUG validating counter group 0x7f2d77bbbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209232157911 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209232157911 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209232157912 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209232157912 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209232157914 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209232157914 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209232157914 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209232157914 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:21:58.873518 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28985): Terminating (SIGTERM) 23:21:58.915773 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28988): Terminating (SIGTERM) 23:21:58.957702 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28991): Terminating (SIGTERM) 23:21:59.000645 --- ParallelTerminationStrategy: PID 28985 died... 23:21:59.020695 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28985): Terminated: ok {rc=0} 23:21:59.068149 --- ParallelTerminationStrategy: PID 28988 died... 23:21:59.088013 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28988): Terminated: ok {rc=0} 23:21:59.135232 --- ParallelTerminationStrategy: PID 28991 died... 23:21:59.155250 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28991): Terminated: ok {rc=0} 23:21:59.243628 bus /sierra_3: Setting Powered False 23:22:00.342677 bus /sierra_3: Setting Powered False 23:22:01.462925 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 nitb_ussd:oc2g --------------------------------------------------------------------- 23:22:02.683220 tst nitb_ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:22:02.687562 tst nitb_ussd:oc2g: Verifying 1 x bts (candidates: 11) 23:22:02.708418 tst nitb_ussd:oc2g: Verifying 1 x ip_address (candidates: 9) 23:22:02.715144 tst nitb_ussd:oc2g: Verifying 1 x modem (candidates: 12) 23:22:02.748781 tst nitb_ussd:oc2g: Reserving 1 x bts (candidates: 11) 23:22:02.769458 tst nitb_ussd:oc2g: Reserving 1 x ip_address (candidates: 9) 23:22:02.776396 tst nitb_ussd:oc2g: Reserving 1 x modem (candidates: 12) 23:22:03.296488 tst nitb_ussd:oc2g: RESERVED RESOURCES for nitb_ussd: bts OC-2G ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2366 nitb_ussd:oc2g assert_extension.py ---------------------------------------------- 23:22:03.301748 tst nitb_ussd:oc2g: Using 1 x ip_address (candidates: 1) 23:22:03.312360 tst nitb_ussd:oc2g: Using 1 x bts (candidates: 1) 23:22:03.346470 tst assert_extension.py: using LAC 24374 23:22:03.461570 tst assert_extension.py: using RAC 149 23:22:03.575578 tst assert_extension.py: using CellId 24374 23:22:03.689280 tst assert_extension.py: using BVCI 24375 23:22:03.794425 tst nitb_ussd:oc2g: Using 1 x modem (candidates: 1) 23:22:03.910253 tst assert_extension.py:10: start nitb and bts... 23:22:04.123507 run osmo-nitb_10.42.42.2: Starting osmo-nitb 23:22:04.763663 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28997): Launched 23:22:05.077148 run osmo-nitb_10.42.42.2(pid=28998): Launched 23:22:05.252508 run osmo-nitb_10.42.42.2(pid=28998): ERR: Terminated: ERROR {rc=2} [trial-2366↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28998)] 23:22:05.393771 run osmo-nitb_10.42.42.2(pid=28998): stdout: | (launched: 2022-12-09_23:22:05.020314) 23:22:05.536292 run osmo-nitb_10.42.42.2(pid=28998): stderr: | (launched: 2022-12-09_23:22:05.067059) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:22:05.679031 run osmo-nitb_10.42.42.2(pid=28998): stdout: | (launched: 2022-12-09_23:22:05.020314) 23:22:05.815878 run osmo-nitb_10.42.42.2(pid=28998): stderr: | (launched: 2022-12-09_23:22:05.067059) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=28998): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28998) [trial-2366↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28998)] 23:22:06.197093 tst osmo-nitb_10.42.42.2(pid=28998): stdout: | (launched: 2022-12-09_23:22:05.020314) 23:22:06.322877 tst osmo-nitb_10.42.42.2(pid=28998): stderr: | (launched: 2022-12-09_23:22:05.067059) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:22:06.472550 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=28998): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28998) [trial-2366↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28998)] [trial-2366↪nitb_ussd:oc2g↪assert_extension.py:12] 23:22:06.481506 tst assert_extension.py:12: Test FAILED (3.2 sec) 23:22:06.488471 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28997): Terminating (SIGTERM) 23:22:06.700070 --- ParallelTerminationStrategy: PID 28997 died... 23:22:06.721583 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28997): Terminated: ok {rc=0} 23:22:06.810300 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 nitb_ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 ussd:oc2g --------------------------------------------------------------------- 23:22:07.970983 tst ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:22:07.974725 tst ussd:oc2g: Verifying 1 x bts (candidates: 11) 23:22:07.995192 tst ussd:oc2g: Verifying 6 x ip_address (candidates: 9) 23:22:08.021758 tst ussd:oc2g: Verifying 1 x modem (candidates: 12) 23:22:08.055360 tst ussd:oc2g: Reserving 1 x bts (candidates: 11) 23:22:08.075634 tst ussd:oc2g: Reserving 6 x ip_address (candidates: 9) 23:22:08.102230 tst ussd:oc2g: Reserving 1 x modem (candidates: 12) 23:22:08.631336 tst ussd:oc2g: RESERVED RESOURCES for ussd: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2366 ussd:oc2g assert_extension.py ---------------------------------------------- 23:22:08.636480 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 23:22:08.647174 tst ussd:oc2g: Using 1 x bts (candidates: 1) 23:22:08.680902 tst assert_extension.py: using LAC 24375 23:22:08.795657 tst assert_extension.py: using RAC 150 23:22:08.909171 tst assert_extension.py: using CellId 24375 23:22:09.022348 tst assert_extension.py: using BVCI 24376 23:22:09.127773 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 23:22:09.138196 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 23:22:09.148445 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 23:22:09.158890 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 23:22:09.169423 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 23:22:09.179936 tst ussd:oc2g: Using 1 x modem (candidates: 1) 23:22:09.296507 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:22:09.785987 run create_hlr_db(pid=29002): Launched 23:22:09.905806 bus /sierra_2: Setting Powered False 23:22:10.968536 run create_hlr_db(pid=29002): Terminated: ok {rc=0} 23:22:11.407417 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29004): Launched 23:22:11.721838 run osmo-hlr_10.42.42.2(pid=29005): Launched 23:22:11.842343 run osmo-stp_10.42.42.5: Starting osmo-stp 23:22:12.395060 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29007): Launched 23:22:12.708384 run osmo-stp_10.42.42.5(pid=29008): Launched 23:22:12.829931 run osmo-msc_10.42.42.6: Starting osmo-msc 23:22:13.397189 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29010): Launched 23:22:13.709187 run osmo-msc_10.42.42.6(pid=29011): Launched 23:22:13.883849 run osmo-stp_10.42.42.5(pid=29008): ERR: Terminated: ERROR {rc=1} [trial-2366↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29008)] 23:22:14.016293 run osmo-stp_10.42.42.5(pid=29008): stdout: | (launched: 2022-12-09_23:22:12.651512) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:22:14.149576 run osmo-stp_10.42.42.5(pid=29008): stderr: | 20221209232212842 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232212842 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232212843 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232212843 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232212843 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232212843 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232212843 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:22:14.282622 run osmo-stp_10.42.42.5(pid=29008): stdout: | (launched: 2022-12-09_23:22:12.651512) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:22:14.407845 run osmo-stp_10.42.42.5(pid=29008): stderr: | 20221209232212842 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232212842 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232212843 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232212843 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232212843 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232212843 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232212843 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:22:14.557744 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=29008): Process ended prematurely: osmo-stp_10.42.42.5(pid=29008) [trial-2366↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29008)] [trial-2366↪ussd:oc2g↪assert_extension.py:17] 23:22:14.566508 tst assert_extension.py:17: Test FAILED (5.9 sec) 23:22:14.593805 run osmo-hlr_10.42.42.2(pid=29005): ERR: Terminated: ERROR {rc=237} [trial-2366↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29005)] 23:22:14.643770 run osmo-hlr_10.42.42.2(pid=29005): stdout: | (launched: 2022-12-09_23:22:11.664925) 23:22:14.695423 run osmo-hlr_10.42.42.2(pid=29005): stderr: | 20221209232211860 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209232211861 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209232211861 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209232211861 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209232211861 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209232211861 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209232211873 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/ussd:oc2g/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209232211881 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209232211882 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209232211882 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:22:14.767158 run osmo-msc_10.42.42.6(pid=29011): ERR: Terminated: ERROR {rc=2} [trial-2366↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29011)] 23:22:14.817435 run osmo-msc_10.42.42.6(pid=29011): stdout: | (launched: 2022-12-09_23:22:13.652373) 23:22:14.868797 run osmo-msc_10.42.42.6(pid=29011): stderr: | 20221209232213972 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209232213972 DLGLOBAL DEBUG validating counter group 0x7f95be6b7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209232213972 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209232213972 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209232213973 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209232213973 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209232213975 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209232213975 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209232213975 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209232213975 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:22:14.920554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29004): Terminating (SIGTERM) 23:22:14.962112 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29007): Terminating (SIGTERM) 23:22:15.003675 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29010): Terminating (SIGTERM) 23:22:15.045544 --- ParallelTerminationStrategy: PID 29004 died... 23:22:15.065336 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29004): Terminated: ok {rc=0} 23:22:15.112044 --- ParallelTerminationStrategy: PID 29007 died... 23:22:15.131391 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29007): Terminated: ok {rc=0} 23:22:15.177843 --- ParallelTerminationStrategy: PID 29010 died... 23:22:15.197399 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29010): Terminated: ok {rc=0} 23:22:15.285277 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 23:22:16.499520 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:22:16.510661 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 23:22:16.542413 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 23:22:16.582554 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 23:22:16.649629 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 23:22:16.692255 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 23:22:16.730391 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 23:22:17.241056 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 23:22:17.291494 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:22:17.302703 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 23:22:17.358728 tst mo_mt_call.py: using LAC 24376 23:22:17.476774 tst mo_mt_call.py: using RAC 151 23:22:17.594263 tst mo_mt_call.py: using CellId 24376 23:22:17.711003 tst mo_mt_call.py: using BVCI 24377 23:22:17.819773 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:22:17.830958 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:22:17.841894 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:22:17.853090 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:22:17.863988 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:22:17.875298 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:22:17.989413 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:22:18.104239 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:22:18.564223 run create_hlr_db(pid=29016): Launched 23:22:18.686261 bus /sierra_2: Setting Powered False 23:22:19.745645 run create_hlr_db(pid=29016): Terminated: ok {rc=0} 23:22:20.183292 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29018): Launched 23:22:20.503215 run osmo-hlr_10.42.42.2(pid=29019): Launched 23:22:20.626084 run osmo-stp_10.42.42.5: Starting osmo-stp 23:22:21.179703 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29021): Launched 23:22:21.500776 run osmo-stp_10.42.42.5(pid=29022): Launched 23:22:21.623948 run osmo-msc_10.42.42.6: Starting osmo-msc 23:22:22.202351 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29024): Launched 23:22:22.520540 run osmo-msc_10.42.42.6(pid=29025): Launched 23:22:22.699955 run osmo-stp_10.42.42.5(pid=29022): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29022)] 23:22:22.835836 run osmo-stp_10.42.42.5(pid=29022): stdout: | (launched: 2022-12-09_23:22:21.442581) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:22:22.972552 run osmo-stp_10.42.42.5(pid=29022): stderr: | 20221209232221635 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232221635 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232221635 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232221636 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232221636 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232221636 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232221636 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:22:23.107561 run osmo-stp_10.42.42.5(pid=29022): stdout: | (launched: 2022-12-09_23:22:21.442581) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:22:23.235696 run osmo-stp_10.42.42.5(pid=29022): stderr: | 20221209232221635 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232221635 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232221635 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232221636 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232221636 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232221636 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232221636 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:22:23.388521 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29022): Process ended prematurely: osmo-stp_10.42.42.5(pid=29022) [trial-2366↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29022)] [trial-2366↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 23:22:23.398050 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 23:22:23.426265 run osmo-hlr_10.42.42.2(pid=29019): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29019)] 23:22:23.476547 run osmo-hlr_10.42.42.2(pid=29019): stdout: | (launched: 2022-12-09_23:22:20.445829) 23:22:23.528831 run osmo-hlr_10.42.42.2(pid=29019): stderr: | 20221209232220642 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209232220642 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209232220642 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209232220642 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209232220642 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209232220642 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209232220655 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209232220664 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209232220664 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209232220664 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:22:23.601208 run osmo-msc_10.42.42.6(pid=29025): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29025)] 23:22:23.651635 run osmo-msc_10.42.42.6(pid=29025): stdout: | (launched: 2022-12-09_23:22:22.462672) 23:22:23.703632 run osmo-msc_10.42.42.6(pid=29025): stderr: | 20221209232222783 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209232222783 DLGLOBAL DEBUG validating counter group 0x7f9eb2485c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209232222784 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209232222784 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209232222784 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209232222784 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209232222787 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209232222788 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209232222788 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209232222788 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:22:23.756027 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29018): Terminating (SIGTERM) 23:22:23.798280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29021): Terminating (SIGTERM) 23:22:23.840436 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29024): Terminating (SIGTERM) 23:22:23.882948 --- ParallelTerminationStrategy: PID 29018 died... 23:22:23.903115 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29018): Terminated: ok {rc=0} 23:22:23.950039 --- ParallelTerminationStrategy: PID 29021 died... 23:22:23.969658 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29021): Terminated: ok {rc=0} 23:22:24.016229 --- ParallelTerminationStrategy: PID 29024 died... 23:22:24.035859 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29024): Terminated: ok {rc=0} 23:22:24.124175 bus /sierra_3: Setting Powered False 23:22:25.223988 bus /sierra_3: Setting Powered False 23:22:26.340074 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 23:22:27.498591 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:22:27.510806 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 23:22:27.569182 tst mo_mt_call_osmux.py: using LAC 24377 23:22:27.695579 tst mo_mt_call_osmux.py: using RAC 152 23:22:27.821363 tst mo_mt_call_osmux.py: using CellId 24377 23:22:27.948106 tst mo_mt_call_osmux.py: using BVCI 24378 23:22:28.064705 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:22:28.076182 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:22:28.087571 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:22:28.099064 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:22:28.110549 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:22:28.122133 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:22:28.242559 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:22:28.359461 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:22:28.821855 run create_hlr_db(pid=29027): Launched 23:22:28.944439 bus /sierra_2: Setting Powered False 23:22:30.004679 run create_hlr_db(pid=29027): Terminated: ok {rc=0} 23:22:30.420116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29029): Launched 23:22:30.716849 run osmo-hlr_10.42.42.2(pid=29030): Launched 23:22:30.830241 run osmo-stp_10.42.42.5: Starting osmo-stp 23:22:31.494710 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29032): Launched 23:22:31.843087 run osmo-stp_10.42.42.5(pid=29033): Launched 23:22:31.990430 run osmo-msc_10.42.42.6: Starting osmo-msc 23:22:32.646875 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29035): Launched 23:22:32.944475 run osmo-msc_10.42.42.6(pid=29036): Launched 23:22:33.110787 run osmo-stp_10.42.42.5(pid=29033): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29033)] 23:22:33.236878 run osmo-stp_10.42.42.5(pid=29033): stdout: | (launched: 2022-12-09_23:22:31.776395) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:22:33.362761 run osmo-stp_10.42.42.5(pid=29033): stderr: | 20221209232232121 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232232121 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232232121 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232232122 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232232122 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232232122 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232232122 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:22:33.486647 run osmo-stp_10.42.42.5(pid=29033): stdout: | (launched: 2022-12-09_23:22:31.776395) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:22:33.605659 run osmo-stp_10.42.42.5(pid=29033): stderr: | 20221209232232121 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232232121 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232232121 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232232122 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232232122 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232232122 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232232122 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:22:33.747301 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29033): Process ended prematurely: osmo-stp_10.42.42.5(pid=29033) [trial-2366↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29033)] [trial-2366↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 23:22:33.756121 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 23:22:33.782578 run osmo-hlr_10.42.42.2(pid=29030): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29030)] 23:22:33.830348 run osmo-hlr_10.42.42.2(pid=29030): stdout: | (launched: 2022-12-09_23:22:30.662925) 23:22:33.879514 run osmo-hlr_10.42.42.2(pid=29030): stderr: | 20221209232230877 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209232230877 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209232230877 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209232230877 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209232230877 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209232230877 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209232230895 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209232230918 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209232230918 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209232230918 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:22:33.948225 run osmo-msc_10.42.42.6(pid=29036): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29036)] 23:22:33.995588 run osmo-msc_10.42.42.6(pid=29036): stdout: | (launched: 2022-12-09_23:22:32.890001) 23:22:34.044179 run osmo-msc_10.42.42.6(pid=29036): stderr: | 20221209232233162 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209232233162 DLGLOBAL DEBUG validating counter group 0x7f6e18993c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209232233162 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209232233163 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209232233163 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209232233163 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209232233165 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209232233165 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209232233166 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209232233166 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:22:34.093499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29029): Terminating (SIGTERM) 23:22:34.132846 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29032): Terminating (SIGTERM) 23:22:34.172240 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29035): Terminating (SIGTERM) 23:22:34.212148 --- ParallelTerminationStrategy: PID 29029 died... 23:22:34.231210 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29029): Terminated: ok {rc=0} 23:22:34.275169 --- ParallelTerminationStrategy: PID 29032 died... 23:22:34.293628 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29032): Terminated: ok {rc=0} 23:22:34.337205 --- ParallelTerminationStrategy: PID 29035 died... 23:22:34.355760 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29035): Terminated: ok {rc=0} 23:22:34.440582 bus /sierra_3: Setting Powered False 23:22:35.539961 bus /sierra_3: Setting Powered False 23:22:36.655165 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 23:22:37.891359 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:22:37.898246 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 23:22:37.919087 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 23:22:37.947255 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 23:22:38.004081 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 23:22:38.025450 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 23:22:38.053206 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 23:22:38.599993 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 23:22:38.648901 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:22:38.660203 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 23:22:38.715453 tst mo_mt_call.py: using LAC 24378 23:22:38.832155 tst mo_mt_call.py: using RAC 153 23:22:38.957023 tst mo_mt_call.py: using CellId 24378 23:22:39.081813 tst mo_mt_call.py: using BVCI 24379 23:22:39.198751 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:22:39.210378 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:22:39.221657 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:22:39.233085 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:22:39.244483 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:22:39.256417 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:22:39.377694 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:22:39.494488 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:22:39.958200 run create_hlr_db(pid=29044): Launched 23:22:40.080737 bus /sierra_2: Setting Powered False 23:22:41.141501 run create_hlr_db(pid=29044): Terminated: ok {rc=0} 23:22:41.580007 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29046): Launched 23:22:41.899890 run osmo-hlr_10.42.42.2(pid=29047): Launched 23:22:42.022162 run osmo-stp_10.42.42.5: Starting osmo-stp 23:22:42.575480 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29049): Launched 23:22:42.895417 run osmo-stp_10.42.42.5(pid=29050): Launched 23:22:43.017561 run osmo-msc_10.42.42.6: Starting osmo-msc 23:22:43.595742 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29052): Launched 23:22:43.915656 run osmo-msc_10.42.42.6(pid=29053): Launched 23:22:44.093612 run osmo-stp_10.42.42.5(pid=29050): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29050)] 23:22:44.229053 run osmo-stp_10.42.42.5(pid=29050): stdout: | (launched: 2022-12-09_23:22:42.837342) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:22:44.364668 run osmo-stp_10.42.42.5(pid=29050): stderr: | 20221209232243028 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232243028 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232243028 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232243029 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232243029 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232243029 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232243029 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:22:44.499524 run osmo-stp_10.42.42.5(pid=29050): stdout: | (launched: 2022-12-09_23:22:42.837342) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:22:44.627406 run osmo-stp_10.42.42.5(pid=29050): stderr: | 20221209232243028 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232243028 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232243028 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232243029 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232243029 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232243029 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232243029 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:22:44.780338 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29050): Process ended prematurely: osmo-stp_10.42.42.5(pid=29050) [trial-2366↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29050)] [trial-2366↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 23:22:44.789794 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 23:22:44.817644 run osmo-hlr_10.42.42.2(pid=29047): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29047)] 23:22:44.868268 run osmo-hlr_10.42.42.2(pid=29047): stdout: | (launched: 2022-12-09_23:22:41.842265) 23:22:44.920210 run osmo-hlr_10.42.42.2(pid=29047): stderr: | 20221209232242042 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209232242042 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209232242042 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209232242042 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209232242042 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209232242043 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209232242059 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209232242068 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209232242069 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209232242069 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:22:44.992663 run osmo-msc_10.42.42.6(pid=29053): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29053)] 23:22:45.043005 run osmo-msc_10.42.42.6(pid=29053): stdout: | (launched: 2022-12-09_23:22:43.857872) 23:22:45.095154 run osmo-msc_10.42.42.6(pid=29053): stderr: | 20221209232244180 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209232244180 DLGLOBAL DEBUG validating counter group 0x7f01e2b68c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209232244180 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209232244180 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209232244180 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209232244180 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209232244182 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209232244183 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209232244183 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209232244183 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:22:45.147273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29046): Terminating (SIGTERM) 23:22:45.189278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29049): Terminating (SIGTERM) 23:22:45.231356 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29052): Terminating (SIGTERM) 23:22:45.273750 --- ParallelTerminationStrategy: PID 29046 died... 23:22:45.294038 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29046): Terminated: ok {rc=0} 23:22:45.340632 --- ParallelTerminationStrategy: PID 29049 died... 23:22:45.360034 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29049): Terminated: ok {rc=0} 23:22:45.406748 --- ParallelTerminationStrategy: PID 29052 died... 23:22:45.426099 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29052): Terminated: ok {rc=0} 23:22:45.514069 bus /sierra_3: Setting Powered False 23:22:46.611434 bus /sierra_3: Setting Powered False 23:22:47.729520 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 23:22:48.875039 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:22:48.886513 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 23:22:48.942634 tst mo_mt_call_osmux.py: using LAC 24379 23:22:49.059504 tst mo_mt_call_osmux.py: using RAC 154 23:22:49.188711 tst mo_mt_call_osmux.py: using CellId 24379 23:22:49.319445 tst mo_mt_call_osmux.py: using BVCI 24380 23:22:49.437433 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:22:49.448927 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:22:49.460316 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:22:49.471882 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:22:49.483356 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:22:49.494859 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:22:49.611171 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:22:49.734710 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:22:50.233146 run create_hlr_db(pid=29055): Launched 23:22:50.355246 bus /sierra_2: Setting Powered False 23:22:51.418808 run create_hlr_db(pid=29055): Terminated: ok {rc=0} 23:22:51.863729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29057): Launched 23:22:52.184073 run osmo-hlr_10.42.42.2(pid=29058): Launched 23:22:52.306724 run osmo-stp_10.42.42.5: Starting osmo-stp 23:22:52.860909 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29060): Launched 23:22:53.181091 run osmo-stp_10.42.42.5(pid=29061): Launched 23:22:53.303611 run osmo-msc_10.42.42.6: Starting osmo-msc 23:22:53.881052 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29063): Launched 23:22:54.200826 run osmo-msc_10.42.42.6(pid=29064): Launched 23:22:54.378964 run osmo-stp_10.42.42.5(pid=29061): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29061)] 23:22:54.514418 run osmo-stp_10.42.42.5(pid=29061): stdout: | (launched: 2022-12-09_23:22:53.122513) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:22:54.650311 run osmo-stp_10.42.42.5(pid=29061): stderr: | 20221209232253313 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232253313 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232253313 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232253314 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232253314 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232253314 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232253314 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:22:54.785078 run osmo-stp_10.42.42.5(pid=29061): stdout: | (launched: 2022-12-09_23:22:53.122513) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:22:54.912747 run osmo-stp_10.42.42.5(pid=29061): stderr: | 20221209232253313 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232253313 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232253313 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232253314 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232253314 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232253314 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232253314 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:22:55.065834 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29061): Process ended prematurely: osmo-stp_10.42.42.5(pid=29061) [trial-2366↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29061)] [trial-2366↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 23:22:55.075416 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 23:22:55.103509 run osmo-hlr_10.42.42.2(pid=29058): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29058)] 23:22:55.154088 run osmo-hlr_10.42.42.2(pid=29058): stdout: | (launched: 2022-12-09_23:22:52.125903) 23:22:55.206252 run osmo-hlr_10.42.42.2(pid=29058): stderr: | 20221209232252321 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209232252321 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209232252321 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209232252321 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209232252321 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209232252322 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209232252334 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209232252344 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209232252344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209232252344 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:22:55.278045 run osmo-msc_10.42.42.6(pid=29064): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29064)] 23:22:55.328193 run osmo-msc_10.42.42.6(pid=29064): stdout: | (launched: 2022-12-09_23:22:54.142673) 23:22:55.379469 run osmo-msc_10.42.42.6(pid=29064): stderr: | 20221209232254462 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209232254463 DLGLOBAL DEBUG validating counter group 0x7f1c57e2ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209232254463 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209232254463 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209232254463 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209232254463 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209232254465 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209232254465 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209232254465 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209232254466 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:22:55.431214 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29057): Terminating (SIGTERM) 23:22:55.472741 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29060): Terminating (SIGTERM) 23:22:55.514488 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29063): Terminating (SIGTERM) 23:22:55.556823 --- ParallelTerminationStrategy: PID 29057 died... 23:22:55.576704 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29057): Terminated: ok {rc=0} 23:22:55.622754 --- ParallelTerminationStrategy: PID 29060 died... 23:22:55.642407 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29060): Terminated: ok {rc=0} 23:22:55.688586 --- ParallelTerminationStrategy: PID 29063 died... 23:22:55.708077 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29063): Terminated: ok {rc=0} 23:22:55.795527 bus /sierra_3: Setting Powered False 23:22:56.894512 bus /sierra_3: Setting Powered False 23:22:58.011286 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 23:22:59.243131 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:22:59.249779 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 23:22:59.270274 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 23:22:59.296661 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 23:22:59.347355 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 23:22:59.367450 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 23:22:59.393460 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 23:22:59.945557 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 23:23:00.000066 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:23:00.012170 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 23:23:00.070317 tst mo_mt_call.py: using LAC 24380 23:23:00.197454 tst mo_mt_call.py: using RAC 155 23:23:00.325499 tst mo_mt_call.py: using CellId 24380 23:23:00.452243 tst mo_mt_call.py: using BVCI 24381 23:23:00.568605 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:23:00.580116 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:23:00.591295 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:23:00.602810 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:23:00.614534 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:23:00.626233 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:23:00.742449 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:23:00.861236 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:23:01.377423 run create_hlr_db(pid=29069): Launched 23:23:01.531661 bus /sierra_2: Setting Powered False 23:23:02.596698 run create_hlr_db(pid=29069): Terminated: ok {rc=0} 23:23:03.058116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29082): Launched 23:23:03.413674 run osmo-hlr_10.42.42.2(pid=29083): Launched 23:23:03.651659 run osmo-stp_10.42.42.5: Starting osmo-stp 23:23:04.369752 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29085): Launched 23:23:04.701640 run osmo-stp_10.42.42.5(pid=29086): Launched 23:23:04.924249 run osmo-msc_10.42.42.6: Starting osmo-msc 23:23:05.664483 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29090): Launched 23:23:06.013655 run osmo-msc_10.42.42.6(pid=29091): Launched 23:23:06.352596 run osmo-stp_10.42.42.5(pid=29086): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29086)] 23:23:06.623357 run osmo-stp_10.42.42.5(pid=29086): stdout: | (launched: 2022-12-09_23:23:04.626750) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:23:06.887610 run osmo-stp_10.42.42.5(pid=29086): stderr: | 20221209232304958 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232304958 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232304958 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232304958 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232304959 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232304959 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232304959 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:23:07.073973 run osmo-stp_10.42.42.5(pid=29086): stdout: | (launched: 2022-12-09_23:23:04.626750) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:23:07.194971 run osmo-stp_10.42.42.5(pid=29086): stderr: | 20221209232304958 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232304958 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232304958 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232304958 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232304959 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232304959 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232304959 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:23:07.340006 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29086): Process ended prematurely: osmo-stp_10.42.42.5(pid=29086) [trial-2366↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29086)] [trial-2366↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 23:23:07.349730 tst mo_mt_call.py:8: Test FAILED (7.4 sec) 23:23:07.377213 run osmo-hlr_10.42.42.2(pid=29083): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29083)] 23:23:07.426612 run osmo-hlr_10.42.42.2(pid=29083): stdout: | (launched: 2022-12-09_23:23:03.335369) 23:23:07.477975 run osmo-hlr_10.42.42.2(pid=29083): stderr: | 20221209232303679 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209232303679 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209232303679 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209232303679 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209232303679 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209232303679 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209232303695 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209232303704 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209232303704 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209232303704 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:23:07.549367 run osmo-msc_10.42.42.6(pid=29091): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29091)] 23:23:07.598364 run osmo-msc_10.42.42.6(pid=29091): stdout: | (launched: 2022-12-09_23:23:05.940799) 23:23:07.649209 run osmo-msc_10.42.42.6(pid=29091): stderr: | 20221209232306538 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209232306539 DLGLOBAL DEBUG validating counter group 0x7f055a710c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209232306539 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209232306539 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209232306539 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209232306539 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209232306549 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209232306550 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209232306550 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209232306550 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:23:07.700294 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29082): Terminating (SIGTERM) 23:23:07.740865 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29085): Terminating (SIGTERM) 23:23:07.783721 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29090): Terminating (SIGTERM) 23:23:07.826858 --- ParallelTerminationStrategy: PID 29082 died... 23:23:07.846431 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29082): Terminated: ok {rc=0} 23:23:07.892551 --- ParallelTerminationStrategy: PID 29085 died... 23:23:07.911576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29085): Terminated: ok {rc=0} 23:23:07.956623 --- ParallelTerminationStrategy: PID 29090 died... 23:23:07.976310 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29090): Terminated: ok {rc=0} 23:23:08.062706 bus /sierra_3: Setting Powered False 23:23:09.166383 bus /sierra_3: Setting Powered False 23:23:10.290037 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 23:23:11.468095 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:23:11.481341 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 23:23:11.553966 tst mo_mt_call_osmux.py: using LAC 24381 23:23:11.716467 tst mo_mt_call_osmux.py: using RAC 156 23:23:11.875330 tst mo_mt_call_osmux.py: using CellId 24381 23:23:12.031207 tst mo_mt_call_osmux.py: using BVCI 24382 23:23:12.189916 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:23:12.204151 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:23:12.221196 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:23:12.238078 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:23:12.251663 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:23:12.269658 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:23:12.411951 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:23:12.579504 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:23:13.165746 run create_hlr_db(pid=29351): Launched 23:23:13.321609 bus /sierra_2: Setting Powered False 23:23:14.382702 run create_hlr_db(pid=29351): Terminated: ok {rc=0} 23:23:14.827195 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29353): Launched 23:23:15.161712 run osmo-hlr_10.42.42.2(pid=29354): Launched 23:23:15.402598 run osmo-stp_10.42.42.5: Starting osmo-stp 23:23:16.196079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29356): Launched 23:23:16.606625 run osmo-stp_10.42.42.5(pid=29357): Launched 23:23:16.894357 run osmo-msc_10.42.42.6: Starting osmo-msc 23:23:17.574839 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29359): Launched 23:23:17.979831 run osmo-msc_10.42.42.6(pid=29360): Launched 23:23:18.370003 run osmo-stp_10.42.42.5(pid=29357): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29357)] 23:23:18.695607 run osmo-stp_10.42.42.5(pid=29357): stdout: | (launched: 2022-12-09_23:23:16.537373) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:23:18.928635 run osmo-stp_10.42.42.5(pid=29357): stderr: | 20221209232316780 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232316780 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232316784 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232316785 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232316785 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232316785 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232316785 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:23:19.066479 run osmo-stp_10.42.42.5(pid=29357): stdout: | (launched: 2022-12-09_23:23:16.537373) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:23:19.199086 run osmo-stp_10.42.42.5(pid=29357): stderr: | 20221209232316780 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232316780 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232316784 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232316785 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232316785 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232316785 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232316785 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:23:19.357235 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29357): Process ended prematurely: osmo-stp_10.42.42.5(pid=29357) [trial-2366↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29357)] [trial-2366↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 23:23:19.367426 tst mo_mt_call_osmux.py:8: Test FAILED (7.9 sec) 23:23:19.398582 run osmo-hlr_10.42.42.2(pid=29354): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29354)] 23:23:19.451444 run osmo-hlr_10.42.42.2(pid=29354): stdout: | (launched: 2022-12-09_23:23:15.089681) 23:23:19.506103 run osmo-hlr_10.42.42.2(pid=29354): stderr: | 20221209232315443 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209232315443 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209232315443 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209232315443 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209232315443 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209232315443 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209232315460 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209232315472 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209232315472 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209232315472 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:23:19.581240 run osmo-msc_10.42.42.6(pid=29360): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29360)] 23:23:19.634726 run osmo-msc_10.42.42.6(pid=29360): stdout: | (launched: 2022-12-09_23:23:17.908375) 23:23:19.689563 run osmo-msc_10.42.42.6(pid=29360): stderr: | 20221209232318495 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209232318495 DLGLOBAL DEBUG validating counter group 0x7f6b27353c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209232318495 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209232318495 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209232318495 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209232318496 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209232318506 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209232318506 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209232318507 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209232318507 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:23:19.745191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29353): Terminating (SIGTERM) 23:23:19.790184 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29356): Terminating (SIGTERM) 23:23:19.836585 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29359): Terminating (SIGTERM) 23:23:19.883888 --- ParallelTerminationStrategy: PID 29353 died... 23:23:19.904826 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29353): Terminated: ok {rc=0} 23:23:19.956574 --- ParallelTerminationStrategy: PID 29356 died... 23:23:19.977488 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29356): Terminated: ok {rc=0} 23:23:20.027591 --- ParallelTerminationStrategy: PID 29359 died... 23:23:20.048715 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29359): Terminated: ok {rc=0} 23:23:20.141119 bus /sierra_3: Setting Powered False 23:23:21.246609 bus /sierra_3: Setting Powered False 23:23:22.367872 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 23:23:23.612826 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:23:23.620669 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 23:23:23.645738 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 23:23:23.678602 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 23:23:23.732182 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 23:23:23.754417 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 23:23:23.785202 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 23:23:24.333739 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 23:23:24.390410 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:23:24.403930 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 23:23:24.465159 tst mo_mt_call.py: using LAC 24382 23:23:24.594329 tst mo_mt_call.py: using RAC 157 23:23:24.724831 tst mo_mt_call.py: using CellId 24382 23:23:24.853500 tst mo_mt_call.py: using BVCI 24383 23:23:24.975786 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:23:24.988507 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:23:25.003102 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:23:25.016526 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:23:25.029136 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:23:25.043723 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:23:25.171001 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:23:25.288797 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:23:25.751065 run create_hlr_db(pid=29366): Launched 23:23:25.872113 bus /sierra_2: Setting Powered False 23:23:26.932560 run create_hlr_db(pid=29366): Terminated: ok {rc=0} 23:23:27.371100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29368): Launched 23:23:27.692486 run osmo-hlr_10.42.42.2(pid=29369): Launched 23:23:27.815654 run osmo-stp_10.42.42.5: Starting osmo-stp 23:23:28.369390 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29371): Launched 23:23:28.689571 run osmo-stp_10.42.42.5(pid=29372): Launched 23:23:28.812500 run osmo-msc_10.42.42.6: Starting osmo-msc 23:23:29.394894 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29374): Launched 23:23:29.716351 run osmo-msc_10.42.42.6(pid=29375): Launched 23:23:29.895445 run osmo-stp_10.42.42.5(pid=29372): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29372)] 23:23:30.031562 run osmo-stp_10.42.42.5(pid=29372): stdout: | (launched: 2022-12-09_23:23:28.631609) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:23:30.168398 run osmo-stp_10.42.42.5(pid=29372): stderr: | 20221209232328824 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232328824 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232328824 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232328824 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232328825 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232328825 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232328825 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:23:30.304409 run osmo-stp_10.42.42.5(pid=29372): stdout: | (launched: 2022-12-09_23:23:28.631609) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:23:30.433115 run osmo-stp_10.42.42.5(pid=29372): stderr: | 20221209232328824 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232328824 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232328824 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232328824 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232328825 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232328825 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232328825 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:23:30.586974 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29372): Process ended prematurely: osmo-stp_10.42.42.5(pid=29372) [trial-2366↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29372)] [trial-2366↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 23:23:30.596676 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 23:23:30.625535 run osmo-hlr_10.42.42.2(pid=29369): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29369)] 23:23:30.677360 run osmo-hlr_10.42.42.2(pid=29369): stdout: | (launched: 2022-12-09_23:23:27.634601) 23:23:30.730582 run osmo-hlr_10.42.42.2(pid=29369): stderr: | 20221209232327834 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209232327834 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209232327834 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209232327834 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209232327834 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209232327834 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209232327846 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209232327854 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209232327854 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209232327854 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:23:30.804575 run osmo-msc_10.42.42.6(pid=29375): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29375)] 23:23:30.876438 run osmo-msc_10.42.42.6(pid=29375): stdout: | (launched: 2022-12-09_23:23:29.657887) 23:23:30.947434 run osmo-msc_10.42.42.6(pid=29375): stderr: | 20221209232329980 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209232329980 DLGLOBAL DEBUG validating counter group 0x7f33542d5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209232329980 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209232329980 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209232329980 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209232329980 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209232329982 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209232329983 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209232329983 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209232329983 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:23:31.001651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29368): Terminating (SIGTERM) 23:23:31.046362 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29371): Terminating (SIGTERM) 23:23:31.091016 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29374): Terminating (SIGTERM) 23:23:31.136011 --- ParallelTerminationStrategy: PID 29368 died... 23:23:31.156219 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29368): Terminated: ok {rc=0} 23:23:31.206117 --- ParallelTerminationStrategy: PID 29371 died... 23:23:31.226001 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29371): Terminated: ok {rc=0} 23:23:31.274202 --- ParallelTerminationStrategy: PID 29374 died... 23:23:31.293841 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29374): Terminated: ok {rc=0} 23:23:31.382271 bus /sierra_3: Setting Powered False 23:23:32.482987 bus /sierra_3: Setting Powered False 23:23:33.599366 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 23:23:34.749241 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:23:34.761611 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 23:23:34.822351 tst mo_mt_call_osmux.py: using LAC 24383 23:23:34.947374 tst mo_mt_call_osmux.py: using RAC 158 23:23:35.071181 tst mo_mt_call_osmux.py: using CellId 24383 23:23:35.195460 tst mo_mt_call_osmux.py: using BVCI 24384 23:23:35.312363 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:23:35.324069 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:23:35.335550 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:23:35.347582 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:23:35.359400 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:23:35.371288 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:23:35.487502 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:23:35.607819 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:23:36.069352 run create_hlr_db(pid=29377): Launched 23:23:36.190792 bus /sierra_2: Setting Powered False 23:23:37.250474 run create_hlr_db(pid=29377): Terminated: ok {rc=0} 23:23:37.667287 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29379): Launched 23:23:37.965538 run osmo-hlr_10.42.42.2(pid=29380): Launched 23:23:38.077831 run osmo-stp_10.42.42.5: Starting osmo-stp 23:23:38.592571 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29382): Launched 23:23:38.888812 run osmo-stp_10.42.42.5(pid=29383): Launched 23:23:39.001929 run osmo-msc_10.42.42.6: Starting osmo-msc 23:23:39.539722 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29385): Launched 23:23:39.836770 run osmo-msc_10.42.42.6(pid=29386): Launched 23:23:40.002553 run osmo-stp_10.42.42.5(pid=29383): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29383)] 23:23:40.128109 run osmo-stp_10.42.42.5(pid=29383): stdout: | (launched: 2022-12-09_23:23:38.834780) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:23:40.253994 run osmo-stp_10.42.42.5(pid=29383): stderr: | 20221209232339006 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232339007 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232339007 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232339007 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232339008 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232339008 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232339008 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:23:40.377859 run osmo-stp_10.42.42.5(pid=29383): stdout: | (launched: 2022-12-09_23:23:38.834780) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:23:40.495827 run osmo-stp_10.42.42.5(pid=29383): stderr: | 20221209232339006 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232339007 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232339007 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232339007 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232339008 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232339008 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232339008 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:23:40.637506 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29383): Process ended prematurely: osmo-stp_10.42.42.5(pid=29383) [trial-2366↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29383)] [trial-2366↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 23:23:40.646349 tst mo_mt_call_osmux.py:8: Test FAILED (5.9 sec) 23:23:40.672580 run osmo-hlr_10.42.42.2(pid=29380): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29380)] 23:23:40.719752 run osmo-hlr_10.42.42.2(pid=29380): stdout: | (launched: 2022-12-09_23:23:37.911030) 23:23:40.768702 run osmo-hlr_10.42.42.2(pid=29380): stderr: | 20221209232338086 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209232338086 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209232338086 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209232338086 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209232338086 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209232338086 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209232338098 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209232338107 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209232338107 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209232338107 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:23:40.837451 run osmo-msc_10.42.42.6(pid=29386): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29386)] 23:23:40.884825 run osmo-msc_10.42.42.6(pid=29386): stdout: | (launched: 2022-12-09_23:23:39.782675) 23:23:40.933811 run osmo-msc_10.42.42.6(pid=29386): stderr: | 20221209232340055 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209232340055 DLGLOBAL DEBUG validating counter group 0x7f9bac5f0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209232340055 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209232340055 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209232340056 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209232340056 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209232340058 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209232340058 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209232340058 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209232340058 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:23:40.983245 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29379): Terminating (SIGTERM) 23:23:41.022763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29382): Terminating (SIGTERM) 23:23:41.062014 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29385): Terminating (SIGTERM) 23:23:41.101884 --- ParallelTerminationStrategy: PID 29379 died... 23:23:41.120724 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29379): Terminated: ok {rc=0} 23:23:41.165266 --- ParallelTerminationStrategy: PID 29382 died... 23:23:41.183823 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29382): Terminated: ok {rc=0} 23:23:41.227600 --- ParallelTerminationStrategy: PID 29385 died... 23:23:41.246177 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29385): Terminated: ok {rc=0} 23:23:41.329373 bus /sierra_3: Setting Powered False 23:23:42.426944 bus /sierra_3: Setting Powered False 23:23:43.544460 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 23:23:44.781109 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:23:44.788069 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 23:23:44.808506 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 23:23:44.835208 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 23:23:44.891420 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 23:23:44.912021 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 23:23:44.938533 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 23:23:45.488272 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 23:23:45.540492 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:23:45.552640 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 23:23:45.610224 tst mo_mt_call.py: using LAC 24384 23:23:45.737372 tst mo_mt_call.py: using RAC 159 23:23:45.868097 tst mo_mt_call.py: using CellId 24384 23:23:46.010942 tst mo_mt_call.py: using BVCI 24385 23:23:46.129979 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:23:46.142502 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:23:46.154842 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:23:46.167876 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:23:46.181104 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:23:46.195013 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:23:46.313322 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:23:46.450760 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:23:46.991897 run create_hlr_db(pid=29391): Launched 23:23:47.145464 bus /sierra_2: Setting Powered False 23:23:48.205583 run create_hlr_db(pid=29391): Terminated: ok {rc=0} 23:23:48.640472 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29393): Launched 23:23:48.959434 run osmo-hlr_10.42.42.2(pid=29394): Launched 23:23:49.081317 run osmo-stp_10.42.42.5: Starting osmo-stp 23:23:49.635154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29396): Launched 23:23:49.954937 run osmo-stp_10.42.42.5(pid=29397): Launched 23:23:50.077818 run osmo-msc_10.42.42.6: Starting osmo-msc 23:23:50.657059 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29399): Launched 23:23:50.976091 run osmo-msc_10.42.42.6(pid=29400): Launched 23:23:51.154482 run osmo-stp_10.42.42.5(pid=29397): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29397)] 23:23:51.289822 run osmo-stp_10.42.42.5(pid=29397): stdout: | (launched: 2022-12-09_23:23:49.896927) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:23:51.425463 run osmo-stp_10.42.42.5(pid=29397): stderr: | 20221209232350088 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232350088 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232350088 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232350089 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232350091 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232350091 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232350091 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:23:51.560750 run osmo-stp_10.42.42.5(pid=29397): stdout: | (launched: 2022-12-09_23:23:49.896927) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:23:51.689293 run osmo-stp_10.42.42.5(pid=29397): stderr: | 20221209232350088 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232350088 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232350088 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232350089 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232350091 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232350091 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232350091 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:23:51.842659 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29397): Process ended prematurely: osmo-stp_10.42.42.5(pid=29397) [trial-2366↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29397)] [trial-2366↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 23:23:51.852370 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 23:23:51.881146 run osmo-hlr_10.42.42.2(pid=29394): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29394)] 23:23:51.931268 run osmo-hlr_10.42.42.2(pid=29394): stdout: | (launched: 2022-12-09_23:23:48.902012) 23:23:51.983074 run osmo-hlr_10.42.42.2(pid=29394): stderr: | 20221209232349102 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209232349102 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209232349102 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209232349102 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209232349102 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209232349102 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209232349115 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209232349123 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209232349123 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209232349123 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:23:52.055057 run osmo-msc_10.42.42.6(pid=29400): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29400)] 23:23:52.104876 run osmo-msc_10.42.42.6(pid=29400): stdout: | (launched: 2022-12-09_23:23:50.918329) 23:23:52.156277 run osmo-msc_10.42.42.6(pid=29400): stderr: | 20221209232351239 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209232351239 DLGLOBAL DEBUG validating counter group 0x7f8dfa6e2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209232351239 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209232351239 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209232351239 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209232351239 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209232351241 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209232351242 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209232351242 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209232351242 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:23:52.208664 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29393): Terminating (SIGTERM) 23:23:52.250547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29396): Terminating (SIGTERM) 23:23:52.292160 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29399): Terminating (SIGTERM) 23:23:52.334364 --- ParallelTerminationStrategy: PID 29393 died... 23:23:52.354129 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29393): Terminated: ok {rc=0} 23:23:52.400268 --- ParallelTerminationStrategy: PID 29396 died... 23:23:52.419821 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29396): Terminated: ok {rc=0} 23:23:52.465802 --- ParallelTerminationStrategy: PID 29399 died... 23:23:52.485191 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29399): Terminated: ok {rc=0} 23:23:52.572847 bus /sierra_3: Setting Powered False 23:23:53.671119 bus /sierra_3: Setting Powered False 23:23:54.786080 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 23:23:55.934347 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:23:55.946542 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 23:23:56.005450 tst mo_mt_call_osmux.py: using LAC 24385 23:23:56.123671 tst mo_mt_call_osmux.py: using RAC 160 23:23:56.240667 tst mo_mt_call_osmux.py: using CellId 24385 23:23:56.358461 tst mo_mt_call_osmux.py: using BVCI 24386 23:23:56.468213 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:23:56.479386 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:23:56.490308 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:23:56.501226 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:23:56.511767 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:23:56.522573 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:23:56.640558 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:23:56.761175 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:23:57.258012 run create_hlr_db(pid=29402): Launched 23:23:57.379470 bus /sierra_2: Setting Powered False 23:23:58.442979 run create_hlr_db(pid=29402): Terminated: ok {rc=0} 23:23:58.870234 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29404): Launched 23:23:59.167650 run osmo-hlr_10.42.42.2(pid=29405): Launched 23:23:59.280895 run osmo-stp_10.42.42.5: Starting osmo-stp 23:23:59.794029 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29407): Launched 23:24:00.091233 run osmo-stp_10.42.42.5(pid=29408): Launched 23:24:00.206633 run osmo-msc_10.42.42.6: Starting osmo-msc 23:24:00.745205 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29410): Launched 23:24:01.078819 run osmo-msc_10.42.42.6(pid=29411): Launched 23:24:01.441742 run osmo-stp_10.42.42.5(pid=29408): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29408)] 23:24:01.640004 run osmo-stp_10.42.42.5(pid=29408): stdout: | (launched: 2022-12-09_23:24:00.036940) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:24:01.887240 run osmo-stp_10.42.42.5(pid=29408): stderr: | 20221209232400207 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232400207 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232400208 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232400208 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232400208 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232400209 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232400209 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:24:02.033353 run osmo-stp_10.42.42.5(pid=29408): stdout: | (launched: 2022-12-09_23:24:00.036940) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:24:02.166237 run osmo-stp_10.42.42.5(pid=29408): stderr: | 20221209232400207 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232400207 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232400208 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232400208 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232400208 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232400209 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232400209 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:24:02.324457 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29408): Process ended prematurely: osmo-stp_10.42.42.5(pid=29408) [trial-2366↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29408)] [trial-2366↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 23:24:02.334105 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 23:24:02.362842 run osmo-hlr_10.42.42.2(pid=29405): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29405)] 23:24:02.414317 run osmo-hlr_10.42.42.2(pid=29405): stdout: | (launched: 2022-12-09_23:23:59.113371) 23:24:02.466711 run osmo-hlr_10.42.42.2(pid=29405): stderr: | 20221209232359288 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209232359288 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209232359288 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209232359288 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209232359288 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209232359288 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209232359300 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209232359309 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209232359309 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209232359309 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:24:02.539776 run osmo-msc_10.42.42.6(pid=29411): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29411)] 23:24:02.590303 run osmo-msc_10.42.42.6(pid=29411): stdout: | (launched: 2022-12-09_23:24:01.019921) 23:24:02.642299 run osmo-msc_10.42.42.6(pid=29411): stderr: | 20221209232401522 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209232401522 DLGLOBAL DEBUG validating counter group 0x7fc77ee09c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209232401522 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209232401522 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209232401523 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209232401524 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209232401525 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209232401526 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209232401526 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209232401526 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:24:02.694860 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29404): Terminating (SIGTERM) 23:24:02.736719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29407): Terminating (SIGTERM) 23:24:02.778809 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29410): Terminating (SIGTERM) 23:24:02.821080 --- ParallelTerminationStrategy: PID 29404 died... 23:24:02.841023 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29404): Terminated: ok {rc=0} 23:24:02.887747 --- ParallelTerminationStrategy: PID 29407 died... 23:24:02.907569 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29407): Terminated: ok {rc=0} 23:24:02.954841 --- ParallelTerminationStrategy: PID 29410 died... 23:24:02.974464 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29410): Terminated: ok {rc=0} 23:24:03.062242 bus /sierra_3: Setting Powered False 23:24:04.159732 bus /sierra_3: Setting Powered False 23:24:05.279257 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 23:24:06.517493 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:24:06.523796 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 23:24:06.544105 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 23:24:06.570870 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 23:24:06.622176 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 23:24:06.642739 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 23:24:06.669674 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 23:24:07.222185 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 23:24:07.270340 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:24:07.281544 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 23:24:07.349114 tst mo_mt_call.py: using LAC 24386 23:24:07.476788 tst mo_mt_call.py: using RAC 161 23:24:07.594940 tst mo_mt_call.py: using CellId 24386 23:24:07.711920 tst mo_mt_call.py: using BVCI 24387 23:24:07.819848 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:24:07.830877 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:24:07.841682 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:24:07.852574 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:24:07.863535 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:24:07.874361 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:24:07.987805 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:24:08.104605 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:24:08.566874 run create_hlr_db(pid=29416): Launched 23:24:08.691704 bus /sierra_2: Setting Powered False 23:24:09.756345 run create_hlr_db(pid=29416): Terminated: ok {rc=0} 23:24:10.202886 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29418): Launched 23:24:10.521647 run osmo-hlr_10.42.42.2(pid=29419): Launched 23:24:10.644881 run osmo-stp_10.42.42.5: Starting osmo-stp 23:24:11.199184 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29421): Launched 23:24:11.518812 run osmo-stp_10.42.42.5(pid=29422): Launched 23:24:11.642048 run osmo-msc_10.42.42.6: Starting osmo-msc 23:24:12.221072 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29424): Launched 23:24:12.541112 run osmo-msc_10.42.42.6(pid=29425): Launched 23:24:12.722173 run osmo-stp_10.42.42.5(pid=29422): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29422)] 23:24:12.857888 run osmo-stp_10.42.42.5(pid=29422): stdout: | (launched: 2022-12-09_23:24:11.461201) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:24:12.995427 run osmo-stp_10.42.42.5(pid=29422): stderr: | 20221209232411650 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232411650 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232411651 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232411651 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232411653 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232411653 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232411654 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:24:13.130973 run osmo-stp_10.42.42.5(pid=29422): stdout: | (launched: 2022-12-09_23:24:11.461201) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:24:13.259801 run osmo-stp_10.42.42.5(pid=29422): stderr: | 20221209232411650 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232411650 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232411651 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232411651 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232411653 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232411653 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232411654 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:24:13.412794 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29422): Process ended prematurely: osmo-stp_10.42.42.5(pid=29422) [trial-2366↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29422)] [trial-2366↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 23:24:13.422378 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 23:24:13.450704 run osmo-hlr_10.42.42.2(pid=29419): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29419)] 23:24:13.500730 run osmo-hlr_10.42.42.2(pid=29419): stdout: | (launched: 2022-12-09_23:24:10.464187) 23:24:13.552690 run osmo-hlr_10.42.42.2(pid=29419): stderr: | 20221209232410663 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209232410663 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209232410663 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209232410663 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209232410663 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209232410663 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209232410674 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209232410682 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209232410682 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209232410682 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:24:13.625128 run osmo-msc_10.42.42.6(pid=29425): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29425)] 23:24:13.675259 run osmo-msc_10.42.42.6(pid=29425): stdout: | (launched: 2022-12-09_23:24:12.483075) 23:24:13.727060 run osmo-msc_10.42.42.6(pid=29425): stderr: | 20221209232412805 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209232412805 DLGLOBAL DEBUG validating counter group 0x7f576e4e3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209232412805 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209232412805 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209232412805 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209232412805 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209232412807 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209232412807 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209232412808 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209232412808 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:24:13.779404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29418): Terminating (SIGTERM) 23:24:13.821478 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29421): Terminating (SIGTERM) 23:24:13.863475 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29424): Terminating (SIGTERM) 23:24:13.905832 --- ParallelTerminationStrategy: PID 29418 died... 23:24:13.925875 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29418): Terminated: ok {rc=0} 23:24:13.972869 --- ParallelTerminationStrategy: PID 29421 died... 23:24:13.992606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29421): Terminated: ok {rc=0} 23:24:14.039571 --- ParallelTerminationStrategy: PID 29424 died... 23:24:14.059298 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29424): Terminated: ok {rc=0} 23:24:14.146458 bus /sierra_3: Setting Powered False 23:24:15.246022 bus /sierra_3: Setting Powered False 23:24:16.365624 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 23:24:17.522050 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:24:17.533809 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 23:24:17.591620 tst mo_mt_call_osmux.py: using LAC 24387 23:24:17.709284 tst mo_mt_call_osmux.py: using RAC 162 23:24:17.827959 tst mo_mt_call_osmux.py: using CellId 24387 23:24:17.956034 tst mo_mt_call_osmux.py: using BVCI 24388 23:24:18.072840 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:24:18.084570 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:24:18.096158 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:24:18.108384 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:24:18.120077 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:24:18.131867 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:24:18.250471 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:24:18.366586 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:24:18.830528 run create_hlr_db(pid=29427): Launched 23:24:18.952497 bus /sierra_2: Setting Powered False 23:24:20.013242 run create_hlr_db(pid=29427): Terminated: ok {rc=0} 23:24:20.431562 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29429): Launched 23:24:20.730101 run osmo-hlr_10.42.42.2(pid=29430): Launched 23:24:20.843051 run osmo-stp_10.42.42.5: Starting osmo-stp 23:24:21.379543 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29432): Launched 23:24:21.676738 run osmo-stp_10.42.42.5(pid=29433): Launched 23:24:21.789719 run osmo-msc_10.42.42.6: Starting osmo-msc 23:24:22.330618 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29435): Launched 23:24:22.629019 run osmo-msc_10.42.42.6(pid=29436): Launched 23:24:22.795981 run osmo-stp_10.42.42.5(pid=29433): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29433)] 23:24:22.922390 run osmo-stp_10.42.42.5(pid=29433): stdout: | (launched: 2022-12-09_23:24:21.622444) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:24:23.048368 run osmo-stp_10.42.42.5(pid=29433): stderr: | 20221209232421791 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232421791 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232421792 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232421792 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232421794 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232421794 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232421794 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:24:23.173219 run osmo-stp_10.42.42.5(pid=29433): stdout: | (launched: 2022-12-09_23:24:21.622444) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:24:23.291978 run osmo-stp_10.42.42.5(pid=29433): stderr: | 20221209232421791 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232421791 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232421792 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232421792 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232421794 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232421794 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232421794 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:24:23.434521 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29433): Process ended prematurely: osmo-stp_10.42.42.5(pid=29433) [trial-2366↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29433)] [trial-2366↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 23:24:23.443419 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 23:24:23.470029 run osmo-hlr_10.42.42.2(pid=29430): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29430)] 23:24:23.517897 run osmo-hlr_10.42.42.2(pid=29430): stdout: | (launched: 2022-12-09_23:24:20.675819) 23:24:23.567242 run osmo-hlr_10.42.42.2(pid=29430): stderr: | 20221209232420852 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209232420852 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209232420852 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209232420852 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209232420852 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209232420852 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209232420864 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209232420875 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209232420875 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209232420875 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:24:23.636883 run osmo-msc_10.42.42.6(pid=29436): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29436)] 23:24:23.684730 run osmo-msc_10.42.42.6(pid=29436): stdout: | (launched: 2022-12-09_23:24:22.574735) 23:24:23.734093 run osmo-msc_10.42.42.6(pid=29436): stderr: | 20221209232422850 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209232422850 DLGLOBAL DEBUG validating counter group 0x7f57ec510c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209232422850 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209232422850 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209232422850 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209232422851 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209232422852 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209232422853 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209232422853 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209232422853 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:24:23.783850 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29429): Terminating (SIGTERM) 23:24:23.823979 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29432): Terminating (SIGTERM) 23:24:23.864040 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29435): Terminating (SIGTERM) 23:24:23.904160 --- ParallelTerminationStrategy: PID 29429 died... 23:24:23.923503 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29429): Terminated: ok {rc=0} 23:24:23.967880 --- ParallelTerminationStrategy: PID 29432 died... 23:24:23.986772 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29432): Terminated: ok {rc=0} 23:24:24.031175 --- ParallelTerminationStrategy: PID 29435 died... 23:24:24.049952 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29435): Terminated: ok {rc=0} 23:24:24.135644 bus /sierra_3: Setting Powered False 23:24:25.233782 bus /sierra_3: Setting Powered False 23:24:26.348095 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 voice:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 23:24:27.581712 tst voice:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:24:27.587938 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 23:24:27.609675 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 23:24:27.637970 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 23:24:27.690920 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 23:24:27.711963 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 23:24:27.740020 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 23:24:28.287843 tst voice:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 23:24:28.336888 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:24:28.347898 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:24:28.405193 tst mo_mt_call.py: using LAC 24388 23:24:28.522643 tst mo_mt_call.py: using RAC 163 23:24:28.641934 tst mo_mt_call.py: using CellId 24388 23:24:28.760862 tst mo_mt_call.py: using BVCI 24389 23:24:28.868925 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:24:28.880011 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:24:28.890807 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:24:28.901762 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:24:28.912589 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:24:28.923597 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:24:29.041871 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:24:29.158041 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:24:29.621189 run create_hlr_db(pid=29441): Launched 23:24:29.742359 bus /sierra_2: Setting Powered False 23:24:30.801912 run create_hlr_db(pid=29441): Terminated: ok {rc=0} 23:24:31.260616 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29443): Launched 23:24:31.641712 run osmo-hlr_10.42.42.2(pid=29444): Launched 23:24:31.987814 run osmo-stp_10.42.42.5: Starting osmo-stp 23:24:32.579127 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29446): Launched 23:24:32.900028 run osmo-stp_10.42.42.5(pid=29447): Launched 23:24:33.022895 run osmo-msc_10.42.42.6: Starting osmo-msc 23:24:33.602686 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29449): Launched 23:24:33.922972 run osmo-msc_10.42.42.6(pid=29450): Launched 23:24:34.101239 run osmo-stp_10.42.42.5(pid=29447): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29447)] 23:24:34.237232 run osmo-stp_10.42.42.5(pid=29447): stdout: | (launched: 2022-12-09_23:24:32.842268) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:24:34.373532 run osmo-stp_10.42.42.5(pid=29447): stderr: | 20221209232433034 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232433034 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232433034 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232433035 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232433035 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232433035 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232433035 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:24:34.509072 run osmo-stp_10.42.42.5(pid=29447): stdout: | (launched: 2022-12-09_23:24:32.842268) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:24:34.637234 run osmo-stp_10.42.42.5(pid=29447): stderr: | 20221209232433034 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232433034 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232433034 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232433035 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232433035 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232433035 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232433035 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:24:34.790339 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29447): Process ended prematurely: osmo-stp_10.42.42.5(pid=29447) [trial-2366↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29447)] [trial-2366↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 23:24:34.799966 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 23:24:34.828538 run osmo-hlr_10.42.42.2(pid=29444): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29444)] 23:24:34.879003 run osmo-hlr_10.42.42.2(pid=29444): stdout: | (launched: 2022-12-09_23:24:31.579303) 23:24:34.931208 run osmo-hlr_10.42.42.2(pid=29444): stderr: | 20221209232431802 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209232431802 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209232431802 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209232431802 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209232431802 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209232431802 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209232431823 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209232431832 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209232431832 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209232431832 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:24:35.003980 run osmo-msc_10.42.42.6(pid=29450): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29450)] 23:24:35.054414 run osmo-msc_10.42.42.6(pid=29450): stdout: | (launched: 2022-12-09_23:24:33.864635) 23:24:35.106591 run osmo-msc_10.42.42.6(pid=29450): stderr: | 20221209232434187 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209232434187 DLGLOBAL DEBUG validating counter group 0x7f10af902c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209232434187 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209232434187 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209232434187 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209232434188 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209232434189 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209232434190 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209232434190 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209232434190 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:24:35.158814 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29443): Terminating (SIGTERM) 23:24:35.200758 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29446): Terminating (SIGTERM) 23:24:35.243330 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29449): Terminating (SIGTERM) 23:24:35.285886 --- ParallelTerminationStrategy: PID 29443 died... 23:24:35.306042 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29443): Terminated: ok {rc=0} 23:24:35.353274 --- ParallelTerminationStrategy: PID 29446 died... 23:24:35.373023 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29446): Terminated: ok {rc=0} 23:24:35.419389 --- ParallelTerminationStrategy: PID 29449 died... 23:24:35.439130 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29449): Terminated: ok {rc=0} 23:24:35.526976 bus /sierra_3: Setting Powered False 23:24:36.626110 bus /sierra_3: Setting Powered False 23:24:37.742979 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 23:24:38.891709 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:24:38.903618 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:24:38.965243 tst mo_mt_call_osmux.py: using LAC 24389 23:24:39.090755 tst mo_mt_call_osmux.py: using RAC 164 23:24:39.214688 tst mo_mt_call_osmux.py: using CellId 24389 23:24:39.339438 tst mo_mt_call_osmux.py: using BVCI 24390 23:24:39.449435 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:24:39.460412 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:24:39.471208 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:24:39.481915 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:24:39.492626 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:24:39.503459 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:24:39.618101 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:24:39.737434 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:24:40.235457 run create_hlr_db(pid=29452): Launched 23:24:40.358385 bus /sierra_2: Setting Powered False 23:24:41.422384 run create_hlr_db(pid=29452): Terminated: ok {rc=0} 23:24:41.869462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29454): Launched 23:24:42.191636 run osmo-hlr_10.42.42.2(pid=29455): Launched 23:24:42.314513 run osmo-stp_10.42.42.5: Starting osmo-stp 23:24:42.868204 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29457): Launched 23:24:43.187713 run osmo-stp_10.42.42.5(pid=29458): Launched 23:24:43.310489 run osmo-msc_10.42.42.6: Starting osmo-msc 23:24:43.893108 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29460): Launched 23:24:44.213316 run osmo-msc_10.42.42.6(pid=29461): Launched 23:24:44.392840 run osmo-stp_10.42.42.5(pid=29458): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29458)] 23:24:44.527957 run osmo-stp_10.42.42.5(pid=29458): stdout: | (launched: 2022-12-09_23:24:43.129801) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:24:44.663659 run osmo-stp_10.42.42.5(pid=29458): stderr: | 20221209232443322 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232443322 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232443322 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232443323 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232443323 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232443323 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232443323 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:24:44.798534 run osmo-stp_10.42.42.5(pid=29458): stdout: | (launched: 2022-12-09_23:24:43.129801) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:24:44.926888 run osmo-stp_10.42.42.5(pid=29458): stderr: | 20221209232443322 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232443322 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232443322 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232443323 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232443323 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232443323 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232443323 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:24:45.080183 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29458): Process ended prematurely: osmo-stp_10.42.42.5(pid=29458) [trial-2366↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29458)] [trial-2366↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 23:24:45.089996 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 23:24:45.118842 run osmo-hlr_10.42.42.2(pid=29455): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29455)] 23:24:45.169351 run osmo-hlr_10.42.42.2(pid=29455): stdout: | (launched: 2022-12-09_23:24:42.133545) 23:24:45.221890 run osmo-hlr_10.42.42.2(pid=29455): stderr: | 20221209232442331 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209232442331 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209232442331 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209232442331 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209232442331 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209232442331 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209232442347 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209232442357 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209232442357 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209232442357 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:24:45.294694 run osmo-msc_10.42.42.6(pid=29461): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29461)] 23:24:45.345145 run osmo-msc_10.42.42.6(pid=29461): stdout: | (launched: 2022-12-09_23:24:44.155256) 23:24:45.396726 run osmo-msc_10.42.42.6(pid=29461): stderr: | 20221209232444478 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209232444478 DLGLOBAL DEBUG validating counter group 0x7f732e6e4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209232444478 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209232444478 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209232444478 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209232444479 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209232444480 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209232444481 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209232444481 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209232444481 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:24:45.449044 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29454): Terminating (SIGTERM) 23:24:45.490913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29457): Terminating (SIGTERM) 23:24:45.532890 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29460): Terminating (SIGTERM) 23:24:45.575221 --- ParallelTerminationStrategy: PID 29454 died... 23:24:45.595199 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29454): Terminated: ok {rc=0} 23:24:45.642069 --- ParallelTerminationStrategy: PID 29457 died... 23:24:45.661730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29457): Terminated: ok {rc=0} 23:24:45.708474 --- ParallelTerminationStrategy: PID 29460 died... 23:24:45.728089 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29460): Terminated: ok {rc=0} 23:24:45.815760 bus /sierra_3: Setting Powered False 23:24:46.914397 bus /sierra_3: Setting Powered False 23:24:48.028899 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 voice:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 emergency:oc2g --------------------------------------------------------------------- 23:24:49.259725 tst emergency:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:24:49.263788 tst emergency:oc2g: Verifying 1 x bts (candidates: 11) 23:24:49.283854 tst emergency:oc2g: Verifying 6 x ip_address (candidates: 9) 23:24:49.310497 tst emergency:oc2g: Verifying 4 x modem (candidates: 12) 23:24:49.393763 tst emergency:oc2g: Reserving 1 x bts (candidates: 11) 23:24:49.414111 tst emergency:oc2g: Reserving 6 x ip_address (candidates: 9) 23:24:49.440593 tst emergency:oc2g: Reserving 4 x modem (candidates: 12) 23:24:50.022952 tst emergency:oc2g: RESERVED RESOURCES for emergency: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2366 emergency:oc2g emergency_mo_mt_call.py ---------------------------------------------- 23:24:50.028471 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 23:24:50.039090 tst emergency:oc2g: Using 1 x bts (candidates: 1) 23:24:50.077773 tst emergency_mo_mt_call.py: using LAC 24390 23:24:50.193383 tst emergency_mo_mt_call.py: using RAC 165 23:24:50.309558 tst emergency_mo_mt_call.py: using CellId 24390 23:24:50.435451 tst emergency_mo_mt_call.py: using BVCI 24391 23:24:50.551374 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 23:24:50.562672 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 23:24:50.573731 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 23:24:50.585519 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 23:24:50.597349 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 23:24:50.609308 tst emergency:oc2g: Using 1 x modem (candidates: 4) 23:24:50.726354 tst emergency:oc2g: Using 1 x modem (candidates: 4) 23:24:50.844780 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:24:51.335063 run create_hlr_db(pid=29466): Launched 23:24:51.456045 bus /sierra_2: Setting Powered False 23:24:52.519414 run create_hlr_db(pid=29466): Terminated: ok {rc=0} 23:24:52.939481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29468): Launched 23:24:53.231722 run osmo-hlr_10.42.42.2(pid=29469): Launched 23:24:53.343913 run osmo-stp_10.42.42.5: Starting osmo-stp 23:24:53.846733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29471): Launched 23:24:54.138983 run osmo-stp_10.42.42.5(pid=29472): Launched 23:24:54.261372 tst emergency_mo_mt_call.py: using MSISDN 7434 23:24:54.411450 run osmo-msc_10.42.42.6: Starting osmo-msc 23:24:54.937476 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29474): Launched 23:24:55.231662 run osmo-msc_10.42.42.6(pid=29475): Launched 23:24:55.396138 run osmo-stp_10.42.42.5(pid=29472): ERR: Terminated: ERROR {rc=1} [trial-2366↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29472)] 23:24:55.527368 run osmo-stp_10.42.42.5(pid=29472): stdout: | (launched: 2022-12-09_23:24:54.085616) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:24:55.664162 run osmo-stp_10.42.42.5(pid=29472): stderr: | 20221209232454256 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232454256 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232454256 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232454257 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232454257 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232454258 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232454258 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:24:55.797262 run osmo-stp_10.42.42.5(pid=29472): stdout: | (launched: 2022-12-09_23:24:54.085616) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:24:55.924280 run osmo-stp_10.42.42.5(pid=29472): stderr: | 20221209232454256 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232454256 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232454256 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232454257 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232454257 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232454258 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232454258 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:24:56.076134 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=29472): Process ended prematurely: osmo-stp_10.42.42.5(pid=29472) [trial-2366↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29472)] [trial-2366↪emergency:oc2g↪emergency_mo_mt_call.py:19] 23:24:56.085319 tst emergency_mo_mt_call.py:19: Test FAILED (6.0 sec) 23:24:56.113648 run osmo-hlr_10.42.42.2(pid=29469): ERR: Terminated: ERROR {rc=237} [trial-2366↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29469)] 23:24:56.164077 run osmo-hlr_10.42.42.2(pid=29469): stdout: | (launched: 2022-12-09_23:24:53.178426) 23:24:56.215999 run osmo-hlr_10.42.42.2(pid=29469): stderr: | 20221209232453351 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209232453351 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209232453351 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209232453351 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209232453351 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209232453351 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209232453363 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/emergency:oc2g/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209232453372 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209232453373 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209232453373 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:24:56.288694 run osmo-msc_10.42.42.6(pid=29475): ERR: Terminated: ERROR {rc=2} [trial-2366↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29475)] 23:24:56.339057 run osmo-msc_10.42.42.6(pid=29475): stdout: | (launched: 2022-12-09_23:24:55.177408) 23:24:56.391057 run osmo-msc_10.42.42.6(pid=29475): stderr: | 20221209232455449 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209232455449 DLGLOBAL DEBUG validating counter group 0x7f60d7f3ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209232455450 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209232455450 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209232455450 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209232455450 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209232455452 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209232455452 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209232455453 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209232455453 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:24:56.443577 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29468): Terminating (SIGTERM) 23:24:56.485801 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29471): Terminating (SIGTERM) 23:24:56.528170 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29474): Terminating (SIGTERM) 23:24:56.570716 --- ParallelTerminationStrategy: PID 29468 died... 23:24:56.590898 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29468): Terminated: ok {rc=0} 23:24:56.637645 --- ParallelTerminationStrategy: PID 29471 died... 23:24:56.657446 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29471): Terminated: ok {rc=0} 23:24:56.703856 --- ParallelTerminationStrategy: PID 29474 died... 23:24:56.723508 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29474): Terminated: ok {rc=0} 23:24:56.810738 bus /sierra_3: Setting Powered False 23:24:57.909538 bus /sierra_3: Setting Powered False 23:24:59.024496 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 emergency:oc2g emergency_preemptive_call.py ---------------------------------------------- 23:25:00.109847 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 23:25:00.121690 tst emergency:oc2g: Using 1 x bts (candidates: 1) 23:25:00.161076 tst emergency_preemptive_call.py: using LAC 24391 23:25:00.288159 tst emergency_preemptive_call.py: using RAC 166 23:25:00.412761 tst emergency_preemptive_call.py: using CellId 24391 23:25:00.536514 tst emergency_preemptive_call.py: using BVCI 24392 23:25:00.651793 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 23:25:00.662948 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 23:25:00.673842 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 23:25:00.684570 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 23:25:00.695755 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 23:25:00.706709 tst emergency:oc2g: Using 1 x modem (candidates: 4) 23:25:00.823610 tst emergency:oc2g: Using 1 x modem (candidates: 4) 23:25:00.962238 tst emergency:oc2g: Using 1 x modem (candidates: 4) 23:25:01.088622 tst emergency:oc2g: Using 1 x modem (candidates: 4) 23:25:01.204866 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:25:01.722020 run create_hlr_db(pid=29480): Launched 23:25:01.877358 bus /sierra_2: Setting Powered False 23:25:02.940852 run create_hlr_db(pid=29480): Terminated: ok {rc=0} 23:25:03.363098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29482): Launched 23:25:03.656220 run osmo-hlr_10.42.42.2(pid=29483): Launched 23:25:03.769644 run osmo-stp_10.42.42.5: Starting osmo-stp 23:25:04.273831 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29485): Launched 23:25:04.564521 run osmo-stp_10.42.42.5(pid=29486): Launched 23:25:04.686712 tst emergency_preemptive_call.py: using MSISDN 7435 23:25:04.843472 run osmo-msc_10.42.42.6: Starting osmo-msc 23:25:05.367074 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29488): Launched 23:25:05.657984 run osmo-msc_10.42.42.6(pid=29489): Launched 23:25:05.822704 run osmo-stp_10.42.42.5(pid=29486): ERR: Terminated: ERROR {rc=1} [trial-2366↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29486)] 23:25:05.946211 run osmo-stp_10.42.42.5(pid=29486): stdout: | (launched: 2022-12-09_23:25:04.511297) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:25:06.070826 run osmo-stp_10.42.42.5(pid=29486): stderr: | 20221209232504678 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232504679 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232504680 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232504681 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232504681 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232504681 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232504681 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:25:06.193445 run osmo-stp_10.42.42.5(pid=29486): stdout: | (launched: 2022-12-09_23:25:04.511297) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:25:06.310239 run osmo-stp_10.42.42.5(pid=29486): stderr: | 20221209232504678 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232504679 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232504680 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232504681 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232504681 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232504681 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232504681 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:25:06.449302 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=29486): Process ended prematurely: osmo-stp_10.42.42.5(pid=29486) [trial-2366↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29486)] [trial-2366↪emergency:oc2g↪emergency_preemptive_call.py:32] 23:25:06.457568 tst emergency_preemptive_call.py:32: Test FAILED (6.3 sec) 23:25:06.483594 run osmo-hlr_10.42.42.2(pid=29483): ERR: Terminated: ERROR {rc=237} [trial-2366↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29483)] 23:25:06.530474 run osmo-hlr_10.42.42.2(pid=29483): stdout: | (launched: 2022-12-09_23:25:03.602602) 23:25:06.579151 run osmo-hlr_10.42.42.2(pid=29483): stderr: | 20221209232503778 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209232503778 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209232503778 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209232503778 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209232503778 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209232503778 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209232503790 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/emergency:oc2g/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209232503800 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209232503800 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209232503800 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:25:06.647450 run osmo-msc_10.42.42.6(pid=29489): ERR: Terminated: ERROR {rc=2} [trial-2366↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29489)] 23:25:06.694477 run osmo-msc_10.42.42.6(pid=29489): stdout: | (launched: 2022-12-09_23:25:05.604288) 23:25:06.744773 run osmo-msc_10.42.42.6(pid=29489): stderr: | 20221209232505875 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209232505876 DLGLOBAL DEBUG validating counter group 0x7fc61badfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209232505876 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209232505876 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209232505876 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209232505876 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209232505878 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209232505879 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209232505879 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209232505879 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:25:06.793755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29482): Terminating (SIGTERM) 23:25:06.832533 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29485): Terminating (SIGTERM) 23:25:06.871117 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29488): Terminating (SIGTERM) 23:25:06.910351 --- ParallelTerminationStrategy: PID 29482 died... 23:25:06.929120 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29482): Terminated: ok {rc=0} 23:25:06.973091 --- ParallelTerminationStrategy: PID 29485 died... 23:25:06.991716 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29485): Terminated: ok {rc=0} 23:25:07.035103 --- ParallelTerminationStrategy: PID 29488 died... 23:25:07.053979 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29488): Terminated: ok {rc=0} 23:25:07.139780 bus /sierra_9: Setting Powered False 23:25:08.239934 bus /sierra_9: Setting Powered False 23:25:09.356258 bus /sierra_8: Setting Powered False 23:25:10.455629 bus /sierra_8: Setting Powered False 23:25:11.570137 bus /sierra_3: Setting Powered False 23:25:12.667879 bus /sierra_3: Setting Powered False 23:25:13.784240 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 emergency:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 gprs:oc2g --------------------------------------------------------------------- 23:25:15.040260 tst gprs:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:25:15.044375 tst gprs:oc2g: Verifying 1 x bts (candidates: 11) 23:25:15.064578 tst gprs:oc2g: Verifying 9 x ip_address (candidates: 9) 23:25:15.102922 tst gprs:oc2g: Verifying 4 x modem (candidates: 12) 23:25:15.188362 tst gprs:oc2g: Reserving 1 x bts (candidates: 11) 23:25:15.208851 tst gprs:oc2g: Reserving 9 x ip_address (candidates: 9) 23:25:15.247264 tst gprs:oc2g: Reserving 4 x modem (candidates: 12) 23:25:15.842709 tst gprs:oc2g: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2366 gprs:oc2g cs_paging_gprs_active.py ---------------------------------------------- 23:25:15.904617 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:15.916811 tst gprs:oc2g: Using 1 x bts (candidates: 1) 23:25:15.955347 tst cs_paging_gprs_active.py: using LAC 24392 23:25:16.085543 tst cs_paging_gprs_active.py: using RAC 167 23:25:16.203665 tst cs_paging_gprs_active.py: using CellId 24392 23:25:16.364169 tst cs_paging_gprs_active.py: using BVCI 24393 23:25:16.487780 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:16.499838 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:16.511835 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:16.524668 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:16.538193 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:16.550954 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:16.562860 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:16.575441 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:16.589941 tst gprs:oc2g: Using 1 x modem (candidates: 4) 23:25:16.711186 tst gprs:oc2g: Using 1 x modem (candidates: 4) 23:25:16.862627 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:25:17.095686 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:25:17.402841 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29494): Launched 23:25:17.665733 run iperf3-srv_10.42.42.10(pid=29495): Launched 23:25:17.787069 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:25:18.004857 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:25:18.311021 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29496): Launched 23:25:18.570607 run iperf3-srv_10.42.42.10(pid=29497): Launched 23:25:18.681863 tst cs_paging_gprs_active.py:38: start network... 23:25:18.881682 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:25:19.342075 run create_hlr_db(pid=29498): Launched 23:25:19.463161 bus /sierra_2: Setting Powered False 23:25:20.523729 run create_hlr_db(pid=29498): Terminated: ok {rc=0} 23:25:20.959945 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29500): Launched 23:25:21.281460 run osmo-hlr_10.42.42.2(pid=29501): Launched 23:25:21.404671 run osmo-stp_10.42.42.5: Starting osmo-stp 23:25:21.957321 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29503): Launched 23:25:22.277177 run osmo-stp_10.42.42.5(pid=29504): Launched 23:25:22.399447 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:25:22.951053 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29506): Launched 23:25:23.073839 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:25:23.345420 run patchelf(pid=29507): Launched 23:25:23.524646 run osmo-stp_10.42.42.5(pid=29504): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29504)] 23:25:23.660739 run osmo-stp_10.42.42.5(pid=29504): stdout: | (launched: 2022-12-09_23:25:22.218827) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:25:23.799133 run osmo-stp_10.42.42.5(pid=29504): stderr: | 20221209232522411 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232522411 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232522411 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232522411 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232522412 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232522412 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232522412 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:25:23.937856 run osmo-stp_10.42.42.5(pid=29504): stdout: | (launched: 2022-12-09_23:25:22.218827) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:25:24.069761 run osmo-stp_10.42.42.5(pid=29504): stderr: | 20221209232522411 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232522411 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232522411 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232522411 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232522412 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232522412 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232522412 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:25:24.226556 run patchelf(pid=29507): Terminating (SIGINT) 23:25:24.409571 run patchelf(pid=29507): Terminated: ok {rc=0} 23:25:24.540545 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29504): Process ended prematurely: osmo-stp_10.42.42.5(pid=29504) [trial-2366↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29504)] [trial-2366↪gprs:oc2g↪cs_paging_gprs_active.py:38] 23:25:24.550551 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 23:25:24.579520 run osmo-hlr_10.42.42.2(pid=29501): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:oc2g↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29501)] 23:25:24.629600 run osmo-hlr_10.42.42.2(pid=29501): stdout: | (launched: 2022-12-09_23:25:21.223097) 23:25:24.681344 run osmo-hlr_10.42.42.2(pid=29501): stderr: | 20221209232521421 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209232521421 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209232521421 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209232521421 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209232521421 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209232521421 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209232521432 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:oc2g/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209232521441 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209232521441 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209232521441 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:25:24.733621 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29494): Terminating (SIGTERM) 23:25:24.775384 run iperf3-srv_10.42.42.10(pid=29495): Terminating (SIGTERM) 23:25:24.817072 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29496): Terminating (SIGTERM) 23:25:24.858757 run iperf3-srv_10.42.42.10(pid=29497): Terminating (SIGTERM) 23:25:24.900401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29500): Terminating (SIGTERM) 23:25:24.942513 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29503): Terminating (SIGTERM) 23:25:24.984373 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29506): Terminating (SIGTERM) 23:25:25.026516 --- ParallelTerminationStrategy: PID 29494 died... 23:25:25.046510 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29494): Terminated: ok {rc=0} 23:25:25.093142 --- ParallelTerminationStrategy: PID 29495 died... 23:25:25.112652 run iperf3-srv_10.42.42.10(pid=29495): Terminated {rc=256} 23:25:25.158599 --- ParallelTerminationStrategy: PID 29496 died... 23:25:25.177822 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29496): Terminated: ok {rc=0} 23:25:25.223784 --- ParallelTerminationStrategy: PID 29497 died... 23:25:25.243238 run iperf3-srv_10.42.42.10(pid=29497): Terminated {rc=256} 23:25:25.289165 --- ParallelTerminationStrategy: PID 29500 died... 23:25:25.308681 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29500): Terminated: ok {rc=0} 23:25:25.354949 --- ParallelTerminationStrategy: PID 29503 died... 23:25:25.374517 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29503): Terminated: ok {rc=0} 23:25:25.420684 --- ParallelTerminationStrategy: PID 29506 died... 23:25:25.440032 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29506): Terminated: ok {rc=0} 23:25:25.527011 bus /gobi_0: Setting Powered False 23:25:26.623833 bus /gobi_0: Setting Powered False 23:25:27.739062 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:oc2g iperf3.py ---------------------------------------------- 23:25:28.880785 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:28.891662 tst gprs:oc2g: Using 1 x bts (candidates: 1) 23:25:28.931113 tst iperf3.py: using LAC 24393 23:25:29.056358 tst iperf3.py: using RAC 168 23:25:29.182070 tst iperf3.py: using CellId 24393 23:25:29.305889 tst iperf3.py: using BVCI 24394 23:25:29.422900 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:29.434007 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:29.444868 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:29.456048 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:29.467043 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:29.478033 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:29.489238 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:29.500609 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:29.511756 tst gprs:oc2g: Using 1 x modem (candidates: 4) 23:25:29.630576 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:25:29.833248 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:25:30.132534 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29508): Launched 23:25:30.393676 run iperf3-srv_10.42.42.10(pid=29509): Launched 23:25:30.505469 tst iperf3.py:8: start network... 23:25:30.706533 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:25:31.191196 run create_hlr_db(pid=29510): Launched 23:25:31.359004 bus /gobi_6: Setting Powered False 23:25:32.419146 run create_hlr_db(pid=29510): Terminated: ok {rc=0} 23:25:32.864345 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29512): Launched 23:25:33.184695 run osmo-hlr_10.42.42.2(pid=29513): Launched 23:25:33.308053 run osmo-stp_10.42.42.5: Starting osmo-stp 23:25:33.865356 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29515): Launched 23:25:34.186260 run osmo-stp_10.42.42.5(pid=29516): Launched 23:25:34.309126 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:25:34.863831 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29518): Launched 23:25:34.987305 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:25:35.259622 run patchelf(pid=29519): Launched 23:25:35.438990 run osmo-stp_10.42.42.5(pid=29516): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29516)] 23:25:35.575254 run osmo-stp_10.42.42.5(pid=29516): stdout: | (launched: 2022-12-09_23:25:34.128189) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:25:35.713591 run osmo-stp_10.42.42.5(pid=29516): stderr: | 20221209232534321 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232534321 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232534322 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232534322 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232534322 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232534322 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232534323 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:25:35.852058 run osmo-stp_10.42.42.5(pid=29516): stdout: | (launched: 2022-12-09_23:25:34.128189) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:25:35.984160 run osmo-stp_10.42.42.5(pid=29516): stderr: | 20221209232534321 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232534321 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232534322 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232534322 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232534322 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232534322 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232534323 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:25:36.141019 run patchelf(pid=29519): Terminating (SIGINT) 23:25:36.322276 run patchelf(pid=29519): Terminated: ok {rc=0} 23:25:36.452923 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29516): Process ended prematurely: osmo-stp_10.42.42.5(pid=29516) [trial-2366↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29516)] [trial-2366↪gprs:oc2g↪iperf3.py:8] 23:25:36.463105 tst iperf3.py:8: Test FAILED (7.6 sec) 23:25:36.492039 run osmo-hlr_10.42.42.2(pid=29513): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:oc2g↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29513)] 23:25:36.541781 run osmo-hlr_10.42.42.2(pid=29513): stdout: | (launched: 2022-12-09_23:25:33.126858) 23:25:36.593322 run osmo-hlr_10.42.42.2(pid=29513): stderr: | 20221209232533326 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209232533326 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209232533326 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209232533326 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209232533326 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209232533326 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209232533336 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:oc2g/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209232533345 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209232533345 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209232533345 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:25:36.645466 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29508): Terminating (SIGTERM) 23:25:36.686875 run iperf3-srv_10.42.42.10(pid=29509): Terminating (SIGTERM) 23:25:36.728420 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29512): Terminating (SIGTERM) 23:25:36.769942 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29515): Terminating (SIGTERM) 23:25:36.811628 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29518): Terminating (SIGTERM) 23:25:36.853513 --- ParallelTerminationStrategy: PID 29508 died... 23:25:36.873423 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29508): Terminated: ok {rc=0} 23:25:36.920001 --- ParallelTerminationStrategy: PID 29509 died... 23:25:36.939527 run iperf3-srv_10.42.42.10(pid=29509): Terminated {rc=256} 23:25:36.985952 --- ParallelTerminationStrategy: PID 29512 died... 23:25:37.005497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29512): Terminated: ok {rc=0} 23:25:37.051675 --- ParallelTerminationStrategy: PID 29515 died... 23:25:37.071263 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29515): Terminated: ok {rc=0} 23:25:37.117478 --- ParallelTerminationStrategy: PID 29518 died... 23:25:37.136942 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29518): Terminated: ok {rc=0} 23:25:37.224066 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:oc2g iperf3m4.py ---------------------------------------------- 23:25:38.369722 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:38.380550 tst gprs:oc2g: Using 1 x bts (candidates: 1) 23:25:38.416612 tst iperf3m4.py: using LAC 24394 23:25:38.542683 tst iperf3m4.py: using RAC 169 23:25:38.669722 tst iperf3m4.py: using CellId 24394 23:25:38.787148 tst iperf3m4.py: using BVCI 24395 23:25:38.896816 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:38.907328 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:38.917666 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:38.928475 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:38.939244 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:38.949894 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:38.960565 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:38.971367 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:38.982220 tst gprs:oc2g: Using 1 x modem (candidates: 4) 23:25:39.095362 tst gprs:oc2g: Using 1 x modem (candidates: 4) 23:25:39.214553 tst gprs:oc2g: Using 1 x modem (candidates: 4) 23:25:39.332039 tst gprs:oc2g: Using 1 x modem (candidates: 4) 23:25:39.449904 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:25:39.667603 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:25:39.991063 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29520): Launched 23:25:40.270333 run iperf3-srv_10.42.42.10(pid=29521): Launched 23:25:40.390423 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:25:40.607537 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:25:40.928910 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29522): Launched 23:25:41.206716 run iperf3-srv_10.42.42.10(pid=29523): Launched 23:25:41.326817 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:25:41.542972 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:25:41.864480 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29524): Launched 23:25:42.143070 run iperf3-srv_10.42.42.10(pid=29525): Launched 23:25:42.263053 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:25:42.478771 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:25:42.800540 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29526): Launched 23:25:43.077911 run iperf3-srv_10.42.42.10(pid=29527): Launched 23:25:43.197570 tst iperf3m4.py:8: start network... 23:25:43.414088 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:25:43.913407 run create_hlr_db(pid=29528): Launched 23:25:44.036163 bus /gobi_6: Setting Powered False 23:25:45.100032 run create_hlr_db(pid=29528): Terminated: ok {rc=0} 23:25:45.527661 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29531): Launched 23:25:45.826083 run osmo-hlr_10.42.42.2(pid=29532): Launched 23:25:46.002537 run osmo-stp_10.42.42.5: Starting osmo-stp 23:25:46.754973 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29534): Launched 23:25:47.101889 run osmo-stp_10.42.42.5(pid=29535): Launched 23:25:47.272720 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:25:47.831765 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29537): Launched 23:25:47.954238 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:25:48.225192 run patchelf(pid=29538): Launched 23:25:48.403442 run osmo-stp_10.42.42.5(pid=29535): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29535)] 23:25:48.539434 run osmo-stp_10.42.42.5(pid=29535): stdout: | (launched: 2022-12-09_23:25:47.035343) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:25:48.677221 run osmo-stp_10.42.42.5(pid=29535): stderr: | 20221209232547325 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232547325 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232547325 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232547326 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232547328 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232547328 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232547328 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:25:48.815652 run osmo-stp_10.42.42.5(pid=29535): stdout: | (launched: 2022-12-09_23:25:47.035343) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:25:48.946955 run osmo-stp_10.42.42.5(pid=29535): stderr: | 20221209232547325 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232547325 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232547325 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232547326 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232547328 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232547328 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232547328 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:25:49.103409 run patchelf(pid=29538): Terminating (SIGINT) 23:25:49.283849 run patchelf(pid=29538): Terminated: ok {rc=0} 23:25:49.414193 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29535): Process ended prematurely: osmo-stp_10.42.42.5(pid=29535) [trial-2366↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29535)] [trial-2366↪gprs:oc2g↪iperf3m4.py:8] 23:25:49.424186 tst iperf3m4.py:8: Test FAILED (11.1 sec) 23:25:49.453647 run osmo-hlr_10.42.42.2(pid=29532): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:oc2g↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29532)] 23:25:49.504082 run osmo-hlr_10.42.42.2(pid=29532): stdout: | (launched: 2022-12-09_23:25:45.771788) 23:25:49.556383 run osmo-hlr_10.42.42.2(pid=29532): stderr: | 20221209232546136 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209232546136 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209232546136 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209232546136 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209232546136 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209232546137 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209232546161 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:oc2g/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209232546179 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209232546179 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209232546179 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:25:49.609211 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29520): Terminating (SIGTERM) 23:25:49.651445 run iperf3-srv_10.42.42.10(pid=29521): Terminating (SIGTERM) 23:25:49.693545 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29522): Terminating (SIGTERM) 23:25:49.735768 run iperf3-srv_10.42.42.10(pid=29523): Terminating (SIGTERM) 23:25:49.777850 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29524): Terminating (SIGTERM) 23:25:49.819985 run iperf3-srv_10.42.42.10(pid=29525): Terminating (SIGTERM) 23:25:49.861909 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29526): Terminating (SIGTERM) 23:25:49.904029 run iperf3-srv_10.42.42.10(pid=29527): Terminating (SIGTERM) 23:25:49.946068 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29531): Terminating (SIGTERM) 23:25:49.988231 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29534): Terminating (SIGTERM) 23:25:50.030500 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29537): Terminating (SIGTERM) 23:25:50.073066 --- ParallelTerminationStrategy: PID 29520 died... 23:25:50.092810 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29520): Terminated: ok {rc=0} 23:25:50.140230 --- ParallelTerminationStrategy: PID 29521 died... 23:25:50.160049 run iperf3-srv_10.42.42.10(pid=29521): Terminated {rc=256} 23:25:50.206725 --- ParallelTerminationStrategy: PID 29522 died... 23:25:50.226859 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29522): Terminated: ok {rc=0} 23:25:50.274102 --- ParallelTerminationStrategy: PID 29523 died... 23:25:50.293863 run iperf3-srv_10.42.42.10(pid=29523): Terminated {rc=256} 23:25:50.340729 --- ParallelTerminationStrategy: PID 29524 died... 23:25:50.360493 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29524): Terminated: ok {rc=0} 23:25:50.407470 --- ParallelTerminationStrategy: PID 29525 died... 23:25:50.427236 run iperf3-srv_10.42.42.10(pid=29525): Terminated {rc=256} 23:25:50.474221 --- ParallelTerminationStrategy: PID 29526 died... 23:25:50.493870 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29526): Terminated: ok {rc=0} 23:25:50.541116 --- ParallelTerminationStrategy: PID 29527 died... 23:25:50.560885 run iperf3-srv_10.42.42.10(pid=29527): Terminated {rc=256} 23:25:50.607961 --- ParallelTerminationStrategy: PID 29531 died... 23:25:50.627825 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29531): Terminated: ok {rc=0} 23:25:50.674761 --- ParallelTerminationStrategy: PID 29534 died... 23:25:50.694677 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29534): Terminated: ok {rc=0} 23:25:50.741769 --- ParallelTerminationStrategy: PID 29537 died... 23:25:50.761524 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29537): Terminated: ok {rc=0} 23:25:50.849672 bus /gobi_4: Setting Powered False 23:25:51.949173 bus /gobi_4: Setting Powered False 23:25:53.065249 bus /gobi_1: Setting Powered False 23:25:54.163254 bus /gobi_1: Setting Powered False 23:25:55.282351 bus /gobi_0: Setting Powered False 23:25:56.381925 bus /gobi_0: Setting Powered False 23:25:57.498286 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:oc2g ping.py ---------------------------------------------- 23:25:58.601340 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:58.612277 tst gprs:oc2g: Using 1 x bts (candidates: 1) 23:25:58.646898 tst ping.py: using LAC 24395 23:25:58.772924 tst ping.py: using RAC 170 23:25:58.889642 tst ping.py: using CellId 24395 23:25:59.015714 tst ping.py: using BVCI 24396 23:25:59.123139 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:59.133888 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:59.144314 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:59.154789 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:59.165187 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:59.175598 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:59.186140 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:25:59.196351 tst gprs:oc2g: Using 1 x modem (candidates: 4) 23:25:59.310079 tst ping.py:19: start network... 23:25:59.506445 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:25:59.958816 run create_hlr_db(pid=29539): Launched 23:26:00.078325 bus /gobi_6: Setting Powered False 23:26:01.148410 run create_hlr_db(pid=29539): Terminated: ok {rc=0} 23:26:01.595921 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29541): Launched 23:26:01.919133 run osmo-hlr_10.42.42.2(pid=29542): Launched 23:26:02.081807 run osmo-stp_10.42.42.5: Starting osmo-stp 23:26:02.749904 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29544): Launched 23:26:03.065380 run osmo-stp_10.42.42.5(pid=29545): Launched 23:26:03.186911 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:26:03.734234 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29547): Launched 23:26:03.854209 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:26:04.120859 run patchelf(pid=29548): Launched 23:26:04.297067 run osmo-stp_10.42.42.5(pid=29545): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29545)] 23:26:04.430899 run osmo-stp_10.42.42.5(pid=29545): stdout: | (launched: 2022-12-09_23:26:03.007687) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:26:04.566790 run osmo-stp_10.42.42.5(pid=29545): stderr: | 20221209232603198 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232603198 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232603198 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232603199 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232603199 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232603199 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232603199 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:26:04.702819 run osmo-stp_10.42.42.5(pid=29545): stdout: | (launched: 2022-12-09_23:26:03.007687) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:26:04.832786 run osmo-stp_10.42.42.5(pid=29545): stderr: | 20221209232603198 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232603198 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232603198 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232603199 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232603199 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232603199 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232603199 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:26:04.986959 run patchelf(pid=29548): Terminating (SIGINT) 23:26:05.164369 run patchelf(pid=29548): Terminated: ok {rc=0} 23:26:05.292376 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29545): Process ended prematurely: osmo-stp_10.42.42.5(pid=29545) [trial-2366↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29545)] [trial-2366↪gprs:oc2g↪ping.py:22] 23:26:05.301998 tst ping.py:22: Test FAILED (6.7 sec) 23:26:05.331302 run osmo-hlr_10.42.42.2(pid=29542): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:oc2g↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29542)] 23:26:05.381979 run osmo-hlr_10.42.42.2(pid=29542): stdout: | (launched: 2022-12-09_23:26:01.854166) 23:26:05.434325 run osmo-hlr_10.42.42.2(pid=29542): stderr: | 20221209232602193 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209232602193 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209232602194 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209232602194 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209232602194 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209232602194 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209232602215 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:oc2g/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209232602240 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209232602240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209232602240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:26:05.486847 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29541): Terminating (SIGTERM) 23:26:05.529355 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29544): Terminating (SIGTERM) 23:26:05.571800 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29547): Terminating (SIGTERM) 23:26:05.614302 --- ParallelTerminationStrategy: PID 29541 died... 23:26:05.634519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29541): Terminated: ok {rc=0} 23:26:05.681741 --- ParallelTerminationStrategy: PID 29544 died... 23:26:05.701620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29544): Terminated: ok {rc=0} 23:26:05.748393 --- ParallelTerminationStrategy: PID 29547 died... 23:26:05.768143 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29547): Terminated: ok {rc=0} 23:26:05.855973 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:oc2g ping_idle_ping.py ---------------------------------------------- 23:26:06.943631 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:26:06.955590 tst gprs:oc2g: Using 1 x bts (candidates: 1) 23:26:06.993117 tst ping_idle_ping.py: using LAC 24396 23:26:07.120162 tst ping_idle_ping.py: using RAC 171 23:26:07.237396 tst ping_idle_ping.py: using CellId 24396 23:26:07.356660 tst ping_idle_ping.py: using BVCI 24397 23:26:07.464337 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:26:07.475095 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:26:07.485734 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:26:07.496316 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:26:07.506928 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:26:07.517539 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:26:07.528212 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 23:26:07.538723 tst gprs:oc2g: Using 1 x modem (candidates: 4) 23:26:07.656735 tst ping_idle_ping.py:24: start network... 23:26:07.870543 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:26:08.363487 run create_hlr_db(pid=29549): Launched 23:26:08.484918 bus /gobi_6: Setting Powered False 23:26:09.548130 run create_hlr_db(pid=29549): Terminated: ok {rc=0} 23:26:09.970568 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29551): Launched 23:26:10.266857 run osmo-hlr_10.42.42.2(pid=29552): Launched 23:26:10.380165 run osmo-stp_10.42.42.5: Starting osmo-stp 23:26:10.889375 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29554): Launched 23:26:11.183603 run osmo-stp_10.42.42.5(pid=29555): Launched 23:26:11.295318 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:26:11.804038 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29557): Launched 23:26:11.916168 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:26:12.164830 run patchelf(pid=29558): Launched 23:26:12.328307 run osmo-stp_10.42.42.5(pid=29555): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29555)] 23:26:12.452706 run osmo-stp_10.42.42.5(pid=29555): stdout: | (launched: 2022-12-09_23:26:11.129917) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:26:12.579019 run osmo-stp_10.42.42.5(pid=29555): stderr: | 20221209232611299 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232611299 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232611299 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232611300 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232611302 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232611302 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232611302 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:26:12.706035 run osmo-stp_10.42.42.5(pid=29555): stdout: | (launched: 2022-12-09_23:26:11.129917) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:26:12.827483 run osmo-stp_10.42.42.5(pid=29555): stderr: | 20221209232611299 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232611299 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232611299 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232611300 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232611302 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232611302 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232611302 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:26:12.970402 run patchelf(pid=29558): Terminating (SIGINT) 23:26:13.135616 run patchelf(pid=29558): Terminated: ok {rc=0} 23:26:13.254456 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29555): Process ended prematurely: osmo-stp_10.42.42.5(pid=29555) [trial-2366↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29555)] [trial-2366↪gprs:oc2g↪ping_idle_ping.py:27] 23:26:13.263264 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 23:26:13.292002 run osmo-hlr_10.42.42.2(pid=29552): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:oc2g↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29552)] 23:26:13.344701 run osmo-hlr_10.42.42.2(pid=29552): stdout: | (launched: 2022-12-09_23:26:10.212439) 23:26:13.396767 run osmo-hlr_10.42.42.2(pid=29552): stderr: | 20221209232610388 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209232610388 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209232610388 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209232610388 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209232610388 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209232610388 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209232610400 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:oc2g/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209232610412 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209232610412 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209232610413 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:26:13.449764 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29551): Terminating (SIGTERM) 23:26:13.491864 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29554): Terminating (SIGTERM) 23:26:13.534560 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29557): Terminating (SIGTERM) 23:26:13.578289 --- ParallelTerminationStrategy: PID 29551 died... 23:26:13.598563 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29551): Terminated: ok {rc=0} 23:26:13.646381 --- ParallelTerminationStrategy: PID 29554 died... 23:26:13.665991 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29554): Terminated: ok {rc=0} 23:26:13.713834 --- ParallelTerminationStrategy: PID 29557 died... 23:26:13.733511 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29557): Terminated: ok {rc=0} 23:26:13.822667 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2366 gprs:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 gprs:oc2g+mod-bts0-egprs --------------------------------------------------------------------- 23:26:15.115031 tst gprs:oc2g+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:26:15.121082 tst gprs:oc2g+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 23:26:15.142602 tst gprs:oc2g+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 23:26:15.182820 tst gprs:oc2g+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 23:26:15.272114 tst gprs:oc2g+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 23:26:15.294249 tst gprs:oc2g+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 23:26:15.334143 tst gprs:oc2g+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 23:26:15.933540 tst gprs:oc2g+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2366 gprs:oc2g+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 23:26:15.987909 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:16.000149 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:26:16.042141 tst cs_paging_gprs_active.py: using LAC 24397 23:26:16.168473 tst cs_paging_gprs_active.py: using RAC 172 23:26:16.326289 tst cs_paging_gprs_active.py: using CellId 24397 23:26:16.452467 tst cs_paging_gprs_active.py: using BVCI 24398 23:26:16.570263 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:16.582709 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:16.594728 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:16.607214 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:16.620741 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:16.633753 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:16.645898 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:16.658682 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:16.670737 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:26:16.791400 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:26:16.934406 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:26:17.182742 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:26:17.482897 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29563): Launched 23:26:17.739054 run iperf3-srv_10.42.42.10(pid=29564): Launched 23:26:17.849384 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:26:18.046986 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:26:18.343131 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29565): Launched 23:26:18.599185 run iperf3-srv_10.42.42.10(pid=29566): Launched 23:26:18.709416 tst cs_paging_gprs_active.py:38: start network... 23:26:18.907223 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:26:19.364577 run create_hlr_db(pid=29567): Launched 23:26:19.486157 bus /gobi_6: Setting Powered False 23:26:20.545360 run create_hlr_db(pid=29567): Terminated: ok {rc=0} 23:26:20.977942 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29569): Launched 23:26:21.293186 run osmo-hlr_10.42.42.2(pid=29570): Launched 23:26:21.414361 run osmo-stp_10.42.42.5: Starting osmo-stp 23:26:21.961235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29572): Launched 23:26:22.276773 run osmo-stp_10.42.42.5(pid=29573): Launched 23:26:22.397832 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:26:22.942253 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29575): Launched 23:26:23.062881 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:26:23.330102 run patchelf(pid=29576): Launched 23:26:23.506080 run osmo-stp_10.42.42.5(pid=29573): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29573)] 23:26:23.640311 run osmo-stp_10.42.42.5(pid=29573): stdout: | (launched: 2022-12-09_23:26:22.219736) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:26:23.776023 run osmo-stp_10.42.42.5(pid=29573): stderr: | 20221209232622411 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232622411 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232622411 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232622412 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232622412 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232622412 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232622412 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:26:23.912425 run osmo-stp_10.42.42.5(pid=29573): stdout: | (launched: 2022-12-09_23:26:22.219736) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:26:24.042400 run osmo-stp_10.42.42.5(pid=29573): stderr: | 20221209232622411 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232622411 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232622411 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232622412 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232622412 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232622412 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232622412 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:26:24.196348 run patchelf(pid=29576): Terminating (SIGINT) 23:26:24.374758 run patchelf(pid=29576): Terminated: ok {rc=0} 23:26:24.503304 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29573): Process ended prematurely: osmo-stp_10.42.42.5(pid=29573) [trial-2366↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29573)] [trial-2366↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 23:26:24.513390 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 23:26:24.541756 run osmo-hlr_10.42.42.2(pid=29570): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29570)] 23:26:24.592129 run osmo-hlr_10.42.42.2(pid=29570): stdout: | (launched: 2022-12-09_23:26:21.236158) 23:26:24.644133 run osmo-hlr_10.42.42.2(pid=29570): stderr: | 20221209232621433 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209232621433 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209232621433 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209232621433 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209232621433 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209232621433 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209232621446 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:oc2g+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209232621454 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209232621455 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209232621455 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:26:24.696844 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29563): Terminating (SIGTERM) 23:26:24.738944 run iperf3-srv_10.42.42.10(pid=29564): Terminating (SIGTERM) 23:26:24.781050 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29565): Terminating (SIGTERM) 23:26:24.823283 run iperf3-srv_10.42.42.10(pid=29566): Terminating (SIGTERM) 23:26:24.865178 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29569): Terminating (SIGTERM) 23:26:24.907357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29572): Terminating (SIGTERM) 23:26:24.949460 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29575): Terminating (SIGTERM) 23:26:24.991750 --- ParallelTerminationStrategy: PID 29563 died... 23:26:25.011530 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29563): Terminated: ok {rc=0} 23:26:25.057847 --- ParallelTerminationStrategy: PID 29564 died... 23:26:25.076926 run iperf3-srv_10.42.42.10(pid=29564): Terminated {rc=256} 23:26:25.122760 --- ParallelTerminationStrategy: PID 29565 died... 23:26:25.141814 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29565): Terminated: ok {rc=0} 23:26:25.187542 --- ParallelTerminationStrategy: PID 29566 died... 23:26:25.206664 run iperf3-srv_10.42.42.10(pid=29566): Terminated {rc=256} 23:26:25.253051 --- ParallelTerminationStrategy: PID 29569 died... 23:26:25.272457 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29569): Terminated: ok {rc=0} 23:26:25.318209 --- ParallelTerminationStrategy: PID 29572 died... 23:26:25.337609 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29572): Terminated: ok {rc=0} 23:26:25.383427 --- ParallelTerminationStrategy: PID 29575 died... 23:26:25.402755 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29575): Terminated: ok {rc=0} 23:26:25.490169 bus /gobi_0: Setting Powered False 23:26:26.588474 bus /gobi_0: Setting Powered False 23:26:27.703384 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:oc2g+mod-bts0-egprs iperf3.py ---------------------------------------------- 23:26:28.860309 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:28.872094 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:26:28.911030 tst iperf3.py: using LAC 24398 23:26:29.035929 tst iperf3.py: using RAC 173 23:26:29.159634 tst iperf3.py: using CellId 24398 23:26:29.287894 tst iperf3.py: using BVCI 24399 23:26:29.403746 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:29.415047 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:29.426073 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:29.437525 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:29.448591 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:29.459704 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:29.471017 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:29.482177 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:29.493592 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:26:29.613121 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:26:29.826693 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:26:30.143557 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29577): Launched 23:26:30.418570 run iperf3-srv_10.42.42.10(pid=29578): Launched 23:26:30.536811 tst iperf3.py:8: start network... 23:26:30.749506 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:26:31.248362 run create_hlr_db(pid=29579): Launched 23:26:31.413422 bus /gobi_6: Setting Powered False 23:26:32.476477 run create_hlr_db(pid=29579): Terminated: ok {rc=0} 23:26:32.928797 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29581): Launched 23:26:33.221856 run osmo-hlr_10.42.42.2(pid=29582): Launched 23:26:33.333639 run osmo-stp_10.42.42.5: Starting osmo-stp 23:26:33.858616 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29584): Launched 23:26:34.153091 run osmo-stp_10.42.42.5(pid=29585): Launched 23:26:34.264692 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:26:34.773387 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29587): Launched 23:26:34.886525 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:26:35.136719 run patchelf(pid=29588): Launched 23:26:35.300793 run osmo-stp_10.42.42.5(pid=29585): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29585)] 23:26:35.426303 run osmo-stp_10.42.42.5(pid=29585): stdout: | (launched: 2022-12-09_23:26:34.099507) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:26:35.553496 run osmo-stp_10.42.42.5(pid=29585): stderr: | 20221209232634267 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232634267 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232634267 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232634268 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232634268 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232634268 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232634268 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:26:35.681550 run osmo-stp_10.42.42.5(pid=29585): stdout: | (launched: 2022-12-09_23:26:34.099507) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:26:35.802714 run osmo-stp_10.42.42.5(pid=29585): stderr: | 20221209232634267 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232634267 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232634267 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232634268 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232634268 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232634268 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232634268 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:26:35.946235 run patchelf(pid=29588): Terminating (SIGINT) 23:26:36.112260 run patchelf(pid=29588): Terminated: ok {rc=0} 23:26:36.231853 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29585): Process ended prematurely: osmo-stp_10.42.42.5(pid=29585) [trial-2366↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29585)] [trial-2366↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8] 23:26:36.241599 tst iperf3.py:8: Test FAILED (7.4 sec) 23:26:36.268174 run osmo-hlr_10.42.42.2(pid=29582): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:oc2g+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29582)] 23:26:36.315728 run osmo-hlr_10.42.42.2(pid=29582): stdout: | (launched: 2022-12-09_23:26:33.168387) 23:26:36.365244 run osmo-hlr_10.42.42.2(pid=29582): stderr: | 20221209232633344 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209232633344 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209232633344 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209232633344 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209232633344 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209232633344 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209232633355 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:oc2g+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209232633365 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209232633365 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209232633365 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:26:36.415108 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29577): Terminating (SIGTERM) 23:26:36.455001 run iperf3-srv_10.42.42.10(pid=29578): Terminating (SIGTERM) 23:26:36.494763 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29581): Terminating (SIGTERM) 23:26:36.534685 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29584): Terminating (SIGTERM) 23:26:36.574439 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29587): Terminating (SIGTERM) 23:26:36.614340 --- ParallelTerminationStrategy: PID 29577 died... 23:26:36.633056 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29577): Terminated: ok {rc=0} 23:26:36.677110 --- ParallelTerminationStrategy: PID 29578 died... 23:26:36.695577 run iperf3-srv_10.42.42.10(pid=29578): Terminated {rc=256} 23:26:36.739627 --- ParallelTerminationStrategy: PID 29581 died... 23:26:36.758363 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29581): Terminated: ok {rc=0} 23:26:36.802201 --- ParallelTerminationStrategy: PID 29584 died... 23:26:36.820936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29584): Terminated: ok {rc=0} 23:26:36.865188 --- ParallelTerminationStrategy: PID 29587 died... 23:26:36.884159 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29587): Terminated: ok {rc=0} 23:26:36.970771 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:oc2g+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 23:26:38.118079 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:38.129453 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:26:38.170709 tst iperf3m4.py: using LAC 24399 23:26:38.285302 tst iperf3m4.py: using RAC 174 23:26:38.401358 tst iperf3m4.py: using CellId 24399 23:26:38.517505 tst iperf3m4.py: using BVCI 24400 23:26:38.624775 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:38.635495 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:38.646065 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:38.656435 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:38.666810 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:38.677156 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:38.687722 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:38.698091 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:38.708786 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:26:38.825747 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:26:38.943390 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:26:39.060292 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:26:39.178045 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:26:39.391814 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:26:39.709926 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29589): Launched 23:26:39.983344 run iperf3-srv_10.42.42.10(pid=29590): Launched 23:26:40.101314 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:26:40.314400 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:26:40.630595 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29591): Launched 23:26:40.904125 run iperf3-srv_10.42.42.10(pid=29592): Launched 23:26:41.022179 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:26:41.234800 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:26:41.551842 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29593): Launched 23:26:41.826580 run iperf3-srv_10.42.42.10(pid=29594): Launched 23:26:41.944424 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:26:42.157127 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:26:42.474661 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29595): Launched 23:26:42.749007 run iperf3-srv_10.42.42.10(pid=29596): Launched 23:26:42.866921 tst iperf3m4.py:8: start network... 23:26:43.079598 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:26:43.569132 run create_hlr_db(pid=29597): Launched 23:26:43.689414 bus /gobi_6: Setting Powered False 23:26:44.752872 run create_hlr_db(pid=29597): Terminated: ok {rc=0} 23:26:45.176670 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29599): Launched 23:26:45.472474 run osmo-hlr_10.42.42.2(pid=29600): Launched 23:26:45.585852 run osmo-stp_10.42.42.5: Starting osmo-stp 23:26:46.146856 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29602): Launched 23:26:46.459193 run osmo-stp_10.42.42.5(pid=29603): Launched 23:26:46.743214 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:26:47.337874 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29605): Launched 23:26:47.460024 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:26:47.714814 run patchelf(pid=29606): Launched 23:26:47.879689 run osmo-stp_10.42.42.5(pid=29603): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29603)] 23:26:48.005371 run osmo-stp_10.42.42.5(pid=29603): stdout: | (launched: 2022-12-09_23:26:46.394472) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:26:48.132786 run osmo-stp_10.42.42.5(pid=29603): stderr: | 20221209232646596 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232646596 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232646596 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232646605 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232646606 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232646606 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232646606 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:26:48.260340 run osmo-stp_10.42.42.5(pid=29603): stdout: | (launched: 2022-12-09_23:26:46.394472) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:26:48.381484 run osmo-stp_10.42.42.5(pid=29603): stderr: | 20221209232646596 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232646596 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232646596 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232646605 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232646606 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232646606 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232646606 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:26:48.525291 run patchelf(pid=29606): Terminating (SIGINT) 23:26:48.691580 run patchelf(pid=29606): Terminated: ok {rc=0} 23:26:48.811690 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29603): Process ended prematurely: osmo-stp_10.42.42.5(pid=29603) [trial-2366↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29603)] [trial-2366↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8] 23:26:48.821325 tst iperf3m4.py:8: Test FAILED (10.7 sec) 23:26:48.848310 run osmo-hlr_10.42.42.2(pid=29600): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29600)] 23:26:48.895184 run osmo-hlr_10.42.42.2(pid=29600): stdout: | (launched: 2022-12-09_23:26:45.418717) 23:26:48.943817 run osmo-hlr_10.42.42.2(pid=29600): stderr: | 20221209232645594 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209232645594 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209232645594 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209232645594 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209232645594 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209232645594 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209232645608 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:oc2g+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209232645618 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209232645619 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209232645619 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:26:48.993434 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29589): Terminating (SIGTERM) 23:26:49.032707 run iperf3-srv_10.42.42.10(pid=29590): Terminating (SIGTERM) 23:26:49.071597 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29591): Terminating (SIGTERM) 23:26:49.110612 run iperf3-srv_10.42.42.10(pid=29592): Terminating (SIGTERM) 23:26:49.149626 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29593): Terminating (SIGTERM) 23:26:49.188460 run iperf3-srv_10.42.42.10(pid=29594): Terminating (SIGTERM) 23:26:49.227247 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29595): Terminating (SIGTERM) 23:26:49.266330 run iperf3-srv_10.42.42.10(pid=29596): Terminating (SIGTERM) 23:26:49.305173 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29599): Terminating (SIGTERM) 23:26:49.344032 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29602): Terminating (SIGTERM) 23:26:49.383012 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29605): Terminating (SIGTERM) 23:26:49.422245 --- ParallelTerminationStrategy: PID 29589 died... 23:26:49.440773 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29589): Terminated: ok {rc=0} 23:26:49.484327 --- ParallelTerminationStrategy: PID 29590 died... 23:26:49.502669 run iperf3-srv_10.42.42.10(pid=29590): Terminated {rc=256} 23:26:49.545955 --- ParallelTerminationStrategy: PID 29591 died... 23:26:49.564187 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29591): Terminated: ok {rc=0} 23:26:49.607209 --- ParallelTerminationStrategy: PID 29592 died... 23:26:49.625873 run iperf3-srv_10.42.42.10(pid=29592): Terminated {rc=256} 23:26:49.668788 --- ParallelTerminationStrategy: PID 29593 died... 23:26:49.687154 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29593): Terminated: ok {rc=0} 23:26:49.730051 --- ParallelTerminationStrategy: PID 29594 died... 23:26:49.748281 run iperf3-srv_10.42.42.10(pid=29594): Terminated {rc=256} 23:26:49.791446 --- ParallelTerminationStrategy: PID 29595 died... 23:26:49.809761 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29595): Terminated: ok {rc=0} 23:26:49.852641 --- ParallelTerminationStrategy: PID 29596 died... 23:26:49.870949 run iperf3-srv_10.42.42.10(pid=29596): Terminated {rc=256} 23:26:49.913768 --- ParallelTerminationStrategy: PID 29599 died... 23:26:49.931973 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29599): Terminated: ok {rc=0} 23:26:49.975495 --- ParallelTerminationStrategy: PID 29602 died... 23:26:49.993796 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29602): Terminated: ok {rc=0} 23:26:50.037291 --- ParallelTerminationStrategy: PID 29605 died... 23:26:50.055565 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29605): Terminated: ok {rc=0} 23:26:50.139959 bus /gobi_4: Setting Powered False 23:26:51.239304 bus /gobi_4: Setting Powered False 23:26:52.353565 bus /gobi_1: Setting Powered False 23:26:53.452730 bus /gobi_1: Setting Powered False 23:26:54.566594 bus /gobi_0: Setting Powered False 23:26:55.664695 bus /gobi_0: Setting Powered False 23:26:56.779990 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:oc2g+mod-bts0-egprs ping.py ---------------------------------------------- 23:26:57.882305 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:57.893557 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:26:57.929994 tst ping.py: using LAC 24400 23:26:58.045560 tst ping.py: using RAC 175 23:26:58.160136 tst ping.py: using CellId 24400 23:26:58.274604 tst ping.py: using BVCI 24401 23:26:58.382009 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:58.392751 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:58.403385 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:58.413878 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:58.424241 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:58.434678 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:58.445340 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:26:58.455853 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:26:58.568186 tst ping.py:19: start network... 23:26:58.763248 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:26:59.214145 run create_hlr_db(pid=29607): Launched 23:26:59.331330 bus /gobi_6: Setting Powered False 23:27:00.389935 run create_hlr_db(pid=29607): Terminated: ok {rc=0} 23:27:00.794871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29609): Launched 23:27:01.098025 run osmo-hlr_10.42.42.2(pid=29610): Launched 23:27:01.274566 run osmo-stp_10.42.42.5: Starting osmo-stp 23:27:02.101065 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29612): Launched 23:27:02.493714 run osmo-stp_10.42.42.5(pid=29613): Launched 23:27:02.627686 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:27:03.165253 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29615): Launched 23:27:03.283709 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:27:03.546836 run patchelf(pid=29616): Launched 23:27:03.720110 run osmo-stp_10.42.42.5(pid=29613): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29613)] 23:27:03.852865 run osmo-stp_10.42.42.5(pid=29613): stdout: | (launched: 2022-12-09_23:27:02.425346) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:27:03.987057 run osmo-stp_10.42.42.5(pid=29613): stderr: | 20221209232702633 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232702634 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232702634 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232702634 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232702635 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232702635 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232702635 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:27:04.121574 run osmo-stp_10.42.42.5(pid=29613): stdout: | (launched: 2022-12-09_23:27:02.425346) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:27:04.249905 run osmo-stp_10.42.42.5(pid=29613): stderr: | 20221209232702633 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232702634 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232702634 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232702634 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232702635 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232702635 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232702635 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:27:04.402419 run patchelf(pid=29616): Terminating (SIGINT) 23:27:04.578348 run patchelf(pid=29616): Terminated: ok {rc=0} 23:27:04.704556 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29613): Process ended prematurely: osmo-stp_10.42.42.5(pid=29613) [trial-2366↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29613)] [trial-2366↪gprs:oc2g+mod-bts0-egprs↪ping.py:22] 23:27:04.714087 tst ping.py:22: Test FAILED (6.8 sec) 23:27:04.742362 run osmo-hlr_10.42.42.2(pid=29610): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:oc2g+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29610)] 23:27:04.793138 run osmo-hlr_10.42.42.2(pid=29610): stdout: | (launched: 2022-12-09_23:27:01.034084) 23:27:04.845345 run osmo-hlr_10.42.42.2(pid=29610): stderr: | 20221209232701515 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209232701515 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209232701515 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209232701515 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209232701515 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209232701515 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209232701541 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:oc2g+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209232701556 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209232701556 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209232701556 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:27:04.897792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29609): Terminating (SIGTERM) 23:27:04.940050 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29612): Terminating (SIGTERM) 23:27:04.982533 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29615): Terminating (SIGTERM) 23:27:05.025088 --- ParallelTerminationStrategy: PID 29609 died... 23:27:05.045143 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29609): Terminated: ok {rc=0} 23:27:05.092152 --- ParallelTerminationStrategy: PID 29612 died... 23:27:05.112036 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29612): Terminated: ok {rc=0} 23:27:05.158841 --- ParallelTerminationStrategy: PID 29615 died... 23:27:05.178543 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29615): Terminated: ok {rc=0} 23:27:05.266858 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:oc2g+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 23:27:06.354322 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:27:06.366745 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:27:06.405725 tst ping_idle_ping.py: using LAC 24401 23:27:06.531091 tst ping_idle_ping.py: using RAC 176 23:27:06.653262 tst ping_idle_ping.py: using CellId 24401 23:27:06.775246 tst ping_idle_ping.py: using BVCI 24402 23:27:06.888913 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:27:06.900027 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:27:06.911059 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:27:06.922400 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:27:06.933505 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:27:06.944514 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:27:06.955735 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:27:06.966984 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:27:07.082927 tst ping_idle_ping.py:24: start network... 23:27:07.278961 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:27:07.733567 run create_hlr_db(pid=29617): Launched 23:27:07.853277 bus /gobi_6: Setting Powered False 23:27:08.912380 run create_hlr_db(pid=29617): Terminated: ok {rc=0} 23:27:09.320735 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29619): Launched 23:27:09.613028 run osmo-hlr_10.42.42.2(pid=29620): Launched 23:27:09.724006 run osmo-stp_10.42.42.5: Starting osmo-stp 23:27:10.225324 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29622): Launched 23:27:10.516282 run osmo-stp_10.42.42.5(pid=29623): Launched 23:27:10.627398 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:27:11.130410 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29625): Launched 23:27:11.242095 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:27:11.488489 run patchelf(pid=29626): Launched 23:27:11.650501 run osmo-stp_10.42.42.5(pid=29623): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29623)] 23:27:11.774136 run osmo-stp_10.42.42.5(pid=29623): stdout: | (launched: 2022-12-09_23:27:10.463002) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:27:11.899586 run osmo-stp_10.42.42.5(pid=29623): stderr: | 20221209232710632 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232710632 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232710632 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232710633 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232710633 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232710633 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232710633 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:27:12.024723 run osmo-stp_10.42.42.5(pid=29623): stdout: | (launched: 2022-12-09_23:27:10.463002) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:27:12.144516 run osmo-stp_10.42.42.5(pid=29623): stderr: | 20221209232710632 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232710632 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232710632 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232710633 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232710633 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232710633 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232710633 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:27:12.285978 run patchelf(pid=29626): Terminating (SIGINT) 23:27:12.450524 run patchelf(pid=29626): Terminated: ok {rc=0} 23:27:12.568579 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29623): Process ended prematurely: osmo-stp_10.42.42.5(pid=29623) [trial-2366↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29623)] [trial-2366↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27] 23:27:12.577494 tst ping_idle_ping.py:27: Test FAILED (6.2 sec) 23:27:12.604013 run osmo-hlr_10.42.42.2(pid=29620): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29620)] 23:27:12.651634 run osmo-hlr_10.42.42.2(pid=29620): stdout: | (launched: 2022-12-09_23:27:09.558784) 23:27:12.700679 run osmo-hlr_10.42.42.2(pid=29620): stderr: | 20221209232709732 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209232709732 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209232709732 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209232709732 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209232709732 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209232709732 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209232709747 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:oc2g+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209232709756 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209232709756 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209232709756 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:27:12.750244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29619): Terminating (SIGTERM) 23:27:12.789982 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29622): Terminating (SIGTERM) 23:27:12.829839 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29625): Terminating (SIGTERM) 23:27:12.869784 --- ParallelTerminationStrategy: PID 29619 died... 23:27:12.888793 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29619): Terminated: ok {rc=0} 23:27:12.932931 --- ParallelTerminationStrategy: PID 29622 died... 23:27:12.951525 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29622): Terminated: ok {rc=0} 23:27:12.995369 --- ParallelTerminationStrategy: PID 29625 died... 23:27:13.013974 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29625): Terminated: ok {rc=0} 23:27:13.097487 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2366 gprs:oc2g+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 gprs:oc2g+mod-bts0-dynts-ipa --------------------------------------------------------------------- 23:27:14.385653 tst gprs:oc2g+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:27:14.391452 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 23:27:14.411551 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 23:27:14.449504 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 23:27:14.534396 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 23:27:14.554392 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 23:27:14.591894 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 23:27:15.186104 tst gprs:oc2g+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2366 gprs:oc2g+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 23:27:15.234176 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:15.244887 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:27:15.300797 tst cs_paging_gprs_active.py: using LAC 24402 23:27:15.419514 tst cs_paging_gprs_active.py: using RAC 177 23:27:15.535191 tst cs_paging_gprs_active.py: using CellId 24402 23:27:15.653039 tst cs_paging_gprs_active.py: using BVCI 24403 23:27:15.760123 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:15.771253 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:15.781737 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:15.792148 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:15.802599 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:15.812932 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:15.823535 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:15.833917 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:15.844526 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:27:15.964839 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:27:16.096872 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:27:16.301901 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:27:16.621528 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29630): Launched 23:27:16.922205 run iperf3-srv_10.42.42.10(pid=29631): Launched 23:27:17.040215 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:27:17.243491 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:27:17.544034 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29632): Launched 23:27:17.801375 run iperf3-srv_10.42.42.10(pid=29633): Launched 23:27:17.911977 tst cs_paging_gprs_active.py:38: start network... 23:27:18.110381 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:27:18.569059 run create_hlr_db(pid=29634): Launched 23:27:18.689509 bus /gobi_6: Setting Powered False 23:27:19.747993 run create_hlr_db(pid=29634): Terminated: ok {rc=0} 23:27:20.161522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29636): Launched 23:27:20.460215 run osmo-hlr_10.42.42.2(pid=29637): Launched 23:27:20.573616 run osmo-stp_10.42.42.5: Starting osmo-stp 23:27:21.099391 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29639): Launched 23:27:21.396264 run osmo-stp_10.42.42.5(pid=29640): Launched 23:27:21.509500 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:27:22.020651 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29642): Launched 23:27:22.134133 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:27:22.383586 run patchelf(pid=29643): Launched 23:27:22.547552 run osmo-stp_10.42.42.5(pid=29640): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29640)] 23:27:22.672710 run osmo-stp_10.42.42.5(pid=29640): stdout: | (launched: 2022-12-09_23:27:21.342313) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:27:22.799656 run osmo-stp_10.42.42.5(pid=29640): stderr: | 20221209232721512 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232721512 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232721513 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232721513 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232721514 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232721514 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232721514 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:27:22.926995 run osmo-stp_10.42.42.5(pid=29640): stdout: | (launched: 2022-12-09_23:27:21.342313) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:27:23.047763 run osmo-stp_10.42.42.5(pid=29640): stderr: | 20221209232721512 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232721512 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232721513 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232721513 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232721514 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232721514 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232721514 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:27:23.191161 run patchelf(pid=29643): Terminating (SIGINT) 23:27:23.358337 run patchelf(pid=29643): Terminated: ok {rc=0} 23:27:23.478561 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29640): Process ended prematurely: osmo-stp_10.42.42.5(pid=29640) [trial-2366↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29640)] [trial-2366↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 23:27:23.487684 tst cs_paging_gprs_active.py:38: Test FAILED (8.3 sec) 23:27:23.514412 run osmo-hlr_10.42.42.2(pid=29637): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29637)] 23:27:23.561256 run osmo-hlr_10.42.42.2(pid=29637): stdout: | (launched: 2022-12-09_23:27:20.405801) 23:27:23.609716 run osmo-hlr_10.42.42.2(pid=29637): stderr: | 20221209232720583 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209232720583 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209232720583 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209232720583 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209232720583 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209232720583 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209232720596 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:oc2g+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209232720606 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209232720606 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209232720606 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:27:23.658741 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29630): Terminating (SIGTERM) 23:27:23.698008 run iperf3-srv_10.42.42.10(pid=29631): Terminating (SIGTERM) 23:27:23.736661 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29632): Terminating (SIGTERM) 23:27:23.775252 run iperf3-srv_10.42.42.10(pid=29633): Terminating (SIGTERM) 23:27:23.813567 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29636): Terminating (SIGTERM) 23:27:23.852556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29639): Terminating (SIGTERM) 23:27:23.891057 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29642): Terminating (SIGTERM) 23:27:23.929769 --- ParallelTerminationStrategy: PID 29630 died... 23:27:23.948648 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29630): Terminated: ok {rc=0} 23:27:23.991831 --- ParallelTerminationStrategy: PID 29631 died... 23:27:24.009992 run iperf3-srv_10.42.42.10(pid=29631): Terminated {rc=256} 23:27:24.052917 --- ParallelTerminationStrategy: PID 29632 died... 23:27:24.071080 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29632): Terminated: ok {rc=0} 23:27:24.114137 --- ParallelTerminationStrategy: PID 29633 died... 23:27:24.132250 run iperf3-srv_10.42.42.10(pid=29633): Terminated {rc=256} 23:27:24.175102 --- ParallelTerminationStrategy: PID 29636 died... 23:27:24.193760 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29636): Terminated: ok {rc=0} 23:27:24.237148 --- ParallelTerminationStrategy: PID 29639 died... 23:27:24.255256 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29639): Terminated: ok {rc=0} 23:27:24.298223 --- ParallelTerminationStrategy: PID 29642 died... 23:27:24.316399 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29642): Terminated: ok {rc=0} 23:27:24.400706 bus /gobi_0: Setting Powered False 23:27:25.499731 bus /gobi_0: Setting Powered False 23:27:26.614462 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:oc2g+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 23:27:27.761971 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:27.773744 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:27:27.833774 tst iperf3.py: using LAC 24403 23:27:27.964265 tst iperf3.py: using RAC 178 23:27:28.088355 tst iperf3.py: using CellId 24403 23:27:28.210693 tst iperf3.py: using BVCI 24404 23:27:28.326591 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:28.337920 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:28.348898 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:28.360310 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:28.371412 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:28.382717 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:28.394188 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:28.405287 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:28.416580 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:27:28.531495 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:27:28.745741 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:27:29.064051 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29644): Launched 23:27:29.339241 run iperf3-srv_10.42.42.10(pid=29645): Launched 23:27:29.458225 tst iperf3.py:8: start network... 23:27:29.672094 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:27:30.160557 run create_hlr_db(pid=29646): Launched 23:27:30.280758 bus /gobi_6: Setting Powered False 23:27:31.341751 run create_hlr_db(pid=29646): Terminated: ok {rc=0} 23:27:31.770476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29648): Launched 23:27:32.094717 run osmo-hlr_10.42.42.2(pid=29649): Launched 23:27:32.248648 run osmo-stp_10.42.42.5: Starting osmo-stp 23:27:32.795845 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29651): Launched 23:27:33.110802 run osmo-stp_10.42.42.5(pid=29652): Launched 23:27:33.231526 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:27:33.777197 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29654): Launched 23:27:33.897957 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:27:34.165165 run patchelf(pid=29655): Launched 23:27:34.341179 run osmo-stp_10.42.42.5(pid=29652): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29652)] 23:27:34.475492 run osmo-stp_10.42.42.5(pid=29652): stdout: | (launched: 2022-12-09_23:27:33.054019) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:27:34.611892 run osmo-stp_10.42.42.5(pid=29652): stderr: | 20221209232733247 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232733247 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232733247 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232733247 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232733248 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232733248 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232733248 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:27:34.748501 run osmo-stp_10.42.42.5(pid=29652): stdout: | (launched: 2022-12-09_23:27:33.054019) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:27:34.878819 run osmo-stp_10.42.42.5(pid=29652): stderr: | 20221209232733247 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232733247 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232733247 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232733247 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232733248 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232733248 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232733248 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:27:35.032759 run patchelf(pid=29655): Terminating (SIGINT) 23:27:35.211126 run patchelf(pid=29655): Terminated: ok {rc=0} 23:27:35.340583 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29652): Process ended prematurely: osmo-stp_10.42.42.5(pid=29652) [trial-2366↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29652)] [trial-2366↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8] 23:27:35.350864 tst iperf3.py:8: Test FAILED (7.6 sec) 23:27:35.379752 run osmo-hlr_10.42.42.2(pid=29649): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29649)] 23:27:35.429450 run osmo-hlr_10.42.42.2(pid=29649): stdout: | (launched: 2022-12-09_23:27:32.025401) 23:27:35.480925 run osmo-hlr_10.42.42.2(pid=29649): stderr: | 20221209232732265 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209232732265 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209232732265 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209232732265 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209232732265 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209232732265 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209232732277 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:oc2g+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209232732286 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209232732286 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209232732286 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:27:35.532892 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29644): Terminating (SIGTERM) 23:27:35.574604 run iperf3-srv_10.42.42.10(pid=29645): Terminating (SIGTERM) 23:27:35.616082 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29648): Terminating (SIGTERM) 23:27:35.657739 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29651): Terminating (SIGTERM) 23:27:35.699223 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29654): Terminating (SIGTERM) 23:27:35.741290 --- ParallelTerminationStrategy: PID 29644 died... 23:27:35.761186 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29644): Terminated: ok {rc=0} 23:27:35.807946 --- ParallelTerminationStrategy: PID 29645 died... 23:27:35.827323 run iperf3-srv_10.42.42.10(pid=29645): Terminated {rc=256} 23:27:35.873173 --- ParallelTerminationStrategy: PID 29648 died... 23:27:35.892828 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29648): Terminated: ok {rc=0} 23:27:35.939490 --- ParallelTerminationStrategy: PID 29651 died... 23:27:35.958724 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29651): Terminated: ok {rc=0} 23:27:36.005187 --- ParallelTerminationStrategy: PID 29654 died... 23:27:36.024489 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29654): Terminated: ok {rc=0} 23:27:36.111900 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:oc2g+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 23:27:37.259256 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:37.271039 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:27:37.329930 tst iperf3m4.py: using LAC 24404 23:27:37.454638 tst iperf3m4.py: using RAC 179 23:27:37.579548 tst iperf3m4.py: using CellId 24404 23:27:37.703493 tst iperf3m4.py: using BVCI 24405 23:27:37.818328 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:37.829608 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:37.840532 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:37.851762 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:37.862990 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:37.874143 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:37.885650 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:37.896789 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:37.908178 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:27:38.023233 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:27:38.140019 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:27:38.259376 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:27:38.381213 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:27:38.596023 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:27:38.914369 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29661): Launched 23:27:39.189693 run iperf3-srv_10.42.42.10(pid=29662): Launched 23:27:39.309459 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:27:39.523748 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:27:39.842566 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29663): Launched 23:27:40.117641 run iperf3-srv_10.42.42.10(pid=29664): Launched 23:27:40.236220 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:27:40.451340 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:27:40.769491 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29665): Launched 23:27:41.045803 run iperf3-srv_10.42.42.10(pid=29666): Launched 23:27:41.164583 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:27:41.378863 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:27:41.696763 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29667): Launched 23:27:41.972399 run iperf3-srv_10.42.42.10(pid=29668): Launched 23:27:42.091322 tst iperf3m4.py:8: start network... 23:27:42.305985 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:27:42.797538 run create_hlr_db(pid=29669): Launched 23:27:42.918764 bus /gobi_6: Setting Powered False 23:27:43.981449 run create_hlr_db(pid=29669): Terminated: ok {rc=0} 23:27:44.422969 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29671): Launched 23:27:44.739302 run osmo-hlr_10.42.42.2(pid=29672): Launched 23:27:44.860842 run osmo-stp_10.42.42.5: Starting osmo-stp 23:27:45.410895 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29674): Launched 23:27:45.707393 run osmo-stp_10.42.42.5(pid=29675): Launched 23:27:45.819457 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:27:46.501214 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29677): Launched 23:27:46.635790 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:27:46.911189 run patchelf(pid=29678): Launched 23:27:47.090416 run osmo-stp_10.42.42.5(pid=29675): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29675)] 23:27:47.217998 run osmo-stp_10.42.42.5(pid=29675): stdout: | (launched: 2022-12-09_23:27:45.653523) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:27:47.347042 run osmo-stp_10.42.42.5(pid=29675): stderr: | 20221209232745822 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232745823 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232745823 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232745823 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232745824 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232745824 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232745824 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:27:47.475117 run osmo-stp_10.42.42.5(pid=29675): stdout: | (launched: 2022-12-09_23:27:45.653523) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:27:47.597520 run osmo-stp_10.42.42.5(pid=29675): stderr: | 20221209232745822 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232745823 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232745823 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232745823 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232745824 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232745824 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232745824 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:27:47.741671 run patchelf(pid=29678): Terminating (SIGINT) 23:27:47.908656 run patchelf(pid=29678): Terminated: ok {rc=0} 23:27:48.028849 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29675): Process ended prematurely: osmo-stp_10.42.42.5(pid=29675) [trial-2366↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29675)] [trial-2366↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8] 23:27:48.038359 tst iperf3m4.py:8: Test FAILED (10.8 sec) 23:27:48.065729 run osmo-hlr_10.42.42.2(pid=29672): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29672)] 23:27:48.113398 run osmo-hlr_10.42.42.2(pid=29672): stdout: | (launched: 2022-12-09_23:27:44.681975) 23:27:48.162710 run osmo-hlr_10.42.42.2(pid=29672): stderr: | 20221209232744878 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209232744878 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209232744878 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209232744878 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209232744878 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209232744878 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209232744890 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:oc2g+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209232744898 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209232744899 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209232744899 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:27:48.212209 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29661): Terminating (SIGTERM) 23:27:48.251908 run iperf3-srv_10.42.42.10(pid=29662): Terminating (SIGTERM) 23:27:48.291615 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29663): Terminating (SIGTERM) 23:27:48.331331 run iperf3-srv_10.42.42.10(pid=29664): Terminating (SIGTERM) 23:27:48.370963 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29665): Terminating (SIGTERM) 23:27:48.410879 run iperf3-srv_10.42.42.10(pid=29666): Terminating (SIGTERM) 23:27:48.450433 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29667): Terminating (SIGTERM) 23:27:48.490225 run iperf3-srv_10.42.42.10(pid=29668): Terminating (SIGTERM) 23:27:48.529767 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29671): Terminating (SIGTERM) 23:27:48.569499 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29674): Terminating (SIGTERM) 23:27:48.609605 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29677): Terminating (SIGTERM) 23:27:48.649458 --- ParallelTerminationStrategy: PID 29661 died... 23:27:48.668458 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29661): Terminated: ok {rc=0} 23:27:48.713093 --- ParallelTerminationStrategy: PID 29662 died... 23:27:48.731643 run iperf3-srv_10.42.42.10(pid=29662): Terminated {rc=256} 23:27:48.775331 --- ParallelTerminationStrategy: PID 29663 died... 23:27:48.794143 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29663): Terminated: ok {rc=0} 23:27:48.838128 --- ParallelTerminationStrategy: PID 29664 died... 23:27:48.856837 run iperf3-srv_10.42.42.10(pid=29664): Terminated {rc=256} 23:27:48.900555 --- ParallelTerminationStrategy: PID 29665 died... 23:27:48.919219 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29665): Terminated: ok {rc=0} 23:27:48.962731 --- ParallelTerminationStrategy: PID 29666 died... 23:27:48.981159 run iperf3-srv_10.42.42.10(pid=29666): Terminated {rc=256} 23:27:49.024735 --- ParallelTerminationStrategy: PID 29667 died... 23:27:49.043432 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29667): Terminated: ok {rc=0} 23:27:49.087098 --- ParallelTerminationStrategy: PID 29668 died... 23:27:49.105833 run iperf3-srv_10.42.42.10(pid=29668): Terminated {rc=256} 23:27:49.149383 --- ParallelTerminationStrategy: PID 29671 died... 23:27:49.167818 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29671): Terminated: ok {rc=0} 23:27:49.212245 --- ParallelTerminationStrategy: PID 29674 died... 23:27:49.231021 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29674): Terminated: ok {rc=0} 23:27:49.274579 --- ParallelTerminationStrategy: PID 29677 died... 23:27:49.293287 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29677): Terminated: ok {rc=0} 23:27:49.378958 bus /gobi_4: Setting Powered False 23:27:50.478616 bus /gobi_4: Setting Powered False 23:27:51.592835 bus /gobi_1: Setting Powered False 23:27:52.692125 bus /gobi_1: Setting Powered False 23:27:53.808192 bus /gobi_0: Setting Powered False 23:27:54.906616 bus /gobi_0: Setting Powered False 23:27:56.022581 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:oc2g+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 23:27:57.122307 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:57.133681 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:27:57.190366 tst ping.py: using LAC 24405 23:27:57.304819 tst ping.py: using RAC 180 23:27:57.423364 tst ping.py: using CellId 24405 23:27:57.538081 tst ping.py: using BVCI 24406 23:27:57.643797 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:57.654592 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:57.665170 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:57.675610 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:57.686106 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:57.696489 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:57.707143 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:27:57.717654 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:27:57.833478 tst ping.py:19: start network... 23:27:58.044343 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:27:58.528242 run create_hlr_db(pid=29679): Launched 23:27:58.647432 bus /gobi_6: Setting Powered False 23:27:59.710379 run create_hlr_db(pid=29679): Terminated: ok {rc=0} 23:28:00.126883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29681): Launched 23:28:00.416872 run osmo-hlr_10.42.42.2(pid=29682): Launched 23:28:00.528242 run osmo-stp_10.42.42.5: Starting osmo-stp 23:28:01.053354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29684): Launched 23:28:01.359638 run osmo-stp_10.42.42.5(pid=29685): Launched 23:28:01.601755 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:28:02.293663 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29687): Launched 23:28:02.434428 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:28:02.697621 run patchelf(pid=29688): Launched 23:28:02.871069 run osmo-stp_10.42.42.5(pid=29685): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29685)] 23:28:03.003555 run osmo-stp_10.42.42.5(pid=29685): stdout: | (launched: 2022-12-09_23:28:01.295794) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:28:03.138096 run osmo-stp_10.42.42.5(pid=29685): stderr: | 20221209232801651 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232801651 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232801651 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232801652 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232801652 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232801652 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232801652 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:28:03.273380 run osmo-stp_10.42.42.5(pid=29685): stdout: | (launched: 2022-12-09_23:28:01.295794) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:28:03.402333 run osmo-stp_10.42.42.5(pid=29685): stderr: | 20221209232801651 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232801651 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232801651 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232801652 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232801652 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232801652 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232801652 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:28:03.555011 run patchelf(pid=29688): Terminating (SIGINT) 23:28:03.730803 run patchelf(pid=29688): Terminated: ok {rc=0} 23:28:03.857362 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29685): Process ended prematurely: osmo-stp_10.42.42.5(pid=29685) [trial-2366↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29685)] [trial-2366↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22] 23:28:03.866974 tst ping.py:22: Test FAILED (6.7 sec) 23:28:03.895201 run osmo-hlr_10.42.42.2(pid=29682): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29682)] 23:28:03.945392 run osmo-hlr_10.42.42.2(pid=29682): stdout: | (launched: 2022-12-09_23:28:00.363795) 23:28:03.997144 run osmo-hlr_10.42.42.2(pid=29682): stderr: | 20221209232800535 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209232800535 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209232800535 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209232800535 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209232800535 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209232800535 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209232800551 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:oc2g+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209232800561 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209232800561 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209232800561 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:28:04.049351 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29681): Terminating (SIGTERM) 23:28:04.091015 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29684): Terminating (SIGTERM) 23:28:04.132938 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29687): Terminating (SIGTERM) 23:28:04.175262 --- ParallelTerminationStrategy: PID 29681 died... 23:28:04.195495 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29681): Terminated: ok {rc=0} 23:28:04.241944 --- ParallelTerminationStrategy: PID 29684 died... 23:28:04.261321 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29684): Terminated: ok {rc=0} 23:28:04.307526 --- ParallelTerminationStrategy: PID 29687 died... 23:28:04.327452 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29687): Terminated: ok {rc=0} 23:28:04.415637 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:oc2g+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 23:28:05.502582 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:28:05.514577 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:28:05.573488 tst ping_idle_ping.py: using LAC 24406 23:28:05.690627 tst ping_idle_ping.py: using RAC 181 23:28:05.808363 tst ping_idle_ping.py: using CellId 24406 23:28:05.934339 tst ping_idle_ping.py: using BVCI 24407 23:28:06.041948 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:28:06.052749 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:28:06.063384 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:28:06.074571 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:28:06.085603 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:28:06.096757 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:28:06.108111 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:28:06.119193 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:28:06.237162 tst ping_idle_ping.py:24: start network... 23:28:06.449944 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:28:06.937196 run create_hlr_db(pid=29689): Launched 23:28:07.056766 bus /gobi_6: Setting Powered False 23:28:08.119709 run create_hlr_db(pid=29689): Terminated: ok {rc=0} 23:28:08.539100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29691): Launched 23:28:08.830375 run osmo-hlr_10.42.42.2(pid=29692): Launched 23:28:08.942205 run osmo-stp_10.42.42.5: Starting osmo-stp 23:28:09.447016 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29694): Launched 23:28:09.738908 run osmo-stp_10.42.42.5(pid=29695): Launched 23:28:09.849958 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:28:10.353530 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29697): Launched 23:28:10.465425 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:28:10.712483 run patchelf(pid=29698): Launched 23:28:10.874580 run osmo-stp_10.42.42.5(pid=29695): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29695)] 23:28:10.998009 run osmo-stp_10.42.42.5(pid=29695): stdout: | (launched: 2022-12-09_23:28:09.685564) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:28:11.124490 run osmo-stp_10.42.42.5(pid=29695): stderr: | 20221209232809854 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232809854 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232809854 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232809855 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232809855 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232809855 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232809855 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:28:11.249959 run osmo-stp_10.42.42.5(pid=29695): stdout: | (launched: 2022-12-09_23:28:09.685564) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:28:11.370074 run osmo-stp_10.42.42.5(pid=29695): stderr: | 20221209232809854 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232809854 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232809854 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232809855 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232809855 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232809855 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232809855 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:28:11.511940 run patchelf(pid=29698): Terminating (SIGINT) 23:28:11.677221 run patchelf(pid=29698): Terminated: ok {rc=0} 23:28:11.795272 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29695): Process ended prematurely: osmo-stp_10.42.42.5(pid=29695) [trial-2366↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29695)] [trial-2366↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 23:28:11.804013 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 23:28:11.830617 run osmo-hlr_10.42.42.2(pid=29692): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29692)] 23:28:11.878038 run osmo-hlr_10.42.42.2(pid=29692): stdout: | (launched: 2022-12-09_23:28:08.776860) 23:28:11.927588 run osmo-hlr_10.42.42.2(pid=29692): stderr: | 20221209232808950 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209232808950 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209232808950 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209232808950 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209232808950 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209232808950 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209232808962 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:oc2g+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209232808971 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209232808971 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209232808971 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:28:11.977363 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29691): Terminating (SIGTERM) 23:28:12.017194 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29694): Terminating (SIGTERM) 23:28:12.056652 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29697): Terminating (SIGTERM) 23:28:12.096266 --- ParallelTerminationStrategy: PID 29691 died... 23:28:12.115287 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29691): Terminated: ok {rc=0} 23:28:12.159192 --- ParallelTerminationStrategy: PID 29694 died... 23:28:12.177542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29694): Terminated: ok {rc=0} 23:28:12.221112 --- ParallelTerminationStrategy: PID 29697 died... 23:28:12.239660 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29697): Terminated: ok {rc=0} 23:28:12.323077 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2366 gprs:oc2g+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 gprs:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 23:28:13.620317 tst gprs:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:28:13.628728 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 23:28:13.653512 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 23:28:13.691159 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 23:28:13.775478 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 23:28:13.797187 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 23:28:13.838676 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 23:28:14.428727 tst gprs:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2366 gprs:oc2g+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 23:28:14.477394 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:14.488231 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:28:14.542230 tst cs_paging_gprs_active.py: using LAC 24407 23:28:14.659334 tst cs_paging_gprs_active.py: using RAC 182 23:28:14.773323 tst cs_paging_gprs_active.py: using CellId 24407 23:28:14.887719 tst cs_paging_gprs_active.py: using BVCI 24408 23:28:14.994969 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:15.006008 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:15.016590 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:15.027249 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:15.037821 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:15.048425 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:15.059212 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:15.069772 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:15.080470 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:28:15.198003 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:28:15.313149 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:28:15.512215 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:28:15.809212 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29702): Launched 23:28:16.167491 run iperf3-srv_10.42.42.10(pid=29703): Launched 23:28:16.354041 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:28:16.580461 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:28:16.920044 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29704): Launched 23:28:17.211589 run iperf3-srv_10.42.42.10(pid=29705): Launched 23:28:17.331435 tst cs_paging_gprs_active.py:38: start network... 23:28:17.545989 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:28:18.038502 run create_hlr_db(pid=29706): Launched 23:28:18.159934 bus /gobi_6: Setting Powered False 23:28:19.222392 run create_hlr_db(pid=29706): Terminated: ok {rc=0} 23:28:19.647327 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29708): Launched 23:28:19.945237 run osmo-hlr_10.42.42.2(pid=29709): Launched 23:28:20.057630 run osmo-stp_10.42.42.5: Starting osmo-stp 23:28:20.566585 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29711): Launched 23:28:20.862575 run osmo-stp_10.42.42.5(pid=29712): Launched 23:28:20.975116 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:28:21.486352 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29714): Launched 23:28:21.599667 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:28:21.850466 run patchelf(pid=29715): Launched 23:28:22.014642 run osmo-stp_10.42.42.5(pid=29712): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29712)] 23:28:22.139972 run osmo-stp_10.42.42.5(pid=29712): stdout: | (launched: 2022-12-09_23:28:20.808522) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:28:22.267226 run osmo-stp_10.42.42.5(pid=29712): stderr: | 20221209232820979 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232820979 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232820979 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232820979 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232820980 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232820980 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232820980 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:28:22.394877 run osmo-stp_10.42.42.5(pid=29712): stdout: | (launched: 2022-12-09_23:28:20.808522) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:28:22.516231 run osmo-stp_10.42.42.5(pid=29712): stderr: | 20221209232820979 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232820979 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232820979 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232820979 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232820980 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232820980 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232820980 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:28:22.659860 run patchelf(pid=29715): Terminating (SIGINT) 23:28:22.827008 run patchelf(pid=29715): Terminated: ok {rc=0} 23:28:22.947241 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29712): Process ended prematurely: osmo-stp_10.42.42.5(pid=29712) [trial-2366↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29712)] [trial-2366↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 23:28:22.956755 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 23:28:22.983409 run osmo-hlr_10.42.42.2(pid=29709): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29709)] 23:28:23.030708 run osmo-hlr_10.42.42.2(pid=29709): stdout: | (launched: 2022-12-09_23:28:19.891179) 23:28:23.079315 run osmo-hlr_10.42.42.2(pid=29709): stderr: | 20221209232820068 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209232820068 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209232820068 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209232820068 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209232820069 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209232820069 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209232820081 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:oc2g+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209232820090 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209232820090 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209232820090 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:28:23.128648 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29702): Terminating (SIGTERM) 23:28:23.167916 run iperf3-srv_10.42.42.10(pid=29703): Terminating (SIGTERM) 23:28:23.207019 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29704): Terminating (SIGTERM) 23:28:23.246289 run iperf3-srv_10.42.42.10(pid=29705): Terminating (SIGTERM) 23:28:23.285531 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29708): Terminating (SIGTERM) 23:28:23.324784 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29711): Terminating (SIGTERM) 23:28:23.364033 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29714): Terminating (SIGTERM) 23:28:23.403213 --- ParallelTerminationStrategy: PID 29702 died... 23:28:23.421562 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29702): Terminated: ok {rc=0} 23:28:23.464758 --- ParallelTerminationStrategy: PID 29703 died... 23:28:23.482829 run iperf3-srv_10.42.42.10(pid=29703): Terminated {rc=256} 23:28:23.525742 --- ParallelTerminationStrategy: PID 29704 died... 23:28:23.544000 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29704): Terminated: ok {rc=0} 23:28:23.586832 --- ParallelTerminationStrategy: PID 29705 died... 23:28:23.605072 run iperf3-srv_10.42.42.10(pid=29705): Terminated {rc=256} 23:28:23.648114 --- ParallelTerminationStrategy: PID 29708 died... 23:28:23.666513 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29708): Terminated: ok {rc=0} 23:28:23.709612 --- ParallelTerminationStrategy: PID 29711 died... 23:28:23.728292 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29711): Terminated: ok {rc=0} 23:28:23.771485 --- ParallelTerminationStrategy: PID 29714 died... 23:28:23.789916 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29714): Terminated: ok {rc=0} 23:28:23.873686 bus /gobi_0: Setting Powered False 23:28:24.973171 bus /gobi_0: Setting Powered False 23:28:26.088212 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:oc2g+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 23:28:27.235453 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:27.247181 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:28:27.308601 tst iperf3.py: using LAC 24408 23:28:27.434433 tst iperf3.py: using RAC 183 23:28:27.559625 tst iperf3.py: using CellId 24408 23:28:27.683800 tst iperf3.py: using BVCI 24409 23:28:27.798888 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:27.810234 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:27.821643 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:27.832773 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:27.843916 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:27.855113 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:27.866515 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:27.877680 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:27.888754 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:28:28.003524 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:28:28.203022 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:28:28.499110 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29716): Launched 23:28:28.756195 run iperf3-srv_10.42.42.10(pid=29717): Launched 23:28:28.867209 tst iperf3.py:8: start network... 23:28:29.065173 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:28:29.554821 run create_hlr_db(pid=29718): Launched 23:28:29.675204 bus /gobi_6: Setting Powered False 23:28:30.738031 run create_hlr_db(pid=29718): Terminated: ok {rc=0} 23:28:31.221713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29720): Launched 23:28:31.555738 run osmo-hlr_10.42.42.2(pid=29721): Launched 23:28:31.826729 run osmo-stp_10.42.42.5: Starting osmo-stp 23:28:32.440891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29723): Launched 23:28:32.756259 run osmo-stp_10.42.42.5(pid=29724): Launched 23:28:32.877656 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:28:33.424161 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29726): Launched 23:28:33.541348 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:28:33.791064 run patchelf(pid=29727): Launched 23:28:33.956218 run osmo-stp_10.42.42.5(pid=29724): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29724)] 23:28:34.081599 run osmo-stp_10.42.42.5(pid=29724): stdout: | (launched: 2022-12-09_23:28:32.699420) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:28:34.208893 run osmo-stp_10.42.42.5(pid=29724): stderr: | 20221209232832891 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232832891 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232832891 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232832891 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232832892 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232832892 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232832892 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:28:34.336913 run osmo-stp_10.42.42.5(pid=29724): stdout: | (launched: 2022-12-09_23:28:32.699420) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:28:34.458554 run osmo-stp_10.42.42.5(pid=29724): stderr: | 20221209232832891 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232832891 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232832891 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232832891 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232832892 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232832892 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232832892 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:28:34.602746 run patchelf(pid=29727): Terminating (SIGINT) 23:28:34.769233 run patchelf(pid=29727): Terminated: ok {rc=0} 23:28:34.889223 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29724): Process ended prematurely: osmo-stp_10.42.42.5(pid=29724) [trial-2366↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29724)] [trial-2366↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8] 23:28:34.898580 tst iperf3.py:8: Test FAILED (7.7 sec) 23:28:34.924903 run osmo-hlr_10.42.42.2(pid=29721): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29721)] 23:28:34.971558 run osmo-hlr_10.42.42.2(pid=29721): stdout: | (launched: 2022-12-09_23:28:31.491973) 23:28:35.020160 run osmo-hlr_10.42.42.2(pid=29721): stderr: | 20221209232831724 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209232831724 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209232831724 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209232831724 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209232831724 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209232831724 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209232831748 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:oc2g+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209232831761 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209232831761 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209232831761 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:28:35.069203 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29716): Terminating (SIGTERM) 23:28:35.108234 run iperf3-srv_10.42.42.10(pid=29717): Terminating (SIGTERM) 23:28:35.147333 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29720): Terminating (SIGTERM) 23:28:35.186286 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29723): Terminating (SIGTERM) 23:28:35.225408 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29726): Terminating (SIGTERM) 23:28:35.265168 --- ParallelTerminationStrategy: PID 29716 died... 23:28:35.284201 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29716): Terminated: ok {rc=0} 23:28:35.328448 --- ParallelTerminationStrategy: PID 29717 died... 23:28:35.347103 run iperf3-srv_10.42.42.10(pid=29717): Terminated {rc=256} 23:28:35.390799 --- ParallelTerminationStrategy: PID 29720 died... 23:28:35.409279 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29720): Terminated: ok {rc=0} 23:28:35.452761 --- ParallelTerminationStrategy: PID 29723 died... 23:28:35.471365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29723): Terminated: ok {rc=0} 23:28:35.514894 --- ParallelTerminationStrategy: PID 29726 died... 23:28:35.533515 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29726): Terminated: ok {rc=0} 23:28:35.619040 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:oc2g+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 23:28:36.769258 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:36.780792 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:28:36.836132 tst iperf3m4.py: using LAC 24409 23:28:36.953137 tst iperf3m4.py: using RAC 184 23:28:37.069435 tst iperf3m4.py: using CellId 24409 23:28:37.185750 tst iperf3m4.py: using BVCI 24410 23:28:37.295214 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:37.306170 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:37.316690 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:37.327328 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:37.337889 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:37.348433 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:37.359329 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:37.369861 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:37.380462 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:28:37.498343 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:28:37.618972 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:28:37.736524 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:28:37.857319 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:28:38.072449 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:28:38.391553 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29728): Launched 23:28:38.667409 run iperf3-srv_10.42.42.10(pid=29729): Launched 23:28:38.785872 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:28:39.000071 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:28:39.318519 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29730): Launched 23:28:39.594161 run iperf3-srv_10.42.42.10(pid=29731): Launched 23:28:39.712782 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:28:39.927373 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:28:40.246243 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29732): Launched 23:28:40.521700 run iperf3-srv_10.42.42.10(pid=29733): Launched 23:28:40.641154 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:28:40.856318 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:28:41.175709 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29734): Launched 23:28:41.451251 run iperf3-srv_10.42.42.10(pid=29735): Launched 23:28:41.569755 tst iperf3m4.py:8: start network... 23:28:41.783604 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:28:42.275404 run create_hlr_db(pid=29736): Launched 23:28:42.395966 bus /gobi_6: Setting Powered False 23:28:43.458669 run create_hlr_db(pid=29736): Terminated: ok {rc=0} 23:28:43.882335 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29738): Launched 23:28:44.177325 run osmo-hlr_10.42.42.2(pid=29739): Launched 23:28:44.290332 run osmo-stp_10.42.42.5: Starting osmo-stp 23:28:44.817946 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29741): Launched 23:28:45.112901 run osmo-stp_10.42.42.5(pid=29742): Launched 23:28:45.224735 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:28:45.735133 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29744): Launched 23:28:45.864786 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:28:46.138740 run patchelf(pid=29745): Launched 23:28:46.317575 run osmo-stp_10.42.42.5(pid=29742): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29742)] 23:28:46.445612 run osmo-stp_10.42.42.5(pid=29742): stdout: | (launched: 2022-12-09_23:28:45.058745) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:28:46.575438 run osmo-stp_10.42.42.5(pid=29742): stderr: | 20221209232845229 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232845230 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232845230 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232845230 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232845231 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232845231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232845231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:28:46.705553 run osmo-stp_10.42.42.5(pid=29742): stdout: | (launched: 2022-12-09_23:28:45.058745) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:28:46.829213 run osmo-stp_10.42.42.5(pid=29742): stderr: | 20221209232845229 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232845230 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232845230 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232845230 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232845231 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232845231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232845231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:28:46.979820 run patchelf(pid=29745): Terminating (SIGINT) 23:28:47.149828 run patchelf(pid=29745): Terminated: ok {rc=0} 23:28:47.271660 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29742): Process ended prematurely: osmo-stp_10.42.42.5(pid=29742) [trial-2366↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29742)] [trial-2366↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8] 23:28:47.281702 tst iperf3m4.py:8: Test FAILED (10.6 sec) 23:28:47.308582 run osmo-hlr_10.42.42.2(pid=29739): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29739)] 23:28:47.355667 run osmo-hlr_10.42.42.2(pid=29739): stdout: | (launched: 2022-12-09_23:28:44.123650) 23:28:47.404713 run osmo-hlr_10.42.42.2(pid=29739): stderr: | 20221209232844297 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209232844298 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209232844298 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209232844298 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209232844298 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209232844298 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209232844310 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:oc2g+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209232844319 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209232844319 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209232844319 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:28:47.453758 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29728): Terminating (SIGTERM) 23:28:47.493095 run iperf3-srv_10.42.42.10(pid=29729): Terminating (SIGTERM) 23:28:47.532200 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29730): Terminating (SIGTERM) 23:28:47.571292 run iperf3-srv_10.42.42.10(pid=29731): Terminating (SIGTERM) 23:28:47.610540 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29732): Terminating (SIGTERM) 23:28:47.649814 run iperf3-srv_10.42.42.10(pid=29733): Terminating (SIGTERM) 23:28:47.689018 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29734): Terminating (SIGTERM) 23:28:47.728222 run iperf3-srv_10.42.42.10(pid=29735): Terminating (SIGTERM) 23:28:47.767398 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29738): Terminating (SIGTERM) 23:28:47.806620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29741): Terminating (SIGTERM) 23:28:47.845757 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29744): Terminating (SIGTERM) 23:28:47.885139 --- ParallelTerminationStrategy: PID 29728 died... 23:28:47.903814 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29728): Terminated: ok {rc=0} 23:28:47.948142 --- ParallelTerminationStrategy: PID 29729 died... 23:28:47.966693 run iperf3-srv_10.42.42.10(pid=29729): Terminated {rc=256} 23:28:48.009861 --- ParallelTerminationStrategy: PID 29730 died... 23:28:48.028284 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29730): Terminated: ok {rc=0} 23:28:48.071663 --- ParallelTerminationStrategy: PID 29731 died... 23:28:48.089993 run iperf3-srv_10.42.42.10(pid=29731): Terminated {rc=256} 23:28:48.133118 --- ParallelTerminationStrategy: PID 29732 died... 23:28:48.151467 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29732): Terminated: ok {rc=0} 23:28:48.194881 --- ParallelTerminationStrategy: PID 29733 died... 23:28:48.213219 run iperf3-srv_10.42.42.10(pid=29733): Terminated {rc=256} 23:28:48.256338 --- ParallelTerminationStrategy: PID 29734 died... 23:28:48.274686 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29734): Terminated: ok {rc=0} 23:28:48.317804 --- ParallelTerminationStrategy: PID 29735 died... 23:28:48.336235 run iperf3-srv_10.42.42.10(pid=29735): Terminated {rc=256} 23:28:48.379368 --- ParallelTerminationStrategy: PID 29738 died... 23:28:48.397870 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29738): Terminated: ok {rc=0} 23:28:48.441462 --- ParallelTerminationStrategy: PID 29741 died... 23:28:48.459929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29741): Terminated: ok {rc=0} 23:28:48.504216 --- ParallelTerminationStrategy: PID 29744 died... 23:28:48.522946 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29744): Terminated: ok {rc=0} 23:28:48.607356 bus /gobi_4: Setting Powered False 23:28:49.707480 bus /gobi_4: Setting Powered False 23:28:50.823154 bus /gobi_1: Setting Powered False 23:28:51.921670 bus /gobi_1: Setting Powered False 23:28:53.037603 bus /gobi_0: Setting Powered False 23:28:54.136910 bus /gobi_0: Setting Powered False 23:28:55.253433 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:oc2g+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 23:28:56.356039 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:56.367389 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:28:56.424164 tst ping.py: using LAC 24410 23:28:56.548625 tst ping.py: using RAC 185 23:28:56.674359 tst ping.py: using CellId 24410 23:28:56.796887 tst ping.py: using BVCI 24411 23:28:56.910867 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:56.922358 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:56.933692 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:56.945302 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:56.956643 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:56.968001 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:56.979620 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:28:56.991336 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:28:57.106816 tst ping.py:19: start network... 23:28:57.301412 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:28:57.751481 run create_hlr_db(pid=29746): Launched 23:28:57.870520 bus /gobi_6: Setting Powered False 23:28:58.929500 run create_hlr_db(pid=29746): Terminated: ok {rc=0} 23:28:59.355525 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29748): Launched 23:28:59.667527 run osmo-hlr_10.42.42.2(pid=29749): Launched 23:28:59.786908 run osmo-stp_10.42.42.5: Starting osmo-stp 23:29:00.329743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29751): Launched 23:29:00.641159 run osmo-stp_10.42.42.5(pid=29752): Launched 23:29:00.760361 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:29:01.379087 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29754): Launched 23:29:01.499830 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:29:01.766957 run patchelf(pid=29755): Launched 23:29:01.933880 run osmo-stp_10.42.42.5(pid=29752): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29752)] 23:29:02.061799 run osmo-stp_10.42.42.5(pid=29752): stdout: | (launched: 2022-12-09_23:29:00.584804) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:29:02.190214 run osmo-stp_10.42.42.5(pid=29752): stderr: | 20221209232900774 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232900774 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232900774 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232900775 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232900775 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232900775 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232900775 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:29:02.317290 run osmo-stp_10.42.42.5(pid=29752): stdout: | (launched: 2022-12-09_23:29:00.584804) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:29:02.436809 run osmo-stp_10.42.42.5(pid=29752): stderr: | 20221209232900774 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232900774 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232900774 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232900775 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232900775 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232900775 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232900775 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:29:02.577883 run patchelf(pid=29755): Terminating (SIGINT) 23:29:02.740154 run patchelf(pid=29755): Terminated: ok {rc=0} 23:29:02.857537 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29752): Process ended prematurely: osmo-stp_10.42.42.5(pid=29752) [trial-2366↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29752)] [trial-2366↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22] 23:29:02.866347 tst ping.py:22: Test FAILED (6.5 sec) 23:29:02.892733 run osmo-hlr_10.42.42.2(pid=29749): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29749)] 23:29:02.940509 run osmo-hlr_10.42.42.2(pid=29749): stdout: | (launched: 2022-12-09_23:28:59.611190) 23:29:02.990112 run osmo-hlr_10.42.42.2(pid=29749): stderr: | 20221209232859806 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209232859806 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209232859806 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209232859806 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209232859806 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209232859806 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209232859818 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:oc2g+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209232859826 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209232859827 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209232859827 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:29:03.040065 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29748): Terminating (SIGTERM) 23:29:03.080034 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29751): Terminating (SIGTERM) 23:29:03.119888 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29754): Terminating (SIGTERM) 23:29:03.159809 --- ParallelTerminationStrategy: PID 29748 died... 23:29:03.179024 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29748): Terminated: ok {rc=0} 23:29:03.223209 --- ParallelTerminationStrategy: PID 29751 died... 23:29:03.241899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29751): Terminated: ok {rc=0} 23:29:03.285972 --- ParallelTerminationStrategy: PID 29754 died... 23:29:03.304506 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29754): Terminated: ok {rc=0} 23:29:03.388341 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:oc2g+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 23:29:04.475146 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:29:04.487537 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:29:04.550301 tst ping_idle_ping.py: using LAC 24411 23:29:04.669459 tst ping_idle_ping.py: using RAC 186 23:29:04.785723 tst ping_idle_ping.py: using CellId 24411 23:29:04.902535 tst ping_idle_ping.py: using BVCI 24412 23:29:05.010305 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:29:05.021125 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:29:05.031653 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:29:05.042211 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:29:05.052677 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:29:05.063177 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:29:05.073808 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:29:05.084269 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:29:05.200935 tst ping_idle_ping.py:24: start network... 23:29:05.414449 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:29:05.907635 run create_hlr_db(pid=29756): Launched 23:29:06.027623 bus /gobi_6: Setting Powered False 23:29:07.089785 run create_hlr_db(pid=29756): Terminated: ok {rc=0} 23:29:07.526535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29758): Launched 23:29:07.837834 run osmo-hlr_10.42.42.2(pid=29759): Launched 23:29:07.957363 run osmo-stp_10.42.42.5: Starting osmo-stp 23:29:08.499009 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29761): Launched 23:29:08.810292 run osmo-stp_10.42.42.5(pid=29762): Launched 23:29:08.930857 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:29:09.471048 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29764): Launched 23:29:09.590522 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:29:09.854172 run patchelf(pid=29765): Launched 23:29:10.027394 run osmo-stp_10.42.42.5(pid=29762): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29762)] 23:29:10.160123 run osmo-stp_10.42.42.5(pid=29762): stdout: | (launched: 2022-12-09_23:29:08.753787) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:29:10.294634 run osmo-stp_10.42.42.5(pid=29762): stderr: | 20221209232908943 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232908943 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232908943 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232908944 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232908946 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232908946 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232908946 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:29:10.429482 run osmo-stp_10.42.42.5(pid=29762): stdout: | (launched: 2022-12-09_23:29:08.753787) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:29:10.557714 run osmo-stp_10.42.42.5(pid=29762): stderr: | 20221209232908943 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232908943 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232908943 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232908944 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232908946 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232908946 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232908946 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:29:10.709897 run patchelf(pid=29765): Terminating (SIGINT) 23:29:10.885174 run patchelf(pid=29765): Terminated: ok {rc=0} 23:29:11.011511 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29762): Process ended prematurely: osmo-stp_10.42.42.5(pid=29762) [trial-2366↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29762)] [trial-2366↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 23:29:11.021544 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 23:29:11.049300 run osmo-hlr_10.42.42.2(pid=29759): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29759)] 23:29:11.100131 run osmo-hlr_10.42.42.2(pid=29759): stdout: | (launched: 2022-12-09_23:29:07.781563) 23:29:11.152230 run osmo-hlr_10.42.42.2(pid=29759): stderr: | 20221209232907978 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209232907978 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209232907978 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209232907978 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209232907978 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209232907979 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209232907991 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:oc2g+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209232908000 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209232908000 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209232908000 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:29:11.204688 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29758): Terminating (SIGTERM) 23:29:11.247022 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29761): Terminating (SIGTERM) 23:29:11.289151 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29764): Terminating (SIGTERM) 23:29:11.331348 --- ParallelTerminationStrategy: PID 29758 died... 23:29:11.351407 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29758): Terminated: ok {rc=0} 23:29:11.398615 --- ParallelTerminationStrategy: PID 29761 died... 23:29:11.418357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29761): Terminated: ok {rc=0} 23:29:11.464853 --- ParallelTerminationStrategy: PID 29764 died... 23:29:11.484638 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29764): Terminated: ok {rc=0} 23:29:11.571987 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2366 gprs:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 23:29:12.862423 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:29:12.870120 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 23:29:12.890302 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 23:29:12.924902 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 23:29:12.983411 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 23:29:13.003606 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 23:29:13.037256 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 23:29:13.589226 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2366 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 23:29:13.594123 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:29:13.605120 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 23:29:13.658876 tst switch_tch_pdch.py: using LAC 24412 23:29:13.774210 tst switch_tch_pdch.py: using RAC 187 23:29:13.886696 tst switch_tch_pdch.py: using CellId 24412 23:29:13.999380 tst switch_tch_pdch.py: using BVCI 24413 23:29:14.115084 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:29:14.127236 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:29:14.139254 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:29:14.151625 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:29:14.163721 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:29:14.175665 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:29:14.187646 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:29:14.199484 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:29:14.313861 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:29:14.429977 tst switch_tch_pdch.py:51: start network... 23:29:14.624274 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:29:15.073463 run create_hlr_db(pid=29769): Launched 23:29:15.192453 bus /gobi_6: Setting Powered False 23:29:16.267340 run create_hlr_db(pid=29769): Terminated: ok {rc=0} 23:29:16.774489 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29771): Launched 23:29:17.112063 run osmo-hlr_10.42.42.2(pid=29772): Launched 23:29:17.284234 run osmo-stp_10.42.42.5: Starting osmo-stp 23:29:17.784647 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29774): Launched 23:29:18.073602 run osmo-stp_10.42.42.5(pid=29775): Launched 23:29:18.185187 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:29:18.687568 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29777): Launched 23:29:18.798088 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:29:19.042688 run patchelf(pid=29778): Launched 23:29:19.203287 run osmo-stp_10.42.42.5(pid=29775): ERR: Terminated: ERROR {rc=1} [trial-2366↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29775)] 23:29:19.325814 run osmo-stp_10.42.42.5(pid=29775): stdout: | (launched: 2022-12-09_23:29:18.020942) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:29:19.450518 run osmo-stp_10.42.42.5(pid=29775): stderr: | 20221209232918188 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232918188 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232918188 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232918189 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232918189 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232918189 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232918189 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:29:19.575012 run osmo-stp_10.42.42.5(pid=29775): stdout: | (launched: 2022-12-09_23:29:18.020942) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:29:19.693998 run osmo-stp_10.42.42.5(pid=29775): stderr: | 20221209232918188 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232918188 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232918188 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232918189 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232918189 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232918189 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232918189 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:29:19.834776 run patchelf(pid=29778): Terminating (SIGINT) 23:29:19.997461 run patchelf(pid=29778): Terminated: ok {rc=0} 23:29:20.114646 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=29775): Process ended prematurely: osmo-stp_10.42.42.5(pid=29775) [trial-2366↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29775)] [trial-2366↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 23:29:20.123268 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 23:29:20.149486 run osmo-hlr_10.42.42.2(pid=29772): ERR: Terminated: ERROR {rc=237} [trial-2366↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29772)] 23:29:20.197505 run osmo-hlr_10.42.42.2(pid=29772): stdout: | (launched: 2022-12-09_23:29:17.041698) 23:29:20.246363 run osmo-hlr_10.42.42.2(pid=29772): stderr: | 20221209232917288 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209232917288 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209232917288 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209232917288 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209232917288 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209232917288 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209232917321 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209232917331 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209232917332 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209232917332 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:29:20.295434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29771): Terminating (SIGTERM) 23:29:20.334416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29774): Terminating (SIGTERM) 23:29:20.373457 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29777): Terminating (SIGTERM) 23:29:20.413153 --- ParallelTerminationStrategy: PID 29771 died... 23:29:20.432019 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29771): Terminated: ok {rc=0} 23:29:20.475418 --- ParallelTerminationStrategy: PID 29774 died... 23:29:20.493573 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29774): Terminated: ok {rc=0} 23:29:20.536840 --- ParallelTerminationStrategy: PID 29777 died... 23:29:20.555520 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29777): Terminated: ok {rc=0} 23:29:20.639171 bus /gobi_0: Setting Powered False 23:29:21.739569 bus /gobi_0: Setting Powered False 23:29:22.853273 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2366 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 dynts:oc2g+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 23:29:24.088312 tst dynts:oc2g+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:29:24.095435 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 23:29:24.116642 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 23:29:24.152465 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 23:29:24.205776 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 23:29:24.227073 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 23:29:24.263107 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 23:29:24.817609 tst dynts:oc2g+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2366 dynts:oc2g+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 23:29:24.824499 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:29:24.835875 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 23:29:24.899096 tst switch_tch_pdch.py: using LAC 24413 23:29:25.013249 tst switch_tch_pdch.py: using RAC 188 23:29:25.136208 tst switch_tch_pdch.py: using CellId 24413 23:29:25.257316 tst switch_tch_pdch.py: using BVCI 24414 23:29:25.370510 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:29:25.382024 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:29:25.393309 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:29:25.404617 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:29:25.416062 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:29:25.427268 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:29:25.438942 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:29:25.450277 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 23:29:25.568807 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 23:29:25.688086 tst switch_tch_pdch.py:51: start network... 23:29:25.897691 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:29:26.352862 run create_hlr_db(pid=29782): Launched 23:29:26.472064 bus /gobi_6: Setting Powered False 23:29:27.535247 run create_hlr_db(pid=29782): Terminated: ok {rc=0} 23:29:27.942264 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29784): Launched 23:29:28.252923 run osmo-hlr_10.42.42.2(pid=29785): Launched 23:29:28.373287 run osmo-stp_10.42.42.5: Starting osmo-stp 23:29:28.880537 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29787): Launched 23:29:29.190361 run osmo-stp_10.42.42.5(pid=29788): Launched 23:29:29.309539 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:29:29.820640 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29790): Launched 23:29:29.940300 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:29:30.203183 run patchelf(pid=29791): Launched 23:29:30.376738 run osmo-stp_10.42.42.5(pid=29788): ERR: Terminated: ERROR {rc=1} [trial-2366↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29788)] 23:29:30.509182 run osmo-stp_10.42.42.5(pid=29788): stdout: | (launched: 2022-12-09_23:29:29.134383) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:29:30.643441 run osmo-stp_10.42.42.5(pid=29788): stderr: | 20221209232929322 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232929322 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232929323 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232929323 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232929324 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232929324 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232929324 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:29:30.777788 run osmo-stp_10.42.42.5(pid=29788): stdout: | (launched: 2022-12-09_23:29:29.134383) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:29:30.914110 run osmo-stp_10.42.42.5(pid=29788): stderr: | 20221209232929322 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232929322 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232929323 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232929323 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232929324 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232929324 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232929324 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:29:31.069504 run patchelf(pid=29791): Terminating (SIGINT) 23:29:31.247392 run patchelf(pid=29791): Terminated: ok {rc=0} 23:29:31.376928 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=29788): Process ended prematurely: osmo-stp_10.42.42.5(pid=29788) [trial-2366↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29788)] [trial-2366↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 23:29:31.387651 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 23:29:31.419184 run osmo-hlr_10.42.42.2(pid=29785): ERR: Terminated: ERROR {rc=237} [trial-2366↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29785)] 23:29:31.471962 run osmo-hlr_10.42.42.2(pid=29785): stdout: | (launched: 2022-12-09_23:29:28.196326) 23:29:31.526429 run osmo-hlr_10.42.42.2(pid=29785): stderr: | 20221209232928391 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209232928391 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209232928391 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209232928391 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209232928391 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209232928391 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209232928403 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/dynts:oc2g+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209232928412 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209232928412 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209232928412 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:29:31.581826 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29784): Terminating (SIGTERM) 23:29:31.626395 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29787): Terminating (SIGTERM) 23:29:31.671252 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29790): Terminating (SIGTERM) 23:29:31.717113 --- ParallelTerminationStrategy: PID 29784 died... 23:29:31.738064 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29784): Terminated: ok {rc=0} 23:29:31.787521 --- ParallelTerminationStrategy: PID 29787 died... 23:29:31.808081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29787): Terminated: ok {rc=0} 23:29:31.857428 --- ParallelTerminationStrategy: PID 29790 died... 23:29:31.877796 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29790): Terminated: ok {rc=0} 23:29:31.968742 bus /gobi_0: Setting Powered False 23:29:33.067905 bus /gobi_0: Setting Powered False 23:29:34.181684 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2366 dynts:oc2g+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 nitb_sms:trx-b200 --------------------------------------------------------------------- 23:29:35.412338 tst nitb_sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:29:35.417052 tst nitb_sms:trx-b200: Verifying 1 x bts (candidates: 11) 23:29:35.449437 tst nitb_sms:trx-b200: Verifying 1 x ip_address (candidates: 9) 23:29:35.456014 tst nitb_sms:trx-b200: Verifying 2 x modem (candidates: 12) 23:29:35.506712 tst nitb_sms:trx-b200: Reserving 1 x bts (candidates: 11) 23:29:35.538855 tst nitb_sms:trx-b200: Reserving 1 x ip_address (candidates: 9) 23:29:35.545442 tst nitb_sms:trx-b200: Reserving 2 x modem (candidates: 12) 23:29:36.086461 tst nitb_sms:trx-b200: RESERVED RESOURCES for nitb_sms: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 nitb_sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 23:29:36.091220 tst nitb_sms:trx-b200: Using 1 x ip_address (candidates: 1) 23:29:36.102213 tst nitb_sms:trx-b200: Using 1 x bts (candidates: 1) 23:29:36.150237 tst mo_mt_sms.py: using LAC 24414 23:29:36.264215 tst mo_mt_sms.py: using RAC 189 23:29:36.380065 tst mo_mt_sms.py: using CellId 24414 23:29:36.496656 tst mo_mt_sms.py: using BVCI 24415 23:29:36.601709 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 23:29:36.717395 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 23:29:36.830580 tst mo_mt_sms.py:9: start nitb and bts... 23:29:37.026073 run osmo-nitb_10.42.42.2: Starting osmo-nitb 23:29:37.620077 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29797): Launched 23:29:37.909714 run osmo-nitb_10.42.42.2(pid=29798): Launched 23:29:38.070496 run osmo-nitb_10.42.42.2(pid=29798): ERR: Terminated: ERROR {rc=2} [trial-2366↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29798)] 23:29:38.202043 run osmo-nitb_10.42.42.2(pid=29798): stdout: | (launched: 2022-12-09_23:29:37.856841) 23:29:38.334797 run osmo-nitb_10.42.42.2(pid=29798): stderr: | (launched: 2022-12-09_23:29:37.900019) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:29:38.467268 run osmo-nitb_10.42.42.2(pid=29798): stdout: | (launched: 2022-12-09_23:29:37.856841) 23:29:38.594011 run osmo-nitb_10.42.42.2(pid=29798): stderr: | (launched: 2022-12-09_23:29:37.900019) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=29798): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29798) [trial-2366↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29798)] 23:29:39.019697 tst osmo-nitb_10.42.42.2(pid=29798): stdout: | (launched: 2022-12-09_23:29:37.856841) 23:29:39.137546 tst osmo-nitb_10.42.42.2(pid=29798): stderr: | (launched: 2022-12-09_23:29:37.900019) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:29:39.275594 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=29798): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29798) [trial-2366↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29798)] [trial-2366↪nitb_sms:trx-b200↪mo_mt_sms.py:11] 23:29:39.284186 tst mo_mt_sms.py:11: Test FAILED (3.2 sec) 23:29:39.290960 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29797): Terminating (SIGTERM) 23:29:39.499321 --- ParallelTerminationStrategy: PID 29797 died... 23:29:39.520046 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29797): Terminated: ok {rc=0} 23:29:39.605222 bus /sierra_3: Setting Powered False 23:29:40.705822 bus /sierra_3: Setting Powered False 23:29:41.819942 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 nitb_sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 sms:trx-b200 --------------------------------------------------------------------- 23:29:43.019992 tst sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:29:43.024267 tst sms:trx-b200: Verifying 1 x bts (candidates: 11) 23:29:43.058722 tst sms:trx-b200: Verifying 6 x ip_address (candidates: 9) 23:29:43.085776 tst sms:trx-b200: Verifying 2 x modem (candidates: 12) 23:29:43.136596 tst sms:trx-b200: Reserving 1 x bts (candidates: 11) 23:29:43.169228 tst sms:trx-b200: Reserving 6 x ip_address (candidates: 9) 23:29:43.195976 tst sms:trx-b200: Reserving 2 x modem (candidates: 12) 23:29:43.743322 tst sms:trx-b200: RESERVED RESOURCES for sms: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 23:29:43.748369 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 23:29:43.758974 tst sms:trx-b200: Using 1 x bts (candidates: 1) 23:29:43.805402 tst mo_mt_sms.py: using LAC 24415 23:29:43.928875 tst mo_mt_sms.py: using RAC 190 23:29:44.050603 tst mo_mt_sms.py: using CellId 24415 23:29:44.175599 tst mo_mt_sms.py: using BVCI 24416 23:29:44.289747 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 23:29:44.300789 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 23:29:44.311632 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 23:29:44.322570 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 23:29:44.333556 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 23:29:44.344779 tst sms:trx-b200: Using 1 x modem (candidates: 2) 23:29:44.461506 tst sms:trx-b200: Using 1 x modem (candidates: 2) 23:29:44.577276 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:29:45.058954 run create_hlr_db(pid=29803): Launched 23:29:45.176487 bus /sierra_2: Setting Powered False 23:29:46.241942 run create_hlr_db(pid=29803): Terminated: ok {rc=0} 23:29:46.671719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29805): Launched 23:29:46.993700 run osmo-hlr_10.42.42.2(pid=29806): Launched 23:29:47.240747 run osmo-stp_10.42.42.5: Starting osmo-stp 23:29:47.774027 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29808): Launched 23:29:48.083711 run osmo-stp_10.42.42.5(pid=29809): Launched 23:29:48.202933 run osmo-msc_10.42.42.6: Starting osmo-msc 23:29:48.769070 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29811): Launched 23:29:49.078535 run osmo-msc_10.42.42.6(pid=29812): Launched 23:29:49.251184 run osmo-stp_10.42.42.5(pid=29809): ERR: Terminated: ERROR {rc=1} [trial-2366↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29809)] 23:29:49.383214 run osmo-stp_10.42.42.5(pid=29809): stdout: | (launched: 2022-12-09_23:29:48.027587) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:29:49.515418 run osmo-stp_10.42.42.5(pid=29809): stderr: | 20221209232948219 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232948219 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232948219 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232948219 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232948220 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232948220 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232948220 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:29:49.647368 run osmo-stp_10.42.42.5(pid=29809): stdout: | (launched: 2022-12-09_23:29:48.027587) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:29:49.771758 run osmo-stp_10.42.42.5(pid=29809): stderr: | 20221209232948219 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209232948219 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209232948219 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209232948219 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209232948220 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209232948220 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209232948220 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:29:49.920245 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=29809): Process ended prematurely: osmo-stp_10.42.42.5(pid=29809) [trial-2366↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29809)] [trial-2366↪sms:trx-b200↪mo_mt_sms.py:16] 23:29:49.929255 tst mo_mt_sms.py:16: Test FAILED (6.2 sec) 23:29:49.957146 run osmo-hlr_10.42.42.2(pid=29806): ERR: Terminated: ERROR {rc=237} [trial-2366↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29806)] 23:29:50.007483 run osmo-hlr_10.42.42.2(pid=29806): stdout: | (launched: 2022-12-09_23:29:46.923448) 23:29:50.059486 run osmo-hlr_10.42.42.2(pid=29806): stderr: | 20221209232947195 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209232947195 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209232947195 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209232947195 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209232947195 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209232947195 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209232947210 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/sms:trx-b200/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209232947223 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209232947223 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209232947223 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:29:50.132057 run osmo-msc_10.42.42.6(pid=29812): ERR: Terminated: ERROR {rc=2} [trial-2366↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29812)] 23:29:50.182261 run osmo-msc_10.42.42.6(pid=29812): stdout: | (launched: 2022-12-09_23:29:49.022445) 23:29:50.234212 run osmo-msc_10.42.42.6(pid=29812): stderr: | 20221209232949339 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209232949339 DLGLOBAL DEBUG validating counter group 0x7f3bc1a6ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209232949340 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209232949340 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209232949340 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209232949340 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209232949344 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209232949344 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209232949345 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209232949345 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:29:50.286574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29805): Terminating (SIGTERM) 23:29:50.328764 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29808): Terminating (SIGTERM) 23:29:50.371027 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29811): Terminating (SIGTERM) 23:29:50.413911 --- ParallelTerminationStrategy: PID 29805 died... 23:29:50.434302 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29805): Terminated: ok {rc=0} 23:29:50.481240 --- ParallelTerminationStrategy: PID 29808 died... 23:29:50.500807 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29808): Terminated: ok {rc=0} 23:29:50.547502 --- ParallelTerminationStrategy: PID 29811 died... 23:29:50.567135 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29811): Terminated: ok {rc=0} 23:29:50.654983 bus /sierra_3: Setting Powered False 23:29:51.753706 bus /sierra_3: Setting Powered False 23:29:52.870421 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 nitb_ussd:trx-b200 --------------------------------------------------------------------- 23:29:54.095241 tst nitb_ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:29:54.099144 tst nitb_ussd:trx-b200: Verifying 1 x bts (candidates: 11) 23:29:54.131608 tst nitb_ussd:trx-b200: Verifying 1 x ip_address (candidates: 9) 23:29:54.138216 tst nitb_ussd:trx-b200: Verifying 1 x modem (candidates: 12) 23:29:54.172247 tst nitb_ussd:trx-b200: Reserving 1 x bts (candidates: 11) 23:29:54.206865 tst nitb_ussd:trx-b200: Reserving 1 x ip_address (candidates: 9) 23:29:54.213978 tst nitb_ussd:trx-b200: Reserving 1 x modem (candidates: 12) 23:29:54.731693 tst nitb_ussd:trx-b200: RESERVED RESOURCES for nitb_ussd: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2366 nitb_ussd:trx-b200 assert_extension.py ---------------------------------------------- 23:29:54.736691 tst nitb_ussd:trx-b200: Using 1 x ip_address (candidates: 1) 23:29:54.747461 tst nitb_ussd:trx-b200: Using 1 x bts (candidates: 1) 23:29:54.794179 tst assert_extension.py: using LAC 24416 23:29:54.909174 tst assert_extension.py: using RAC 191 23:29:55.021520 tst assert_extension.py: using CellId 24416 23:29:55.133573 tst assert_extension.py: using BVCI 24417 23:29:55.238234 tst nitb_ussd:trx-b200: Using 1 x modem (candidates: 1) 23:29:55.353999 tst assert_extension.py:10: start nitb and bts... 23:29:55.565631 run osmo-nitb_10.42.42.2: Starting osmo-nitb 23:29:56.201640 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29817): Launched 23:29:56.514349 run osmo-nitb_10.42.42.2(pid=29818): Launched 23:29:56.686508 run osmo-nitb_10.42.42.2(pid=29818): ERR: Terminated: ERROR {rc=2} [trial-2366↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29818)] 23:29:56.826404 run osmo-nitb_10.42.42.2(pid=29818): stdout: | (launched: 2022-12-09_23:29:56.457586) 23:29:56.967974 run osmo-nitb_10.42.42.2(pid=29818): stderr: | (launched: 2022-12-09_23:29:56.504549) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:29:57.109335 run osmo-nitb_10.42.42.2(pid=29818): stdout: | (launched: 2022-12-09_23:29:56.457586) 23:29:57.245454 run osmo-nitb_10.42.42.2(pid=29818): stderr: | (launched: 2022-12-09_23:29:56.504549) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=29818): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29818) [trial-2366↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29818)] 23:29:57.632036 tst osmo-nitb_10.42.42.2(pid=29818): stdout: | (launched: 2022-12-09_23:29:56.457586) 23:29:57.757939 tst osmo-nitb_10.42.42.2(pid=29818): stderr: | (launched: 2022-12-09_23:29:56.504549) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:29:57.906151 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=29818): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29818) [trial-2366↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29818)] [trial-2366↪nitb_ussd:trx-b200↪assert_extension.py:12] 23:29:57.915078 tst assert_extension.py:12: Test FAILED (3.2 sec) 23:29:57.922028 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29817): Terminating (SIGTERM) 23:29:58.132857 --- ParallelTerminationStrategy: PID 29817 died... 23:29:58.154019 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29817): Terminated: ok {rc=0} 23:29:58.240665 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 nitb_ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 ussd:trx-b200 --------------------------------------------------------------------- 23:29:59.417973 tst ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:29:59.422749 tst ussd:trx-b200: Verifying 1 x bts (candidates: 11) 23:29:59.456900 tst ussd:trx-b200: Verifying 6 x ip_address (candidates: 9) 23:29:59.484044 tst ussd:trx-b200: Verifying 1 x modem (candidates: 12) 23:29:59.520003 tst ussd:trx-b200: Reserving 1 x bts (candidates: 11) 23:29:59.554141 tst ussd:trx-b200: Reserving 6 x ip_address (candidates: 9) 23:29:59.581638 tst ussd:trx-b200: Reserving 1 x modem (candidates: 12) 23:30:00.110943 tst ussd:trx-b200: RESERVED RESOURCES for ussd: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2366 ussd:trx-b200 assert_extension.py ---------------------------------------------- 23:30:00.116243 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 23:30:00.127335 tst ussd:trx-b200: Using 1 x bts (candidates: 1) 23:30:00.175773 tst assert_extension.py: using LAC 24417 23:30:00.298050 tst assert_extension.py: using RAC 192 23:30:00.420533 tst assert_extension.py: using CellId 24417 23:30:00.544891 tst assert_extension.py: using BVCI 24418 23:30:00.660095 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 23:30:00.671086 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 23:30:00.681915 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 23:30:00.692881 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 23:30:00.703824 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 23:30:00.714833 tst ussd:trx-b200: Using 1 x modem (candidates: 1) 23:30:00.826244 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:30:01.298349 run create_hlr_db(pid=29822): Launched 23:30:01.464277 bus /sierra_2: Setting Powered False 23:30:02.523824 run create_hlr_db(pid=29822): Terminated: ok {rc=0} 23:30:02.930748 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29827): Launched 23:30:03.222060 run osmo-hlr_10.42.42.2(pid=29828): Launched 23:30:03.332222 run osmo-stp_10.42.42.5: Starting osmo-stp 23:30:03.833629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29830): Launched 23:30:04.124590 run osmo-stp_10.42.42.5(pid=29831): Launched 23:30:04.234687 run osmo-msc_10.42.42.6: Starting osmo-msc 23:30:04.759777 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29833): Launched 23:30:05.048896 run osmo-msc_10.42.42.6(pid=29834): Launched 23:30:05.211368 run osmo-stp_10.42.42.5(pid=29831): ERR: Terminated: ERROR {rc=1} [trial-2366↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29831)] 23:30:05.334455 run osmo-stp_10.42.42.5(pid=29831): stdout: | (launched: 2022-12-09_23:30:04.071158) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:30:05.458041 run osmo-stp_10.42.42.5(pid=29831): stderr: | 20221209233004239 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233004239 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233004239 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233004240 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233004242 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233004242 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233004242 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:30:05.578877 run osmo-stp_10.42.42.5(pid=29831): stdout: | (launched: 2022-12-09_23:30:04.071158) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:30:05.694810 run osmo-stp_10.42.42.5(pid=29831): stderr: | 20221209233004239 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233004239 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233004239 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233004240 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233004242 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233004242 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233004242 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:30:05.833369 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=29831): Process ended prematurely: osmo-stp_10.42.42.5(pid=29831) [trial-2366↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29831)] [trial-2366↪ussd:trx-b200↪assert_extension.py:17] 23:30:05.841436 tst assert_extension.py:17: Test FAILED (5.7 sec) 23:30:05.866966 run osmo-hlr_10.42.42.2(pid=29828): ERR: Terminated: ERROR {rc=237} [trial-2366↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29828)] 23:30:05.913992 run osmo-hlr_10.42.42.2(pid=29828): stdout: | (launched: 2022-12-09_23:30:03.168462) 23:30:05.962876 run osmo-hlr_10.42.42.2(pid=29828): stderr: | 20221209233003343 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209233003343 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209233003343 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209233003343 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209233003344 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209233003344 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209233003359 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/ussd:trx-b200/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209233003367 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209233003367 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209233003367 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:30:06.031054 run osmo-msc_10.42.42.6(pid=29834): ERR: Terminated: ERROR {rc=2} [trial-2366↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29834)] 23:30:06.078106 run osmo-msc_10.42.42.6(pid=29834): stdout: | (launched: 2022-12-09_23:30:04.995704) 23:30:06.126675 run osmo-msc_10.42.42.6(pid=29834): stderr: | 20221209233005266 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209233005266 DLGLOBAL DEBUG validating counter group 0x7efcc0d94c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209233005266 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209233005266 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209233005266 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209233005267 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209233005268 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209233005269 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209233005269 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209233005269 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:30:06.175982 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29827): Terminating (SIGTERM) 23:30:06.215180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29830): Terminating (SIGTERM) 23:30:06.254388 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29833): Terminating (SIGTERM) 23:30:06.293689 --- ParallelTerminationStrategy: PID 29827 died... 23:30:06.312390 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29827): Terminated: ok {rc=0} 23:30:06.356205 --- ParallelTerminationStrategy: PID 29830 died... 23:30:06.374533 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29830): Terminated: ok {rc=0} 23:30:06.418203 --- ParallelTerminationStrategy: PID 29833 died... 23:30:06.436887 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29833): Terminated: ok {rc=0} 23:30:06.519406 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 23:30:07.725289 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:30:07.731432 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 23:30:07.763651 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 23:30:07.789918 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 23:30:07.840213 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 23:30:07.872452 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 23:30:07.898330 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 23:30:08.449802 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 23:30:08.497662 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:30:08.508479 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 23:30:08.576799 tst mo_mt_call.py: using LAC 24418 23:30:08.692492 tst mo_mt_call.py: using RAC 193 23:30:08.808522 tst mo_mt_call.py: using CellId 24418 23:30:08.925111 tst mo_mt_call.py: using BVCI 24419 23:30:09.031876 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:30:09.042846 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:30:09.053585 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:30:09.064294 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:30:09.075086 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:30:09.085840 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:30:09.202601 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:30:09.320595 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:30:09.810657 run create_hlr_db(pid=29839): Launched 23:30:09.931044 bus /sierra_2: Setting Powered False 23:30:10.993610 run create_hlr_db(pid=29839): Terminated: ok {rc=0} 23:30:11.434545 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29841): Launched 23:30:11.749668 run osmo-hlr_10.42.42.2(pid=29842): Launched 23:30:11.870202 run osmo-stp_10.42.42.5: Starting osmo-stp 23:30:12.421439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29844): Launched 23:30:12.738128 run osmo-stp_10.42.42.5(pid=29845): Launched 23:30:12.859463 run osmo-msc_10.42.42.6: Starting osmo-msc 23:30:13.432017 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29847): Launched 23:30:13.748646 run osmo-msc_10.42.42.6(pid=29848): Launched 23:30:13.925946 run osmo-stp_10.42.42.5(pid=29845): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29845)] 23:30:14.061554 run osmo-stp_10.42.42.5(pid=29845): stdout: | (launched: 2022-12-09_23:30:12.680790) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:30:14.196167 run osmo-stp_10.42.42.5(pid=29845): stderr: | 20221209233012870 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233012871 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233012871 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233012871 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233012872 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233012872 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233012872 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:30:14.330388 run osmo-stp_10.42.42.5(pid=29845): stdout: | (launched: 2022-12-09_23:30:12.680790) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:30:14.457168 run osmo-stp_10.42.42.5(pid=29845): stderr: | 20221209233012870 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233012871 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233012871 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233012871 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233012872 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233012872 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233012872 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:30:14.608277 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29845): Process ended prematurely: osmo-stp_10.42.42.5(pid=29845) [trial-2366↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29845)] [trial-2366↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 23:30:14.617977 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 23:30:14.646067 run osmo-hlr_10.42.42.2(pid=29842): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29842)] 23:30:14.696260 run osmo-hlr_10.42.42.2(pid=29842): stdout: | (launched: 2022-12-09_23:30:11.693058) 23:30:14.747994 run osmo-hlr_10.42.42.2(pid=29842): stderr: | 20221209233011890 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209233011890 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209233011890 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209233011890 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209233011890 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209233011891 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209233011903 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209233011913 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209233011914 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209233011914 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:30:14.820052 run osmo-msc_10.42.42.6(pid=29848): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29848)] 23:30:14.869975 run osmo-msc_10.42.42.6(pid=29848): stdout: | (launched: 2022-12-09_23:30:13.691763) 23:30:14.921268 run osmo-msc_10.42.42.6(pid=29848): stderr: | 20221209233014013 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209233014013 DLGLOBAL DEBUG validating counter group 0x7f57ec274c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209233014013 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209233014014 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209233014014 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209233014014 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209233014015 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209233014017 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209233014017 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209233014017 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:30:14.973094 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29841): Terminating (SIGTERM) 23:30:15.014642 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29844): Terminating (SIGTERM) 23:30:15.056092 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29847): Terminating (SIGTERM) 23:30:15.097756 --- ParallelTerminationStrategy: PID 29841 died... 23:30:15.117522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29841): Terminated: ok {rc=0} 23:30:15.164388 --- ParallelTerminationStrategy: PID 29844 died... 23:30:15.183609 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29844): Terminated: ok {rc=0} 23:30:15.230165 --- ParallelTerminationStrategy: PID 29847 died... 23:30:15.249557 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29847): Terminated: ok {rc=0} 23:30:15.338195 bus /sierra_3: Setting Powered False 23:30:16.443899 bus /sierra_3: Setting Powered False 23:30:17.567436 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 23:30:18.715708 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:30:18.727761 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 23:30:18.799075 tst mo_mt_call_osmux.py: using LAC 24419 23:30:18.924374 tst mo_mt_call_osmux.py: using RAC 194 23:30:19.049504 tst mo_mt_call_osmux.py: using CellId 24419 23:30:19.175890 tst mo_mt_call_osmux.py: using BVCI 24420 23:30:19.292627 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:30:19.304112 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:30:19.315390 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:30:19.326825 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:30:19.338448 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:30:19.350605 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:30:19.470444 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:30:19.586661 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:30:20.047803 run create_hlr_db(pid=29850): Launched 23:30:20.168877 bus /sierra_2: Setting Powered False 23:30:21.228904 run create_hlr_db(pid=29850): Terminated: ok {rc=0} 23:30:21.664382 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29852): Launched 23:30:21.980917 run osmo-hlr_10.42.42.2(pid=29853): Launched 23:30:22.101957 run osmo-stp_10.42.42.5: Starting osmo-stp 23:30:22.653595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29855): Launched 23:30:22.971450 run osmo-stp_10.42.42.5(pid=29856): Launched 23:30:23.092502 run osmo-msc_10.42.42.6: Starting osmo-msc 23:30:23.666513 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29858): Launched 23:30:23.981938 run osmo-msc_10.42.42.6(pid=29859): Launched 23:30:24.159087 run osmo-stp_10.42.42.5(pid=29856): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29856)] 23:30:24.298046 run osmo-stp_10.42.42.5(pid=29856): stdout: | (launched: 2022-12-09_23:30:22.914096) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:30:24.429327 run osmo-stp_10.42.42.5(pid=29856): stderr: | 20221209233023106 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233023106 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233023107 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233023107 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233023107 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233023107 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233023108 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:30:24.562240 run osmo-stp_10.42.42.5(pid=29856): stdout: | (launched: 2022-12-09_23:30:22.914096) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:30:24.689448 run osmo-stp_10.42.42.5(pid=29856): stderr: | 20221209233023106 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233023106 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233023107 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233023107 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233023107 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233023107 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233023108 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:30:24.841649 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29856): Process ended prematurely: osmo-stp_10.42.42.5(pid=29856) [trial-2366↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29856)] [trial-2366↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 23:30:24.851354 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 23:30:24.879863 run osmo-hlr_10.42.42.2(pid=29853): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29853)] 23:30:24.930747 run osmo-hlr_10.42.42.2(pid=29853): stdout: | (launched: 2022-12-09_23:30:21.923843) 23:30:24.983560 run osmo-hlr_10.42.42.2(pid=29853): stderr: | 20221209233022119 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209233022119 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209233022119 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209233022119 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209233022120 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209233022120 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209233022131 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209233022140 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209233022140 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209233022140 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:30:25.056555 run osmo-msc_10.42.42.6(pid=29859): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29859)] 23:30:25.107571 run osmo-msc_10.42.42.6(pid=29859): stdout: | (launched: 2022-12-09_23:30:23.924821) 23:30:25.160093 run osmo-msc_10.42.42.6(pid=29859): stderr: | 20221209233024247 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209233024248 DLGLOBAL DEBUG validating counter group 0x7fcee7c91c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209233024248 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209233024248 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209233024248 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209233024248 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209233024250 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209233024250 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209233024250 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209233024250 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:30:25.213113 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29852): Terminating (SIGTERM) 23:30:25.255502 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29855): Terminating (SIGTERM) 23:30:25.297899 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29858): Terminating (SIGTERM) 23:30:25.340409 --- ParallelTerminationStrategy: PID 29852 died... 23:30:25.360515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29852): Terminated: ok {rc=0} 23:30:25.408092 --- ParallelTerminationStrategy: PID 29855 died... 23:30:25.427785 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29855): Terminated: ok {rc=0} 23:30:25.474546 --- ParallelTerminationStrategy: PID 29858 died... 23:30:25.494220 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29858): Terminated: ok {rc=0} 23:30:25.582224 bus /sierra_3: Setting Powered False 23:30:26.680375 bus /sierra_3: Setting Powered False 23:30:27.797661 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 23:30:29.041404 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:30:29.047687 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 23:30:29.080069 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 23:30:29.106255 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 23:30:29.157420 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 23:30:29.190429 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 23:30:29.216666 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 23:30:29.767566 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 23:30:29.815226 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:30:29.826284 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 23:30:29.894770 tst mo_mt_call.py: using LAC 24420 23:30:30.012299 tst mo_mt_call.py: using RAC 195 23:30:30.129167 tst mo_mt_call.py: using CellId 24420 23:30:30.245727 tst mo_mt_call.py: using BVCI 24421 23:30:30.354597 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:30:30.365742 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:30:30.376673 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:30:30.387617 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:30:30.398715 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:30:30.409715 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:30:30.527726 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:30:30.647648 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:30:31.148840 run create_hlr_db(pid=29864): Launched 23:30:31.304355 bus /sierra_2: Setting Powered False 23:30:32.367488 run create_hlr_db(pid=29864): Terminated: ok {rc=0} 23:30:32.791102 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29866): Launched 23:30:33.086003 run osmo-hlr_10.42.42.2(pid=29867): Launched 23:30:33.197769 run osmo-stp_10.42.42.5: Starting osmo-stp 23:30:33.720847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29869): Launched 23:30:34.015401 run osmo-stp_10.42.42.5(pid=29870): Launched 23:30:34.126264 run osmo-msc_10.42.42.6: Starting osmo-msc 23:30:34.659126 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29872): Launched 23:30:34.953326 run osmo-msc_10.42.42.6(pid=29873): Launched 23:30:35.117061 run osmo-stp_10.42.42.5(pid=29870): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29870)] 23:30:35.241912 run osmo-stp_10.42.42.5(pid=29870): stdout: | (launched: 2022-12-09_23:30:33.961920) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:30:35.366672 run osmo-stp_10.42.42.5(pid=29870): stderr: | 20221209233034131 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233034131 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233034131 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233034132 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233034134 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233034134 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233034134 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:30:35.489289 run osmo-stp_10.42.42.5(pid=29870): stdout: | (launched: 2022-12-09_23:30:33.961920) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:30:35.606446 run osmo-stp_10.42.42.5(pid=29870): stderr: | 20221209233034131 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233034131 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233034131 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233034132 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233034134 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233034134 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233034134 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:30:35.746719 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29870): Process ended prematurely: osmo-stp_10.42.42.5(pid=29870) [trial-2366↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29870)] [trial-2366↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 23:30:35.755614 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 23:30:35.781766 run osmo-hlr_10.42.42.2(pid=29867): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29867)] 23:30:35.829074 run osmo-hlr_10.42.42.2(pid=29867): stdout: | (launched: 2022-12-09_23:30:33.032218) 23:30:35.877629 run osmo-hlr_10.42.42.2(pid=29867): stderr: | 20221209233033207 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209233033207 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209233033207 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209233033207 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209233033207 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209233033207 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209233033220 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209233033229 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209233033229 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209233033229 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:30:35.945472 run osmo-msc_10.42.42.6(pid=29873): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29873)] 23:30:35.992253 run osmo-msc_10.42.42.6(pid=29873): stdout: | (launched: 2022-12-09_23:30:34.899791) 23:30:36.040584 run osmo-msc_10.42.42.6(pid=29873): stderr: | 20221209233035173 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209233035173 DLGLOBAL DEBUG validating counter group 0x7ff92d66ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209233035173 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209233035173 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209233035173 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209233035174 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209233035177 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209233035178 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209233035178 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209233035178 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:30:36.089460 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29866): Terminating (SIGTERM) 23:30:36.128436 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29869): Terminating (SIGTERM) 23:30:36.167395 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29872): Terminating (SIGTERM) 23:30:36.206576 --- ParallelTerminationStrategy: PID 29866 died... 23:30:36.225459 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29866): Terminated: ok {rc=0} 23:30:36.269100 --- ParallelTerminationStrategy: PID 29869 died... 23:30:36.287648 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29869): Terminated: ok {rc=0} 23:30:36.331345 --- ParallelTerminationStrategy: PID 29872 died... 23:30:36.349890 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29872): Terminated: ok {rc=0} 23:30:36.435676 bus /sierra_3: Setting Powered False 23:30:37.533613 bus /sierra_3: Setting Powered False 23:30:38.649275 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 23:30:39.791783 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:30:39.803406 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 23:30:39.876808 tst mo_mt_call_osmux.py: using LAC 24421 23:30:39.997918 tst mo_mt_call_osmux.py: using RAC 196 23:30:40.122276 tst mo_mt_call_osmux.py: using CellId 24421 23:30:40.245991 tst mo_mt_call_osmux.py: using BVCI 24422 23:30:40.360506 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:30:40.372155 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:30:40.383652 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:30:40.395425 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:30:40.407373 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:30:40.418918 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:30:40.533977 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:30:40.652613 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:30:41.144257 run create_hlr_db(pid=29875): Launched 23:30:41.264177 bus /sierra_2: Setting Powered False 23:30:42.328085 run create_hlr_db(pid=29875): Terminated: ok {rc=0} 23:30:42.753341 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29877): Launched 23:30:43.051038 run osmo-hlr_10.42.42.2(pid=29878): Launched 23:30:43.163777 run osmo-stp_10.42.42.5: Starting osmo-stp 23:30:43.672319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29880): Launched 23:30:43.967748 run osmo-stp_10.42.42.5(pid=29881): Launched 23:30:44.080793 run osmo-msc_10.42.42.6: Starting osmo-msc 23:30:44.622265 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29883): Launched 23:30:44.919940 run osmo-msc_10.42.42.6(pid=29884): Launched 23:30:45.085598 run osmo-stp_10.42.42.5(pid=29881): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29881)] 23:30:45.211471 run osmo-stp_10.42.42.5(pid=29881): stdout: | (launched: 2022-12-09_23:30:43.913904) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:30:45.337708 run osmo-stp_10.42.42.5(pid=29881): stderr: | 20221209233044084 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233044084 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233044084 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233044084 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233044085 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233044085 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233044085 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:30:45.461904 run osmo-stp_10.42.42.5(pid=29881): stdout: | (launched: 2022-12-09_23:30:43.913904) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:30:45.580371 run osmo-stp_10.42.42.5(pid=29881): stderr: | 20221209233044084 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233044084 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233044084 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233044084 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233044085 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233044085 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233044085 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:30:45.722153 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29881): Process ended prematurely: osmo-stp_10.42.42.5(pid=29881) [trial-2366↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29881)] [trial-2366↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 23:30:45.731078 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 23:30:45.757424 run osmo-hlr_10.42.42.2(pid=29878): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29878)] 23:30:45.804696 run osmo-hlr_10.42.42.2(pid=29878): stdout: | (launched: 2022-12-09_23:30:42.997202) 23:30:45.857753 run osmo-hlr_10.42.42.2(pid=29878): stderr: | 20221209233043170 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209233043170 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209233043170 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209233043170 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209233043170 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209233043170 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209233043228 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209233043238 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209233043239 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209233043239 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:30:45.948101 run osmo-msc_10.42.42.6(pid=29884): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29884)] 23:30:45.997288 run osmo-msc_10.42.42.6(pid=29884): stdout: | (launched: 2022-12-09_23:30:44.865797) 23:30:46.047914 run osmo-msc_10.42.42.6(pid=29884): stderr: | 20221209233045140 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209233045140 DLGLOBAL DEBUG validating counter group 0x7f619f547c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209233045140 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209233045141 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209233045141 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209233045141 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209233045143 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209233045143 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209233045143 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209233045143 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:30:46.099304 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29877): Terminating (SIGTERM) 23:30:46.140431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29880): Terminating (SIGTERM) 23:30:46.181469 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29883): Terminating (SIGTERM) 23:30:46.222640 --- ParallelTerminationStrategy: PID 29877 died... 23:30:46.242111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29877): Terminated: ok {rc=0} 23:30:46.286987 --- ParallelTerminationStrategy: PID 29880 died... 23:30:46.306106 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29880): Terminated: ok {rc=0} 23:30:46.350676 --- ParallelTerminationStrategy: PID 29883 died... 23:30:46.369760 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29883): Terminated: ok {rc=0} 23:30:46.459616 bus /sierra_3: Setting Powered False 23:30:47.571359 bus /sierra_3: Setting Powered False 23:30:48.687273 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 23:30:49.929711 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:30:49.935897 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 23:30:49.968360 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 23:30:49.994808 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 23:30:50.047168 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 23:30:50.082109 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 23:30:50.109637 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 23:30:50.657984 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 23:30:50.709963 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:30:50.721487 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 23:30:50.796193 tst mo_mt_call.py: using LAC 24422 23:30:50.919983 tst mo_mt_call.py: using RAC 197 23:30:51.043512 tst mo_mt_call.py: using CellId 24422 23:30:51.166459 tst mo_mt_call.py: using BVCI 24423 23:30:51.281823 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:30:51.293400 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:30:51.304594 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:30:51.316144 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:30:51.327676 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:30:51.339250 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:30:51.457133 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:30:51.573282 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:30:52.065079 run create_hlr_db(pid=29889): Launched 23:30:52.185387 bus /sierra_2: Setting Powered False 23:30:53.248732 run create_hlr_db(pid=29889): Terminated: ok {rc=0} 23:30:53.689889 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29891): Launched 23:30:54.005740 run osmo-hlr_10.42.42.2(pid=29892): Launched 23:30:54.126471 run osmo-stp_10.42.42.5: Starting osmo-stp 23:30:54.670060 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29894): Launched 23:30:54.986173 run osmo-stp_10.42.42.5(pid=29896): Launched 23:30:55.107629 run osmo-msc_10.42.42.6: Starting osmo-msc 23:30:55.681662 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29898): Launched 23:30:55.999339 run osmo-msc_10.42.42.6(pid=29899): Launched 23:30:56.176103 run osmo-stp_10.42.42.5(pid=29896): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29896)] 23:30:56.310319 run osmo-stp_10.42.42.5(pid=29896): stdout: | (launched: 2022-12-09_23:30:54.928897) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:30:56.445754 run osmo-stp_10.42.42.5(pid=29896): stderr: | 20221209233055119 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233055120 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233055120 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233055120 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233055122 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233055123 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233055123 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:30:56.579525 run osmo-stp_10.42.42.5(pid=29896): stdout: | (launched: 2022-12-09_23:30:54.928897) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:30:56.706210 run osmo-stp_10.42.42.5(pid=29896): stderr: | 20221209233055119 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233055120 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233055120 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233055120 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233055122 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233055123 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233055123 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:30:56.858045 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29896): Process ended prematurely: osmo-stp_10.42.42.5(pid=29896) [trial-2366↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29896)] [trial-2366↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 23:30:56.867568 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 23:30:56.896240 run osmo-hlr_10.42.42.2(pid=29892): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29892)] 23:30:56.946455 run osmo-hlr_10.42.42.2(pid=29892): stdout: | (launched: 2022-12-09_23:30:53.948665) 23:30:56.998390 run osmo-hlr_10.42.42.2(pid=29892): stderr: | 20221209233054147 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209233054147 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209233054147 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209233054147 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209233054147 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209233054147 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209233054182 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209233054191 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209233054192 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209233054192 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:30:57.070332 run osmo-msc_10.42.42.6(pid=29899): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29899)] 23:30:57.120478 run osmo-msc_10.42.42.6(pid=29899): stdout: | (launched: 2022-12-09_23:30:55.942104) 23:30:57.172166 run osmo-msc_10.42.42.6(pid=29899): stderr: | 20221209233056262 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209233056262 DLGLOBAL DEBUG validating counter group 0x7f5ac848ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209233056262 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209233056262 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209233056262 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209233056263 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209233056266 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209233056267 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209233056267 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209233056267 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:30:57.224289 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29891): Terminating (SIGTERM) 23:30:57.266105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29894): Terminating (SIGTERM) 23:30:57.307925 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29898): Terminating (SIGTERM) 23:30:57.349986 --- ParallelTerminationStrategy: PID 29891 died... 23:30:57.369954 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29891): Terminated: ok {rc=0} 23:30:57.416748 --- ParallelTerminationStrategy: PID 29894 died... 23:30:57.436632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29894): Terminated: ok {rc=0} 23:30:57.483437 --- ParallelTerminationStrategy: PID 29898 died... 23:30:57.503074 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29898): Terminated: ok {rc=0} 23:30:57.591305 bus /sierra_3: Setting Powered False 23:30:58.690167 bus /sierra_3: Setting Powered False 23:30:59.806613 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 23:31:00.971142 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:31:00.983512 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 23:31:01.096163 tst mo_mt_call_osmux.py: using LAC 24423 23:31:01.262070 tst mo_mt_call_osmux.py: using RAC 198 23:31:01.380884 tst mo_mt_call_osmux.py: using CellId 24423 23:31:01.498609 tst mo_mt_call_osmux.py: using BVCI 24424 23:31:01.609577 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:31:01.621601 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:31:01.633493 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:31:01.644696 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:31:01.656450 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:31:01.668728 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:31:01.801189 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:31:01.948372 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:31:02.474936 run create_hlr_db(pid=29901): Launched 23:31:02.596359 bus /sierra_2: Setting Powered False 23:31:03.659462 run create_hlr_db(pid=29901): Terminated: ok {rc=0} 23:31:04.084245 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29903): Launched 23:31:04.379238 run osmo-hlr_10.42.42.2(pid=29904): Launched 23:31:04.491347 run osmo-stp_10.42.42.5: Starting osmo-stp 23:31:05.000758 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29906): Launched 23:31:05.296912 run osmo-stp_10.42.42.5(pid=29907): Launched 23:31:05.409419 run osmo-msc_10.42.42.6: Starting osmo-msc 23:31:05.945171 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29909): Launched 23:31:06.240790 run osmo-msc_10.42.42.6(pid=29910): Launched 23:31:06.406009 run osmo-stp_10.42.42.5(pid=29907): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29907)] 23:31:06.531667 run osmo-stp_10.42.42.5(pid=29907): stdout: | (launched: 2022-12-09_23:31:05.243103) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:31:06.657699 run osmo-stp_10.42.42.5(pid=29907): stderr: | 20221209233105410 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233105410 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233105411 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233105411 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233105412 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233105412 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233105412 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:31:06.780811 run osmo-stp_10.42.42.5(pid=29907): stdout: | (launched: 2022-12-09_23:31:05.243103) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:31:06.898684 run osmo-stp_10.42.42.5(pid=29907): stderr: | 20221209233105410 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233105410 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233105411 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233105411 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233105412 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233105412 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233105412 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:31:07.040444 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29907): Process ended prematurely: osmo-stp_10.42.42.5(pid=29907) [trial-2366↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29907)] [trial-2366↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 23:31:07.049216 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 23:31:07.075262 run osmo-hlr_10.42.42.2(pid=29904): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29904)] 23:31:07.122225 run osmo-hlr_10.42.42.2(pid=29904): stdout: | (launched: 2022-12-09_23:31:04.325575) 23:31:07.170868 run osmo-hlr_10.42.42.2(pid=29904): stderr: | 20221209233104501 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209233104501 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209233104501 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209233104501 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209233104501 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209233104501 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209233104533 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209233104543 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209233104543 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209233104543 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:31:07.238773 run osmo-msc_10.42.42.6(pid=29910): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29910)] 23:31:07.285532 run osmo-msc_10.42.42.6(pid=29910): stdout: | (launched: 2022-12-09_23:31:06.186492) 23:31:07.333860 run osmo-msc_10.42.42.6(pid=29910): stderr: | 20221209233106459 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209233106459 DLGLOBAL DEBUG validating counter group 0x7fe058691c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209233106459 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209233106459 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209233106459 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209233106460 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209233106461 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209233106462 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209233106462 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209233106462 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:31:07.383231 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29903): Terminating (SIGTERM) 23:31:07.422245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29906): Terminating (SIGTERM) 23:31:07.461240 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29909): Terminating (SIGTERM) 23:31:07.500817 --- ParallelTerminationStrategy: PID 29903 died... 23:31:07.519558 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29903): Terminated: ok {rc=0} 23:31:07.562742 --- ParallelTerminationStrategy: PID 29906 died... 23:31:07.581007 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29906): Terminated: ok {rc=0} 23:31:07.623901 --- ParallelTerminationStrategy: PID 29909 died... 23:31:07.642213 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29909): Terminated: ok {rc=0} 23:31:07.724745 bus /sierra_3: Setting Powered False 23:31:08.821723 bus /sierra_3: Setting Powered False 23:31:09.937656 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 23:31:11.187035 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:31:11.194290 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 23:31:11.228655 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 23:31:11.256195 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 23:31:11.308788 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 23:31:11.343535 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 23:31:11.371088 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 23:31:11.922627 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 23:31:11.973969 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:31:11.985502 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 23:31:12.055878 tst mo_mt_call.py: using LAC 24424 23:31:12.181347 tst mo_mt_call.py: using RAC 199 23:31:12.305833 tst mo_mt_call.py: using CellId 24424 23:31:12.429802 tst mo_mt_call.py: using BVCI 24425 23:31:12.544854 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:31:12.556308 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:31:12.567621 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:31:12.579139 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:31:12.590711 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:31:12.602241 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:31:12.718565 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:31:12.836387 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:31:13.326613 run create_hlr_db(pid=29915): Launched 23:31:13.446663 bus /sierra_2: Setting Powered False 23:31:14.509487 run create_hlr_db(pid=29915): Terminated: ok {rc=0} 23:31:14.950968 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29917): Launched 23:31:15.268091 run osmo-hlr_10.42.42.2(pid=29918): Launched 23:31:15.391100 run osmo-stp_10.42.42.5: Starting osmo-stp 23:31:15.962812 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29920): Launched 23:31:16.301663 run osmo-stp_10.42.42.5(pid=29921): Launched 23:31:16.532488 run osmo-msc_10.42.42.6: Starting osmo-msc 23:31:17.263937 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29923): Launched 23:31:17.581646 run osmo-msc_10.42.42.6(pid=29924): Launched 23:31:17.758413 run osmo-stp_10.42.42.5(pid=29921): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29921)] 23:31:17.891901 run osmo-stp_10.42.42.5(pid=29921): stdout: | (launched: 2022-12-09_23:31:16.235139) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:31:18.026236 run osmo-stp_10.42.42.5(pid=29921): stderr: | 20221209233116504 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233116504 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233116504 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233116505 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233116506 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233116506 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233116506 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:31:18.160078 run osmo-stp_10.42.42.5(pid=29921): stdout: | (launched: 2022-12-09_23:31:16.235139) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:31:18.287098 run osmo-stp_10.42.42.5(pid=29921): stderr: | 20221209233116504 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233116504 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233116504 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233116505 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233116506 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233116506 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233116506 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:31:18.439227 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29921): Process ended prematurely: osmo-stp_10.42.42.5(pid=29921) [trial-2366↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29921)] [trial-2366↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 23:31:18.448552 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 23:31:18.476512 run osmo-hlr_10.42.42.2(pid=29918): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29918)] 23:31:18.526124 run osmo-hlr_10.42.42.2(pid=29918): stdout: | (launched: 2022-12-09_23:31:15.210908) 23:31:18.577451 run osmo-hlr_10.42.42.2(pid=29918): stderr: | 20221209233115408 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209233115408 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209233115408 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209233115408 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209233115408 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209233115408 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209233115419 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209233115427 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209233115427 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209233115427 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:31:18.648825 run osmo-msc_10.42.42.6(pid=29924): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29924)] 23:31:18.698512 run osmo-msc_10.42.42.6(pid=29924): stdout: | (launched: 2022-12-09_23:31:17.524609) 23:31:18.749838 run osmo-msc_10.42.42.6(pid=29924): stderr: | 20221209233117846 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209233117846 DLGLOBAL DEBUG validating counter group 0x7fd5da8a5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209233117846 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209233117846 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209233117846 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209233117847 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209233117848 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209233117849 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209233117849 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209233117849 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:31:18.801457 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29917): Terminating (SIGTERM) 23:31:18.842712 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29920): Terminating (SIGTERM) 23:31:18.884169 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29923): Terminating (SIGTERM) 23:31:18.926017 --- ParallelTerminationStrategy: PID 29917 died... 23:31:18.945674 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29917): Terminated: ok {rc=0} 23:31:18.991771 --- ParallelTerminationStrategy: PID 29920 died... 23:31:19.011071 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29920): Terminated: ok {rc=0} 23:31:19.057201 --- ParallelTerminationStrategy: PID 29923 died... 23:31:19.076436 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29923): Terminated: ok {rc=0} 23:31:19.164084 bus /sierra_3: Setting Powered False 23:31:20.264039 bus /sierra_3: Setting Powered False 23:31:21.381414 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 23:31:22.530049 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:31:22.542114 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 23:31:22.612838 tst mo_mt_call_osmux.py: using LAC 24425 23:31:22.738485 tst mo_mt_call_osmux.py: using RAC 200 23:31:22.865586 tst mo_mt_call_osmux.py: using CellId 24425 23:31:22.989863 tst mo_mt_call_osmux.py: using BVCI 24426 23:31:23.105919 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:31:23.117486 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:31:23.128602 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:31:23.140061 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:31:23.152088 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:31:23.163665 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:31:23.285416 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:31:23.405145 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:31:23.897452 run create_hlr_db(pid=29926): Launched 23:31:24.018818 bus /sierra_2: Setting Powered False 23:31:25.081908 run create_hlr_db(pid=29926): Terminated: ok {rc=0} 23:31:25.506503 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29928): Launched 23:31:25.802231 run osmo-hlr_10.42.42.2(pid=29929): Launched 23:31:25.914354 run osmo-stp_10.42.42.5: Starting osmo-stp 23:31:26.441565 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29931): Launched 23:31:26.737733 run osmo-stp_10.42.42.5(pid=29932): Launched 23:31:26.850247 run osmo-msc_10.42.42.6: Starting osmo-msc 23:31:27.386245 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29934): Launched 23:31:27.681175 run osmo-msc_10.42.42.6(pid=29935): Launched 23:31:27.846074 run osmo-stp_10.42.42.5(pid=29932): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29932)] 23:31:27.971541 run osmo-stp_10.42.42.5(pid=29932): stdout: | (launched: 2022-12-09_23:31:26.683787) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:31:28.096237 run osmo-stp_10.42.42.5(pid=29932): stderr: | 20221209233126853 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233126853 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233126853 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233126854 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233126854 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233126854 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233126854 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:31:28.219461 run osmo-stp_10.42.42.5(pid=29932): stdout: | (launched: 2022-12-09_23:31:26.683787) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:31:28.337107 run osmo-stp_10.42.42.5(pid=29932): stderr: | 20221209233126853 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233126853 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233126853 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233126854 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233126854 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233126854 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233126854 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:31:28.477757 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29932): Process ended prematurely: osmo-stp_10.42.42.5(pid=29932) [trial-2366↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29932)] [trial-2366↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 23:31:28.486510 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 23:31:28.512344 run osmo-hlr_10.42.42.2(pid=29929): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29929)] 23:31:28.559239 run osmo-hlr_10.42.42.2(pid=29929): stdout: | (launched: 2022-12-09_23:31:25.748759) 23:31:28.607944 run osmo-hlr_10.42.42.2(pid=29929): stderr: | 20221209233125924 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209233125924 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209233125924 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209233125924 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209233125924 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209233125924 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209233125938 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209233125947 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209233125947 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209233125947 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:31:28.676600 run osmo-msc_10.42.42.6(pid=29935): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29935)] 23:31:28.723792 run osmo-msc_10.42.42.6(pid=29935): stdout: | (launched: 2022-12-09_23:31:27.627189) 23:31:28.772554 run osmo-msc_10.42.42.6(pid=29935): stderr: | 20221209233127897 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209233127897 DLGLOBAL DEBUG validating counter group 0x7fd59c7eec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209233127898 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209233127898 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209233127898 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209233127898 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209233127900 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209233127900 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209233127900 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209233127900 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:31:28.821861 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29928): Terminating (SIGTERM) 23:31:28.861210 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29931): Terminating (SIGTERM) 23:31:28.900381 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29934): Terminating (SIGTERM) 23:31:28.939868 --- ParallelTerminationStrategy: PID 29928 died... 23:31:28.958889 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29928): Terminated: ok {rc=0} 23:31:29.002703 --- ParallelTerminationStrategy: PID 29931 died... 23:31:29.021196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29931): Terminated: ok {rc=0} 23:31:29.064643 --- ParallelTerminationStrategy: PID 29934 died... 23:31:29.083128 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29934): Terminated: ok {rc=0} 23:31:29.168093 bus /sierra_3: Setting Powered False 23:31:30.265903 bus /sierra_3: Setting Powered False 23:31:31.379338 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 23:31:32.628412 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:31:32.635295 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 23:31:32.669716 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 23:31:32.697062 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 23:31:32.749608 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 23:31:32.783618 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 23:31:32.811360 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 23:31:33.363293 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 23:31:33.414533 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:31:33.425993 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 23:31:33.496573 tst mo_mt_call.py: using LAC 24426 23:31:33.622524 tst mo_mt_call.py: using RAC 201 23:31:33.740196 tst mo_mt_call.py: using CellId 24426 23:31:33.857704 tst mo_mt_call.py: using BVCI 24427 23:31:33.965458 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:31:33.976571 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:31:33.987536 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:31:33.998984 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:31:34.010690 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:31:34.022021 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:31:34.137348 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:31:34.251923 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:31:34.711921 run create_hlr_db(pid=29940): Launched 23:31:34.832465 bus /sierra_2: Setting Powered False 23:31:35.893840 run create_hlr_db(pid=29940): Terminated: ok {rc=0} 23:31:36.327042 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29942): Launched 23:31:36.645294 run osmo-hlr_10.42.42.2(pid=29943): Launched 23:31:36.766541 run osmo-stp_10.42.42.5: Starting osmo-stp 23:31:37.314206 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29945): Launched 23:31:37.630325 run osmo-stp_10.42.42.5(pid=29946): Launched 23:31:37.750478 run osmo-msc_10.42.42.6: Starting osmo-msc 23:31:38.321620 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29948): Launched 23:31:38.638692 run osmo-msc_10.42.42.6(pid=29949): Launched 23:31:38.814727 run osmo-stp_10.42.42.5(pid=29946): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29946)] 23:31:38.949053 run osmo-stp_10.42.42.5(pid=29946): stdout: | (launched: 2022-12-09_23:31:37.573211) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:31:39.083718 run osmo-stp_10.42.42.5(pid=29946): stderr: | 20221209233137762 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233137762 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233137763 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233137763 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233137763 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233137764 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233137764 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:31:39.217600 run osmo-stp_10.42.42.5(pid=29946): stdout: | (launched: 2022-12-09_23:31:37.573211) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:31:39.344256 run osmo-stp_10.42.42.5(pid=29946): stderr: | 20221209233137762 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233137762 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233137763 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233137763 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233137763 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233137764 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233137764 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:31:39.496387 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29946): Process ended prematurely: osmo-stp_10.42.42.5(pid=29946) [trial-2366↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29946)] [trial-2366↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 23:31:39.505908 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 23:31:39.533792 run osmo-hlr_10.42.42.2(pid=29943): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29943)] 23:31:39.583638 run osmo-hlr_10.42.42.2(pid=29943): stdout: | (launched: 2022-12-09_23:31:36.587904) 23:31:39.635163 run osmo-hlr_10.42.42.2(pid=29943): stderr: | 20221209233136783 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209233136783 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209233136783 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209233136783 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209233136783 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209233136783 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209233136793 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209233136802 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209233136802 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209233136802 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:31:39.706610 run osmo-msc_10.42.42.6(pid=29949): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29949)] 23:31:39.756398 run osmo-msc_10.42.42.6(pid=29949): stdout: | (launched: 2022-12-09_23:31:38.581332) 23:31:39.807728 run osmo-msc_10.42.42.6(pid=29949): stderr: | 20221209233138902 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209233138902 DLGLOBAL DEBUG validating counter group 0x7f9019c88c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209233138902 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209233138902 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209233138902 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209233138903 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209233138904 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209233138905 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209233138905 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209233138905 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:31:39.859783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29942): Terminating (SIGTERM) 23:31:39.901099 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29945): Terminating (SIGTERM) 23:31:39.942413 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29948): Terminating (SIGTERM) 23:31:39.983934 --- ParallelTerminationStrategy: PID 29942 died... 23:31:40.003686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29942): Terminated: ok {rc=0} 23:31:40.049701 --- ParallelTerminationStrategy: PID 29945 died... 23:31:40.068890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29945): Terminated: ok {rc=0} 23:31:40.114960 --- ParallelTerminationStrategy: PID 29948 died... 23:31:40.134259 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29948): Terminated: ok {rc=0} 23:31:40.222977 bus /sierra_3: Setting Powered False 23:31:41.321631 bus /sierra_3: Setting Powered False 23:31:42.440315 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 23:31:43.583899 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:31:43.595539 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 23:31:43.667746 tst mo_mt_call_osmux.py: using LAC 24427 23:31:43.783878 tst mo_mt_call_osmux.py: using RAC 202 23:31:43.901636 tst mo_mt_call_osmux.py: using CellId 24427 23:31:44.017770 tst mo_mt_call_osmux.py: using BVCI 24428 23:31:44.124925 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:31:44.136189 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:31:44.147075 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:31:44.157905 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:31:44.168873 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:31:44.179705 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:31:44.298178 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:31:44.414676 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:31:44.874539 run create_hlr_db(pid=29951): Launched 23:31:44.995460 bus /sierra_2: Setting Powered False 23:31:46.053445 run create_hlr_db(pid=29951): Terminated: ok {rc=0} 23:31:46.486388 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29953): Launched 23:31:46.830863 run osmo-hlr_10.42.42.2(pid=29954): Launched 23:31:47.085797 run osmo-stp_10.42.42.5: Starting osmo-stp 23:31:47.739208 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29956): Launched 23:31:48.056570 run osmo-stp_10.42.42.5(pid=29957): Launched 23:31:48.178057 run osmo-msc_10.42.42.6: Starting osmo-msc 23:31:48.752204 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29959): Launched 23:31:49.068320 run osmo-msc_10.42.42.6(pid=29960): Launched 23:31:49.246560 run osmo-stp_10.42.42.5(pid=29957): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29957)] 23:31:49.381854 run osmo-stp_10.42.42.5(pid=29957): stdout: | (launched: 2022-12-09_23:31:47.999374) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:31:49.517816 run osmo-stp_10.42.42.5(pid=29957): stderr: | 20221209233148188 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233148188 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233148189 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233148189 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233148191 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233148192 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233148192 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:31:49.652371 run osmo-stp_10.42.42.5(pid=29957): stdout: | (launched: 2022-12-09_23:31:47.999374) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:31:49.779668 run osmo-stp_10.42.42.5(pid=29957): stderr: | 20221209233148188 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233148188 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233148189 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233148189 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233148191 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233148192 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233148192 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:31:49.931825 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29957): Process ended prematurely: osmo-stp_10.42.42.5(pid=29957) [trial-2366↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29957)] [trial-2366↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 23:31:49.941595 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 23:31:49.969933 run osmo-hlr_10.42.42.2(pid=29954): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29954)] 23:31:50.019833 run osmo-hlr_10.42.42.2(pid=29954): stdout: | (launched: 2022-12-09_23:31:46.767177) 23:31:50.071849 run osmo-hlr_10.42.42.2(pid=29954): stderr: | 20221209233147165 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209233147165 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209233147166 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209233147166 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209233147167 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209233147167 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209233147199 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209233147207 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209233147207 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209233147207 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:31:50.143972 run osmo-msc_10.42.42.6(pid=29960): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29960)] 23:31:50.193483 run osmo-msc_10.42.42.6(pid=29960): stdout: | (launched: 2022-12-09_23:31:49.011122) 23:31:50.244753 run osmo-msc_10.42.42.6(pid=29960): stderr: | 20221209233149331 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209233149331 DLGLOBAL DEBUG validating counter group 0x7fc38f1f4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209233149332 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209233149332 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209233149332 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209233149332 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209233149334 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209233149334 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209233149334 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209233149334 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:31:50.296451 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29953): Terminating (SIGTERM) 23:31:50.338033 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29956): Terminating (SIGTERM) 23:31:50.379516 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29959): Terminating (SIGTERM) 23:31:50.421187 --- ParallelTerminationStrategy: PID 29953 died... 23:31:50.441440 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29953): Terminated: ok {rc=0} 23:31:50.487898 --- ParallelTerminationStrategy: PID 29956 died... 23:31:50.507272 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29956): Terminated: ok {rc=0} 23:31:50.553296 --- ParallelTerminationStrategy: PID 29959 died... 23:31:50.572686 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29959): Terminated: ok {rc=0} 23:31:50.660462 bus /sierra_3: Setting Powered False 23:31:51.757607 bus /sierra_3: Setting Powered False 23:31:52.872867 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 23:31:54.126655 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:31:54.135318 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 23:31:54.170086 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 23:31:54.198097 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 23:31:54.248573 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 23:31:54.282626 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 23:31:54.310140 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 23:31:54.869250 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 23:31:54.920551 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:31:54.932325 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 23:31:55.002352 tst mo_mt_call.py: using LAC 24428 23:31:55.127259 tst mo_mt_call.py: using RAC 203 23:31:55.250360 tst mo_mt_call.py: using CellId 24428 23:31:55.373158 tst mo_mt_call.py: using BVCI 24429 23:31:55.488567 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:31:55.500372 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:31:55.511829 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:31:55.523510 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:31:55.535383 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:31:55.547161 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:31:55.662014 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:31:55.779989 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:31:56.271757 run create_hlr_db(pid=29965): Launched 23:31:56.391641 bus /sierra_2: Setting Powered False 23:31:57.454557 run create_hlr_db(pid=29965): Terminated: ok {rc=0} 23:31:57.879086 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29967): Launched 23:31:58.176376 run osmo-hlr_10.42.42.2(pid=29968): Launched 23:31:58.289699 run osmo-stp_10.42.42.5: Starting osmo-stp 23:31:58.816740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29970): Launched 23:31:59.112031 run osmo-stp_10.42.42.5(pid=29971): Launched 23:31:59.224708 run osmo-msc_10.42.42.6: Starting osmo-msc 23:31:59.760699 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29973): Launched 23:32:00.057710 run osmo-msc_10.42.42.6(pid=29974): Launched 23:32:00.223167 run osmo-stp_10.42.42.5(pid=29971): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29971)] 23:32:00.348841 run osmo-stp_10.42.42.5(pid=29971): stdout: | (launched: 2022-12-09_23:31:59.058249) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:32:00.473612 run osmo-stp_10.42.42.5(pid=29971): stderr: | 20221209233159229 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233159229 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233159229 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233159230 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233159230 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233159230 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233159230 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:32:00.596848 run osmo-stp_10.42.42.5(pid=29971): stdout: | (launched: 2022-12-09_23:31:59.058249) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:32:00.714610 run osmo-stp_10.42.42.5(pid=29971): stderr: | 20221209233159229 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233159229 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233159229 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233159230 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233159230 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233159230 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233159230 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:32:00.855874 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29971): Process ended prematurely: osmo-stp_10.42.42.5(pid=29971) [trial-2366↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29971)] [trial-2366↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 23:32:00.865174 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 23:32:00.896457 run osmo-hlr_10.42.42.2(pid=29968): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29968)] 23:32:00.969572 run osmo-hlr_10.42.42.2(pid=29968): stdout: | (launched: 2022-12-09_23:31:58.122514) 23:32:01.024340 run osmo-hlr_10.42.42.2(pid=29968): stderr: | 20221209233158297 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209233158297 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209233158297 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209233158297 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209233158297 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209233158297 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209233158309 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209233158318 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209233158318 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209233158318 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:32:01.102793 run osmo-msc_10.42.42.6(pid=29974): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29974)] 23:32:01.155359 run osmo-msc_10.42.42.6(pid=29974): stdout: | (launched: 2022-12-09_23:32:00.003423) 23:32:01.209528 run osmo-msc_10.42.42.6(pid=29974): stderr: | 20221209233200273 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209233200274 DLGLOBAL DEBUG validating counter group 0x7fdef7f09c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209233200274 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209233200274 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209233200274 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209233200274 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209233200276 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209233200276 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209233200276 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209233200276 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:32:01.265488 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29967): Terminating (SIGTERM) 23:32:01.310124 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29970): Terminating (SIGTERM) 23:32:01.356374 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29973): Terminating (SIGTERM) 23:32:01.402614 --- ParallelTerminationStrategy: PID 29967 died... 23:32:01.425060 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29967): Terminated: ok {rc=0} 23:32:01.476643 --- ParallelTerminationStrategy: PID 29970 died... 23:32:01.497173 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29970): Terminated: ok {rc=0} 23:32:01.547276 --- ParallelTerminationStrategy: PID 29973 died... 23:32:01.568085 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29973): Terminated: ok {rc=0} 23:32:01.659265 bus /sierra_3: Setting Powered False 23:32:02.753478 bus /sierra_3: Setting Powered False 23:32:03.867791 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 23:32:05.017473 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:32:05.029817 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 23:32:05.104612 tst mo_mt_call_osmux.py: using LAC 24429 23:32:05.229355 tst mo_mt_call_osmux.py: using RAC 204 23:32:05.351614 tst mo_mt_call_osmux.py: using CellId 24429 23:32:05.476388 tst mo_mt_call_osmux.py: using BVCI 24430 23:32:05.592567 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:32:05.604326 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:32:05.615887 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:32:05.627806 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:32:05.639861 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:32:05.651852 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:32:05.770617 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:32:05.889478 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:32:06.382178 run create_hlr_db(pid=29976): Launched 23:32:06.503303 bus /sierra_2: Setting Powered False 23:32:07.566515 run create_hlr_db(pid=29976): Terminated: ok {rc=0} 23:32:07.991793 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29978): Launched 23:32:08.287978 run osmo-hlr_10.42.42.2(pid=29979): Launched 23:32:08.401875 run osmo-stp_10.42.42.5: Starting osmo-stp 23:32:08.926821 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29981): Launched 23:32:09.222494 run osmo-stp_10.42.42.5(pid=29982): Launched 23:32:09.335362 run osmo-msc_10.42.42.6: Starting osmo-msc 23:32:09.871670 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29984): Launched 23:32:10.167507 run osmo-msc_10.42.42.6(pid=29985): Launched 23:32:10.333150 run osmo-stp_10.42.42.5(pid=29982): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29982)] 23:32:10.458644 run osmo-stp_10.42.42.5(pid=29982): stdout: | (launched: 2022-12-09_23:32:09.167990) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:32:10.584047 run osmo-stp_10.42.42.5(pid=29982): stderr: | 20221209233209336 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233209336 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233209337 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233209337 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233209338 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233209338 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233209338 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:32:10.707079 run osmo-stp_10.42.42.5(pid=29982): stdout: | (launched: 2022-12-09_23:32:09.167990) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:32:10.824756 run osmo-stp_10.42.42.5(pid=29982): stderr: | 20221209233209336 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233209336 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233209337 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233209337 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233209338 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233209338 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233209338 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:32:10.965830 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29982): Process ended prematurely: osmo-stp_10.42.42.5(pid=29982) [trial-2366↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29982)] [trial-2366↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 23:32:10.974506 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 23:32:11.000257 run osmo-hlr_10.42.42.2(pid=29979): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29979)] 23:32:11.046969 run osmo-hlr_10.42.42.2(pid=29979): stdout: | (launched: 2022-12-09_23:32:08.234303) 23:32:11.095465 run osmo-hlr_10.42.42.2(pid=29979): stderr: | 20221209233208410 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209233208410 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209233208410 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209233208410 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209233208410 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209233208410 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209233208423 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209233208432 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209233208433 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209233208433 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:32:11.163781 run osmo-msc_10.42.42.6(pid=29985): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29985)] 23:32:11.210847 run osmo-msc_10.42.42.6(pid=29985): stdout: | (launched: 2022-12-09_23:32:10.112900) 23:32:11.259252 run osmo-msc_10.42.42.6(pid=29985): stderr: | 20221209233210383 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209233210384 DLGLOBAL DEBUG validating counter group 0x7f3942ab4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209233210384 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209233210384 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209233210384 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209233210384 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209233210387 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209233210387 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209233210388 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209233210388 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:32:11.308109 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29978): Terminating (SIGTERM) 23:32:11.346970 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29981): Terminating (SIGTERM) 23:32:11.385924 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29984): Terminating (SIGTERM) 23:32:11.424894 --- ParallelTerminationStrategy: PID 29978 died... 23:32:11.443668 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29978): Terminated: ok {rc=0} 23:32:11.486742 --- ParallelTerminationStrategy: PID 29981 died... 23:32:11.504772 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29981): Terminated: ok {rc=0} 23:32:11.548379 --- ParallelTerminationStrategy: PID 29984 died... 23:32:11.566744 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29984): Terminated: ok {rc=0} 23:32:11.648289 bus /sierra_3: Setting Powered False 23:32:12.744625 bus /sierra_3: Setting Powered False 23:32:13.859855 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 voice:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 23:32:15.102406 tst voice:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:32:15.108167 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 23:32:15.140641 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 23:32:15.166995 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 23:32:15.218517 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 23:32:15.251395 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 23:32:15.277755 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 23:32:15.827015 tst voice:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 23:32:15.879461 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:32:15.890981 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:32:15.963913 tst mo_mt_call.py: using LAC 24430 23:32:16.088012 tst mo_mt_call.py: using RAC 205 23:32:16.242605 tst mo_mt_call.py: using CellId 24430 23:32:16.372014 tst mo_mt_call.py: using BVCI 24431 23:32:16.529630 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:32:16.546253 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:32:16.564665 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:32:16.581918 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:32:16.599328 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:32:16.618159 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:32:16.760612 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:32:16.906613 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:32:17.404329 run create_hlr_db(pid=29990): Launched 23:32:17.532237 bus /sierra_2: Setting Powered False 23:32:18.595558 run create_hlr_db(pid=29990): Terminated: ok {rc=0} 23:32:19.022241 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29992): Launched 23:32:19.340857 run osmo-hlr_10.42.42.2(pid=29993): Launched 23:32:19.463296 run osmo-stp_10.42.42.5: Starting osmo-stp 23:32:20.011596 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29995): Launched 23:32:20.328895 run osmo-stp_10.42.42.5(pid=29996): Launched 23:32:20.451102 run osmo-msc_10.42.42.6: Starting osmo-msc 23:32:21.026094 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29998): Launched 23:32:21.342900 run osmo-msc_10.42.42.6(pid=29999): Launched 23:32:21.520771 run osmo-stp_10.42.42.5(pid=29996): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29996)] 23:32:21.655100 run osmo-stp_10.42.42.5(pid=29996): stdout: | (launched: 2022-12-09_23:32:20.271902) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:32:21.790747 run osmo-stp_10.42.42.5(pid=29996): stderr: | 20221209233220463 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233220463 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233220463 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233220463 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233220464 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233220464 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233220464 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:32:21.925891 run osmo-stp_10.42.42.5(pid=29996): stdout: | (launched: 2022-12-09_23:32:20.271902) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:32:22.052918 run osmo-stp_10.42.42.5(pid=29996): stderr: | 20221209233220463 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233220463 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233220463 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233220463 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233220464 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233220464 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233220464 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:32:22.205692 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29996): Process ended prematurely: osmo-stp_10.42.42.5(pid=29996) [trial-2366↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29996)] [trial-2366↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 23:32:22.215385 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 23:32:22.243843 run osmo-hlr_10.42.42.2(pid=29993): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29993)] 23:32:22.294213 run osmo-hlr_10.42.42.2(pid=29993): stdout: | (launched: 2022-12-09_23:32:19.283792) 23:32:22.346438 run osmo-hlr_10.42.42.2(pid=29993): stderr: | 20221209233219480 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209233219481 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209233219481 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209233219481 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209233219481 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209233219481 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209233219494 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209233219502 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209233219502 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209233219503 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:32:22.418648 run osmo-msc_10.42.42.6(pid=29999): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29999)] 23:32:22.469281 run osmo-msc_10.42.42.6(pid=29999): stdout: | (launched: 2022-12-09_23:32:21.285587) 23:32:22.521027 run osmo-msc_10.42.42.6(pid=29999): stderr: | 20221209233221607 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209233221607 DLGLOBAL DEBUG validating counter group 0x7ffb70746c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209233221607 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209233221607 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209233221607 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209233221608 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209233221610 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209233221610 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209233221610 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209233221610 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:32:22.573235 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29992): Terminating (SIGTERM) 23:32:22.614853 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29995): Terminating (SIGTERM) 23:32:22.657049 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29998): Terminating (SIGTERM) 23:32:22.699608 --- ParallelTerminationStrategy: PID 29992 died... 23:32:22.719491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29992): Terminated: ok {rc=0} 23:32:22.766612 --- ParallelTerminationStrategy: PID 29995 died... 23:32:22.786236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29995): Terminated: ok {rc=0} 23:32:22.833317 --- ParallelTerminationStrategy: PID 29998 died... 23:32:22.853057 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29998): Terminated: ok {rc=0} 23:32:22.942330 bus /sierra_3: Setting Powered False 23:32:24.040398 bus /sierra_3: Setting Powered False 23:32:25.157749 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 23:32:26.305948 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:32:26.318107 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:32:26.390757 tst mo_mt_call_osmux.py: using LAC 24431 23:32:26.516574 tst mo_mt_call_osmux.py: using RAC 206 23:32:26.643670 tst mo_mt_call_osmux.py: using CellId 24431 23:32:26.770469 tst mo_mt_call_osmux.py: using BVCI 24432 23:32:26.888216 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:32:26.899621 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:32:26.910839 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:32:26.922483 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:32:26.934005 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:32:26.945616 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:32:27.061782 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:32:27.179378 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:32:27.641611 run create_hlr_db(pid=30001): Launched 23:32:27.764642 bus /sierra_2: Setting Powered False 23:32:28.824854 run create_hlr_db(pid=30001): Terminated: ok {rc=0} 23:32:29.260195 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30003): Launched 23:32:29.578939 run osmo-hlr_10.42.42.2(pid=30004): Launched 23:32:29.700484 run osmo-stp_10.42.42.5: Starting osmo-stp 23:32:30.222889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30006): Launched 23:32:30.518843 run osmo-stp_10.42.42.5(pid=30007): Launched 23:32:30.631863 run osmo-msc_10.42.42.6: Starting osmo-msc 23:32:31.185951 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30009): Launched 23:32:31.499289 run osmo-msc_10.42.42.6(pid=30010): Launched 23:32:31.995410 run osmo-stp_10.42.42.5(pid=30007): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30007)] 23:32:32.332338 run osmo-stp_10.42.42.5(pid=30007): stdout: | (launched: 2022-12-09_23:32:30.464933) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:32:32.503432 run osmo-stp_10.42.42.5(pid=30007): stderr: | 20221209233230633 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233230633 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233230634 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233230634 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233230634 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233230634 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233230635 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:32:32.627585 run osmo-stp_10.42.42.5(pid=30007): stdout: | (launched: 2022-12-09_23:32:30.464933) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:32:32.745966 run osmo-stp_10.42.42.5(pid=30007): stderr: | 20221209233230633 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233230633 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233230634 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233230634 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233230634 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233230634 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233230635 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:32:32.887934 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30007): Process ended prematurely: osmo-stp_10.42.42.5(pid=30007) [trial-2366↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30007)] [trial-2366↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 23:32:32.896891 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 23:32:32.923456 run osmo-hlr_10.42.42.2(pid=30004): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30004)] 23:32:32.971222 run osmo-hlr_10.42.42.2(pid=30004): stdout: | (launched: 2022-12-09_23:32:29.521279) 23:32:33.021040 run osmo-hlr_10.42.42.2(pid=30004): stderr: | 20221209233229719 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209233229719 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209233229719 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209233229719 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209233229719 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209233229719 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209233229732 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209233229740 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209233229740 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209233229740 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:32:33.090066 run osmo-msc_10.42.42.6(pid=30010): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30010)] 23:32:33.137690 run osmo-msc_10.42.42.6(pid=30010): stdout: | (launched: 2022-12-09_23:32:31.435587) 23:32:33.186887 run osmo-msc_10.42.42.6(pid=30010): stderr: | 20221209233232060 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209233232060 DLGLOBAL DEBUG validating counter group 0x7f98ec4dec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209233232061 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209233232061 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209233232062 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209233232062 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209233232065 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209233232065 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209233232065 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209233232065 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:32:33.236418 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30003): Terminating (SIGTERM) 23:32:33.276101 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30006): Terminating (SIGTERM) 23:32:33.316116 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30009): Terminating (SIGTERM) 23:32:33.356352 --- ParallelTerminationStrategy: PID 30003 died... 23:32:33.375566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30003): Terminated: ok {rc=0} 23:32:33.419806 --- ParallelTerminationStrategy: PID 30006 died... 23:32:33.438992 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30006): Terminated: ok {rc=0} 23:32:33.483096 --- ParallelTerminationStrategy: PID 30009 died... 23:32:33.501825 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30009): Terminated: ok {rc=0} 23:32:33.587325 bus /sierra_3: Setting Powered False 23:32:34.687345 bus /sierra_3: Setting Powered False 23:32:35.804321 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 voice:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 voice:trx-b200+mod-bts0-trxdversion0 --------------------------------------------------------------------- 23:32:37.066550 tst voice:trx-b200+mod-bts0-trxdversion0: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:32:37.072264 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 1 x bts (candidates: 11) 23:32:37.106904 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 6 x ip_address (candidates: 9) 23:32:37.133941 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 2 x modem (candidates: 12) 23:32:37.183884 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 1 x bts (candidates: 11) 23:32:37.217995 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 6 x ip_address (candidates: 9) 23:32:37.245515 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 2 x modem (candidates: 12) 23:32:37.797744 tst voice:trx-b200+mod-bts0-trxdversion0: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call.py ---------------------------------------------- 23:32:37.849236 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 23:32:37.860456 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 23:32:37.910258 tst mo_mt_call.py: using LAC 24432 23:32:38.034686 tst mo_mt_call.py: using RAC 207 23:32:38.158680 tst mo_mt_call.py: using CellId 24432 23:32:38.283615 tst mo_mt_call.py: using BVCI 24433 23:32:38.391966 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 23:32:38.403206 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 23:32:38.414145 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 23:32:38.425148 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 23:32:38.436068 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 23:32:38.447188 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 23:32:38.566962 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 23:32:38.686361 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:32:39.147692 run create_hlr_db(pid=30015): Launched 23:32:39.268025 bus /sierra_2: Setting Powered False 23:32:40.328311 run create_hlr_db(pid=30015): Terminated: ok {rc=0} 23:32:40.741686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30017): Launched 23:32:41.037645 run osmo-hlr_10.42.42.2(pid=30018): Launched 23:32:41.149652 run osmo-stp_10.42.42.5: Starting osmo-stp 23:32:41.673577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30020): Launched 23:32:41.971045 run osmo-stp_10.42.42.5(pid=30021): Launched 23:32:42.084846 run osmo-msc_10.42.42.6: Starting osmo-msc 23:32:42.621569 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30023): Launched 23:32:42.918620 run osmo-msc_10.42.42.6(pid=30024): Launched 23:32:43.084547 run osmo-stp_10.42.42.5(pid=30021): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30021)] 23:32:43.210171 run osmo-stp_10.42.42.5(pid=30021): stdout: | (launched: 2022-12-09_23:32:41.916844) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:32:43.335631 run osmo-stp_10.42.42.5(pid=30021): stderr: | 20221209233242088 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233242088 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233242089 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233242089 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233242090 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233242090 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233242090 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:32:43.458309 run osmo-stp_10.42.42.5(pid=30021): stdout: | (launched: 2022-12-09_23:32:41.916844) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:32:43.576075 run osmo-stp_10.42.42.5(pid=30021): stderr: | 20221209233242088 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233242088 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233242089 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233242089 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233242090 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233242090 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233242090 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:32:43.717285 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30021): Process ended prematurely: osmo-stp_10.42.42.5(pid=30021) [trial-2366↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30021)] [trial-2366↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8] 23:32:43.725958 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 23:32:43.751719 run osmo-hlr_10.42.42.2(pid=30018): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30018)] 23:32:43.798875 run osmo-hlr_10.42.42.2(pid=30018): stdout: | (launched: 2022-12-09_23:32:40.984063) 23:32:43.847666 run osmo-hlr_10.42.42.2(pid=30018): stderr: | 20221209233241158 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209233241159 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209233241159 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209233241159 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209233241159 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209233241159 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209233241172 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209233241180 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209233241180 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209233241180 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:32:43.915803 run osmo-msc_10.42.42.6(pid=30024): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30024)] 23:32:43.962857 run osmo-msc_10.42.42.6(pid=30024): stdout: | (launched: 2022-12-09_23:32:42.864773) 23:32:44.011385 run osmo-msc_10.42.42.6(pid=30024): stderr: | 20221209233243138 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209233243138 DLGLOBAL DEBUG validating counter group 0x7f5a2fd21c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209233243138 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209233243138 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209233243138 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209233243139 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209233243140 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209233243141 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209233243141 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209233243141 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:32:44.060367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30017): Terminating (SIGTERM) 23:32:44.099347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30020): Terminating (SIGTERM) 23:32:44.138491 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30023): Terminating (SIGTERM) 23:32:44.177751 --- ParallelTerminationStrategy: PID 30017 died... 23:32:44.196410 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30017): Terminated: ok {rc=0} 23:32:44.240043 --- ParallelTerminationStrategy: PID 30020 died... 23:32:44.258500 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30020): Terminated: ok {rc=0} 23:32:44.301620 --- ParallelTerminationStrategy: PID 30023 died... 23:32:44.319958 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30023): Terminated: ok {rc=0} 23:32:44.402250 bus /sierra_3: Setting Powered False 23:32:45.499836 bus /sierra_3: Setting Powered False 23:32:46.624621 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call_osmux.py ---------------------------------------------- 23:32:47.789300 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 23:32:47.801528 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 23:32:47.852421 tst mo_mt_call_osmux.py: using LAC 24433 23:32:47.977087 tst mo_mt_call_osmux.py: using RAC 208 23:32:48.100885 tst mo_mt_call_osmux.py: using CellId 24433 23:32:48.224429 tst mo_mt_call_osmux.py: using BVCI 24434 23:32:48.340274 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 23:32:48.351899 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 23:32:48.363220 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 23:32:48.374767 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 23:32:48.386258 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 23:32:48.397696 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 23:32:48.514186 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 23:32:48.635589 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:32:49.097366 run create_hlr_db(pid=30026): Launched 23:32:49.218350 bus /sierra_2: Setting Powered False 23:32:50.277625 run create_hlr_db(pid=30026): Terminated: ok {rc=0} 23:32:50.713921 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30028): Launched 23:32:51.031936 run osmo-hlr_10.42.42.2(pid=30029): Launched 23:32:51.154123 run osmo-stp_10.42.42.5: Starting osmo-stp 23:32:51.705397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30031): Launched 23:32:52.024619 run osmo-stp_10.42.42.5(pid=30032): Launched 23:32:52.146640 run osmo-msc_10.42.42.6: Starting osmo-msc 23:32:52.721760 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30034): Launched 23:32:53.040185 run osmo-msc_10.42.42.6(pid=30035): Launched 23:32:53.217885 run osmo-stp_10.42.42.5(pid=30032): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30032)] 23:32:53.352344 run osmo-stp_10.42.42.5(pid=30032): stdout: | (launched: 2022-12-09_23:32:51.966403) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:32:53.488047 run osmo-stp_10.42.42.5(pid=30032): stderr: | 20221209233252158 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233252159 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233252159 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233252159 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233252160 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233252160 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233252160 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:32:53.622402 run osmo-stp_10.42.42.5(pid=30032): stdout: | (launched: 2022-12-09_23:32:51.966403) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:32:53.749376 run osmo-stp_10.42.42.5(pid=30032): stderr: | 20221209233252158 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233252159 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233252159 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233252159 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233252160 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233252160 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233252160 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:32:53.901634 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30032): Process ended prematurely: osmo-stp_10.42.42.5(pid=30032) [trial-2366↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30032)] [trial-2366↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8] 23:32:53.911323 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 23:32:53.939678 run osmo-hlr_10.42.42.2(pid=30029): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30029)] 23:32:53.989883 run osmo-hlr_10.42.42.2(pid=30029): stdout: | (launched: 2022-12-09_23:32:50.974718) 23:32:54.041561 run osmo-hlr_10.42.42.2(pid=30029): stderr: | 20221209233251171 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209233251171 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209233251171 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209233251171 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209233251171 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209233251171 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209233251182 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209233251191 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209233251191 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209233251191 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:32:54.113540 run osmo-msc_10.42.42.6(pid=30035): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30035)] 23:32:54.163679 run osmo-msc_10.42.42.6(pid=30035): stdout: | (launched: 2022-12-09_23:32:52.982426) 23:32:54.215287 run osmo-msc_10.42.42.6(pid=30035): stderr: | 20221209233253305 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209233253306 DLGLOBAL DEBUG validating counter group 0x7f4630bb6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209233253306 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209233253306 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209233253306 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209233253306 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209233253308 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209233253308 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209233253308 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209233253308 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:32:54.267135 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30028): Terminating (SIGTERM) 23:32:54.308846 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30031): Terminating (SIGTERM) 23:32:54.350834 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30034): Terminating (SIGTERM) 23:32:54.392844 --- ParallelTerminationStrategy: PID 30028 died... 23:32:54.412648 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30028): Terminated: ok {rc=0} 23:32:54.459422 --- ParallelTerminationStrategy: PID 30031 died... 23:32:54.479342 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30031): Terminated: ok {rc=0} 23:32:54.525779 --- ParallelTerminationStrategy: PID 30034 died... 23:32:54.545261 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30034): Terminated: ok {rc=0} 23:32:54.633363 bus /sierra_3: Setting Powered False 23:32:55.731034 bus /sierra_3: Setting Powered False 23:32:56.847872 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 voice:trx-b200+mod-bts0-trxdversion0 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 23:32:58.089273 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:32:58.096507 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 23:32:58.131641 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 23:32:58.158798 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 23:32:58.211662 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 23:32:58.245801 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 23:32:58.273373 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 23:32:58.827391 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 23:32:58.879030 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:32:58.890954 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 23:32:58.944372 tst mo_mt_call.py: using LAC 24434 23:32:59.073528 tst mo_mt_call.py: using RAC 209 23:32:59.198267 tst mo_mt_call.py: using CellId 24434 23:32:59.323007 tst mo_mt_call.py: using BVCI 24435 23:32:59.439082 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:32:59.450784 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:32:59.462293 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:32:59.474433 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:32:59.486313 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:32:59.498054 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 23:32:59.617635 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 23:32:59.736790 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:33:00.230754 run create_hlr_db(pid=30040): Launched 23:33:00.351046 bus /sierra_2: Setting Powered False 23:33:01.412720 run create_hlr_db(pid=30040): Terminated: ok {rc=0} 23:33:01.877876 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30043): Launched 23:33:02.206647 run osmo-hlr_10.42.42.2(pid=30044): Launched 23:33:02.328787 run osmo-stp_10.42.42.5: Starting osmo-stp 23:33:02.882079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30046): Launched 23:33:03.201471 run osmo-stp_10.42.42.5(pid=30047): Launched 23:33:03.323817 run osmo-msc_10.42.42.6: Starting osmo-msc 23:33:03.902430 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30049): Launched 23:33:04.220080 run osmo-msc_10.42.42.6(pid=30050): Launched 23:33:04.398326 run osmo-stp_10.42.42.5(pid=30047): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30047)] 23:33:04.534164 run osmo-stp_10.42.42.5(pid=30047): stdout: | (launched: 2022-12-09_23:33:03.143728) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:33:04.669759 run osmo-stp_10.42.42.5(pid=30047): stderr: | 20221209233303334 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233303335 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233303335 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233303335 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233303336 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233303336 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233303336 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:33:04.804280 run osmo-stp_10.42.42.5(pid=30047): stdout: | (launched: 2022-12-09_23:33:03.143728) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:33:04.931389 run osmo-stp_10.42.42.5(pid=30047): stderr: | 20221209233303334 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233303335 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233303335 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233303335 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233303336 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233303336 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233303336 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:33:05.083825 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30047): Process ended prematurely: osmo-stp_10.42.42.5(pid=30047) [trial-2366↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30047)] [trial-2366↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 23:33:05.093395 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 23:33:05.121499 run osmo-hlr_10.42.42.2(pid=30044): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30044)] 23:33:05.171655 run osmo-hlr_10.42.42.2(pid=30044): stdout: | (launched: 2022-12-09_23:33:02.145971) 23:33:05.223610 run osmo-hlr_10.42.42.2(pid=30044): stderr: | 20221209233302345 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209233302345 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209233302345 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209233302345 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209233302345 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209233302345 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209233302356 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209233302364 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209233302365 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209233302365 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:33:05.295588 run osmo-msc_10.42.42.6(pid=30050): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30050)] 23:33:05.345699 run osmo-msc_10.42.42.6(pid=30050): stdout: | (launched: 2022-12-09_23:33:04.162651) 23:33:05.397377 run osmo-msc_10.42.42.6(pid=30050): stderr: | 20221209233304484 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209233304484 DLGLOBAL DEBUG validating counter group 0x7f3435d65c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209233304484 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209233304484 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209233304484 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209233304485 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209233304486 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209233304487 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209233304487 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209233304487 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:33:05.449703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30043): Terminating (SIGTERM) 23:33:05.491949 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30046): Terminating (SIGTERM) 23:33:05.533976 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30049): Terminating (SIGTERM) 23:33:05.576153 --- ParallelTerminationStrategy: PID 30043 died... 23:33:05.596153 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30043): Terminated: ok {rc=0} 23:33:05.642717 --- ParallelTerminationStrategy: PID 30046 died... 23:33:05.662183 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30046): Terminated: ok {rc=0} 23:33:05.708474 --- ParallelTerminationStrategy: PID 30049 died... 23:33:05.727998 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30049): Terminated: ok {rc=0} 23:33:05.815629 bus /sierra_3: Setting Powered False 23:33:06.914771 bus /sierra_3: Setting Powered False 23:33:08.031767 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 23:33:09.178731 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:33:09.191339 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 23:33:09.245452 tst mo_mt_call_osmux.py: using LAC 24435 23:33:09.366549 tst mo_mt_call_osmux.py: using RAC 210 23:33:09.483923 tst mo_mt_call_osmux.py: using CellId 24435 23:33:09.609176 tst mo_mt_call_osmux.py: using BVCI 24436 23:33:09.724342 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:33:09.736378 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:33:09.748257 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:33:09.760129 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:33:09.772362 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:33:09.784286 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 23:33:09.901448 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 23:33:10.019623 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:33:10.480371 run create_hlr_db(pid=30052): Launched 23:33:10.602992 bus /sierra_2: Setting Powered False 23:33:11.662068 run create_hlr_db(pid=30052): Terminated: ok {rc=0} 23:33:12.077188 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30054): Launched 23:33:12.372434 run osmo-hlr_10.42.42.2(pid=30055): Launched 23:33:12.484667 run osmo-stp_10.42.42.5: Starting osmo-stp 23:33:13.006597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30057): Launched 23:33:13.301626 run osmo-stp_10.42.42.5(pid=30058): Launched 23:33:13.414384 run osmo-msc_10.42.42.6: Starting osmo-msc 23:33:13.951543 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30060): Launched 23:33:14.247598 run osmo-msc_10.42.42.6(pid=30061): Launched 23:33:14.413166 run osmo-stp_10.42.42.5(pid=30058): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30058)] 23:33:14.538437 run osmo-stp_10.42.42.5(pid=30058): stdout: | (launched: 2022-12-09_23:33:13.248035) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:33:14.664686 run osmo-stp_10.42.42.5(pid=30058): stderr: | 20221209233313417 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233313418 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233313418 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233313418 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233313419 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233313419 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233313419 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:33:14.787913 run osmo-stp_10.42.42.5(pid=30058): stdout: | (launched: 2022-12-09_23:33:13.248035) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:33:14.905938 run osmo-stp_10.42.42.5(pid=30058): stderr: | 20221209233313417 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233313418 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233313418 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233313418 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233313419 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233313419 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233313419 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:33:15.046868 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30058): Process ended prematurely: osmo-stp_10.42.42.5(pid=30058) [trial-2366↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30058)] [trial-2366↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 23:33:15.055627 tst mo_mt_call_osmux.py:8: Test FAILED (5.9 sec) 23:33:15.081329 run osmo-hlr_10.42.42.2(pid=30055): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30055)] 23:33:15.128248 run osmo-hlr_10.42.42.2(pid=30055): stdout: | (launched: 2022-12-09_23:33:12.318827) 23:33:15.176660 run osmo-hlr_10.42.42.2(pid=30055): stderr: | 20221209233312493 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209233312493 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209233312493 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209233312493 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209233312493 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209233312494 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209233312506 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209233312517 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209233312517 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209233312517 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:33:15.244437 run osmo-msc_10.42.42.6(pid=30061): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30061)] 23:33:15.291033 run osmo-msc_10.42.42.6(pid=30061): stdout: | (launched: 2022-12-09_23:33:14.193791) 23:33:15.339182 run osmo-msc_10.42.42.6(pid=30061): stderr: | 20221209233314463 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209233314463 DLGLOBAL DEBUG validating counter group 0x7f9a467f7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209233314463 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209233314463 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209233314464 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209233314464 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209233314467 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209233314467 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209233314467 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209233314467 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:33:15.387885 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30054): Terminating (SIGTERM) 23:33:15.426588 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30057): Terminating (SIGTERM) 23:33:15.465432 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30060): Terminating (SIGTERM) 23:33:15.504920 --- ParallelTerminationStrategy: PID 30054 died... 23:33:15.523708 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30054): Terminated: ok {rc=0} 23:33:15.567366 --- ParallelTerminationStrategy: PID 30057 died... 23:33:15.585736 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30057): Terminated: ok {rc=0} 23:33:15.628997 --- ParallelTerminationStrategy: PID 30060 died... 23:33:15.647223 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30060): Terminated: ok {rc=0} 23:33:15.732206 bus /sierra_3: Setting Powered False 23:33:16.828161 bus /sierra_3: Setting Powered False 23:33:17.943559 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 emergency:trx-b200 --------------------------------------------------------------------- 23:33:19.197209 tst emergency:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:33:19.202113 tst emergency:trx-b200: Verifying 1 x bts (candidates: 11) 23:33:19.236876 tst emergency:trx-b200: Verifying 6 x ip_address (candidates: 9) 23:33:19.264588 tst emergency:trx-b200: Verifying 4 x modem (candidates: 12) 23:33:19.349766 tst emergency:trx-b200: Reserving 1 x bts (candidates: 11) 23:33:19.383911 tst emergency:trx-b200: Reserving 6 x ip_address (candidates: 9) 23:33:19.411169 tst emergency:trx-b200: Reserving 4 x modem (candidates: 12) 23:33:19.996749 tst emergency:trx-b200: RESERVED RESOURCES for emergency: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2366 emergency:trx-b200 emergency_mo_mt_call.py ---------------------------------------------- 23:33:20.002280 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 23:33:20.013500 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 23:33:20.067266 tst emergency_mo_mt_call.py: using LAC 24436 23:33:20.190168 tst emergency_mo_mt_call.py: using RAC 211 23:33:20.312815 tst emergency_mo_mt_call.py: using CellId 24436 23:33:20.433927 tst emergency_mo_mt_call.py: using BVCI 24437 23:33:20.548543 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 23:33:20.559669 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 23:33:20.570551 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 23:33:20.581785 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 23:33:20.593007 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 23:33:20.604400 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 23:33:20.720876 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 23:33:20.835626 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:33:21.288806 run create_hlr_db(pid=30066): Launched 23:33:21.407764 bus /sierra_2: Setting Powered False 23:33:22.466063 run create_hlr_db(pid=30066): Terminated: ok {rc=0} 23:33:22.893853 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30068): Launched 23:33:23.206012 run osmo-hlr_10.42.42.2(pid=30069): Launched 23:33:23.325437 run osmo-stp_10.42.42.5: Starting osmo-stp 23:33:23.863835 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30071): Launched 23:33:24.176150 run osmo-stp_10.42.42.5(pid=30072): Launched 23:33:24.304202 tst emergency_mo_mt_call.py: using MSISDN 7436 23:33:24.463283 run osmo-msc_10.42.42.6: Starting osmo-msc 23:33:25.028278 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30074): Launched 23:33:25.340227 run osmo-msc_10.42.42.6(pid=30075): Launched 23:33:25.515544 run osmo-stp_10.42.42.5(pid=30072): ERR: Terminated: ERROR {rc=1} [trial-2366↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30072)] 23:33:25.647700 run osmo-stp_10.42.42.5(pid=30072): stdout: | (launched: 2022-12-09_23:33:24.119565) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:33:25.780832 run osmo-stp_10.42.42.5(pid=30072): stderr: | 20221209233324310 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233324311 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233324311 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233324311 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233324312 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233324312 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233324312 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:33:25.913157 run osmo-stp_10.42.42.5(pid=30072): stdout: | (launched: 2022-12-09_23:33:24.119565) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:33:26.037804 run osmo-stp_10.42.42.5(pid=30072): stderr: | 20221209233324310 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233324311 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233324311 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233324311 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233324312 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233324312 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233324312 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:33:26.187220 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=30072): Process ended prematurely: osmo-stp_10.42.42.5(pid=30072) [trial-2366↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30072)] [trial-2366↪emergency:trx-b200↪emergency_mo_mt_call.py:19] 23:33:26.196186 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 23:33:26.224073 run osmo-hlr_10.42.42.2(pid=30069): ERR: Terminated: ERROR {rc=237} [trial-2366↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30069)] 23:33:26.274113 run osmo-hlr_10.42.42.2(pid=30069): stdout: | (launched: 2022-12-09_23:33:23.149036) 23:33:26.325973 run osmo-hlr_10.42.42.2(pid=30069): stderr: | 20221209233323345 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209233323345 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209233323345 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209233323345 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209233323345 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209233323345 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209233323361 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/emergency:trx-b200/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209233323372 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209233323372 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209233323372 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:33:26.398400 run osmo-msc_10.42.42.6(pid=30075): ERR: Terminated: ERROR {rc=2} [trial-2366↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30075)] 23:33:26.448379 run osmo-msc_10.42.42.6(pid=30075): stdout: | (launched: 2022-12-09_23:33:25.283529) 23:33:26.499961 run osmo-msc_10.42.42.6(pid=30075): stderr: | 20221209233325602 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209233325602 DLGLOBAL DEBUG validating counter group 0x7f34e9427c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209233325602 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209233325602 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209233325603 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209233325603 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209233325604 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209233325605 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209233325605 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209233325605 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:33:26.551836 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30068): Terminating (SIGTERM) 23:33:26.593700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30071): Terminating (SIGTERM) 23:33:26.635693 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30074): Terminating (SIGTERM) 23:33:26.677761 --- ParallelTerminationStrategy: PID 30068 died... 23:33:26.697621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30068): Terminated: ok {rc=0} 23:33:26.744361 --- ParallelTerminationStrategy: PID 30071 died... 23:33:26.763850 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30071): Terminated: ok {rc=0} 23:33:26.810334 --- ParallelTerminationStrategy: PID 30074 died... 23:33:26.829756 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30074): Terminated: ok {rc=0} 23:33:26.917023 bus /sierra_3: Setting Powered False 23:33:28.015565 bus /sierra_3: Setting Powered False 23:33:29.130164 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 emergency:trx-b200 emergency_preemptive_call.py ---------------------------------------------- 23:33:30.216367 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 23:33:30.228631 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 23:33:30.281629 tst emergency_preemptive_call.py: using LAC 24437 23:33:30.396839 tst emergency_preemptive_call.py: using RAC 212 23:33:30.515549 tst emergency_preemptive_call.py: using CellId 24437 23:33:30.629227 tst emergency_preemptive_call.py: using BVCI 24438 23:33:30.735081 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 23:33:30.745748 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 23:33:30.756094 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 23:33:30.766514 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 23:33:30.777258 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 23:33:30.787638 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 23:33:30.928746 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 23:33:31.056862 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 23:33:31.202272 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 23:33:31.351993 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:33:31.835536 run create_hlr_db(pid=30077): Launched 23:33:31.979421 bus /sierra_2: Setting Powered False 23:33:33.039189 run create_hlr_db(pid=30077): Terminated: ok {rc=0} 23:33:33.467439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30079): Launched 23:33:33.780474 run osmo-hlr_10.42.42.2(pid=30080): Launched 23:33:33.900516 run osmo-stp_10.42.42.5: Starting osmo-stp 23:33:34.441371 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30082): Launched 23:33:34.754467 run osmo-stp_10.42.42.5(pid=30083): Launched 23:33:34.882665 tst emergency_preemptive_call.py: using MSISDN 7437 23:33:35.043793 run osmo-msc_10.42.42.6: Starting osmo-msc 23:33:35.603363 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30085): Launched 23:33:35.914949 run osmo-msc_10.42.42.6(pid=30086): Launched 23:33:36.088635 run osmo-stp_10.42.42.5(pid=30083): ERR: Terminated: ERROR {rc=1} [trial-2366↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30083)] 23:33:36.221410 run osmo-stp_10.42.42.5(pid=30083): stdout: | (launched: 2022-12-09_23:33:34.697995) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:33:36.354040 run osmo-stp_10.42.42.5(pid=30083): stderr: | 20221209233334890 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233334890 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233334891 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233334891 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233334892 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233334892 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233334892 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:33:36.486632 run osmo-stp_10.42.42.5(pid=30083): stdout: | (launched: 2022-12-09_23:33:34.697995) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:33:36.612209 run osmo-stp_10.42.42.5(pid=30083): stderr: | 20221209233334890 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233334890 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233334891 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233334891 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233334892 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233334892 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233334892 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:33:36.762247 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=30083): Process ended prematurely: osmo-stp_10.42.42.5(pid=30083) [trial-2366↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30083)] [trial-2366↪emergency:trx-b200↪emergency_preemptive_call.py:32] 23:33:36.771311 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 23:33:36.799532 run osmo-hlr_10.42.42.2(pid=30080): ERR: Terminated: ERROR {rc=237} [trial-2366↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30080)] 23:33:36.850202 run osmo-hlr_10.42.42.2(pid=30080): stdout: | (launched: 2022-12-09_23:33:33.723858) 23:33:36.902665 run osmo-hlr_10.42.42.2(pid=30080): stderr: | 20221209233333922 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209233333922 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209233333922 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209233333922 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209233333922 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209233333922 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209233333935 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/emergency:trx-b200/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209233333943 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209233333944 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209233333944 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:33:36.975379 run osmo-msc_10.42.42.6(pid=30086): ERR: Terminated: ERROR {rc=2} [trial-2366↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30086)] 23:33:37.025661 run osmo-msc_10.42.42.6(pid=30086): stdout: | (launched: 2022-12-09_23:33:35.858345) 23:33:37.077397 run osmo-msc_10.42.42.6(pid=30086): stderr: | 20221209233336178 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209233336178 DLGLOBAL DEBUG validating counter group 0x7fe6f7231c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209233336178 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209233336178 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209233336179 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209233336179 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209233336181 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209233336181 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209233336181 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209233336181 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:33:37.129426 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30079): Terminating (SIGTERM) 23:33:37.171063 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30082): Terminating (SIGTERM) 23:33:37.212895 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30085): Terminating (SIGTERM) 23:33:37.255850 --- ParallelTerminationStrategy: PID 30079 died... 23:33:37.275751 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30079): Terminated: ok {rc=0} 23:33:37.322753 --- ParallelTerminationStrategy: PID 30082 died... 23:33:37.342361 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30082): Terminated: ok {rc=0} 23:33:37.389222 --- ParallelTerminationStrategy: PID 30085 died... 23:33:37.408786 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30085): Terminated: ok {rc=0} 23:33:37.497638 bus /sierra_9: Setting Powered False 23:33:38.595687 bus /sierra_9: Setting Powered False 23:33:39.713813 bus /sierra_8: Setting Powered False 23:33:40.813110 bus /sierra_8: Setting Powered False 23:33:41.931464 bus /sierra_3: Setting Powered False 23:33:43.029448 bus /sierra_3: Setting Powered False 23:33:44.146513 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 emergency:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 gprs:trx-b200 --------------------------------------------------------------------- 23:33:45.428681 tst gprs:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:33:45.433724 tst gprs:trx-b200: Verifying 1 x bts (candidates: 11) 23:33:45.466826 tst gprs:trx-b200: Verifying 9 x ip_address (candidates: 9) 23:33:45.504870 tst gprs:trx-b200: Verifying 4 x modem (candidates: 12) 23:33:45.596037 tst gprs:trx-b200: Reserving 1 x bts (candidates: 11) 23:33:45.628931 tst gprs:trx-b200: Reserving 9 x ip_address (candidates: 9) 23:33:45.666990 tst gprs:trx-b200: Reserving 4 x modem (candidates: 12) 23:33:46.293429 tst gprs:trx-b200: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2366 gprs:trx-b200 cs_paging_gprs_active.py ---------------------------------------------- 23:33:46.374892 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:33:46.388646 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 23:33:46.449909 tst cs_paging_gprs_active.py: using LAC 24438 23:33:46.578428 tst cs_paging_gprs_active.py: using RAC 213 23:33:46.705983 tst cs_paging_gprs_active.py: using CellId 24438 23:33:46.871085 tst cs_paging_gprs_active.py: using BVCI 24439 23:33:46.990758 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:33:47.003182 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:33:47.015033 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:33:47.027732 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:33:47.041302 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:33:47.054033 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:33:47.066106 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:33:47.080201 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:33:47.092215 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 23:33:47.216230 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 23:33:47.335045 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:33:47.535544 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:33:47.834336 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30092): Launched 23:33:48.093365 run iperf3-srv_10.42.42.10(pid=30093): Launched 23:33:48.206298 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:33:48.408444 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:33:48.709738 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30094): Launched 23:33:48.968525 run iperf3-srv_10.42.42.10(pid=30095): Launched 23:33:49.080884 tst cs_paging_gprs_active.py:38: start network... 23:33:49.281096 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:33:49.742903 run create_hlr_db(pid=30096): Launched 23:33:49.865087 bus /sierra_2: Setting Powered False 23:33:50.925295 run create_hlr_db(pid=30096): Terminated: ok {rc=0} 23:33:51.362064 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30098): Launched 23:33:51.682042 run osmo-hlr_10.42.42.2(pid=30099): Launched 23:33:51.803490 run osmo-stp_10.42.42.5: Starting osmo-stp 23:33:52.355420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30101): Launched 23:33:52.674180 run osmo-stp_10.42.42.5(pid=30102): Launched 23:33:52.795750 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:33:53.348137 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30104): Launched 23:33:53.470768 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:33:53.741892 run patchelf(pid=30105): Launched 23:33:53.919384 run osmo-stp_10.42.42.5(pid=30102): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30102)] 23:33:54.055569 run osmo-stp_10.42.42.5(pid=30102): stdout: | (launched: 2022-12-09_23:33:52.616696) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:33:54.193821 run osmo-stp_10.42.42.5(pid=30102): stderr: | 20221209233352806 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233352806 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233352807 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233352807 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233352810 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233352810 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233352810 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:33:54.331909 run osmo-stp_10.42.42.5(pid=30102): stdout: | (launched: 2022-12-09_23:33:52.616696) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:33:54.463808 run osmo-stp_10.42.42.5(pid=30102): stderr: | 20221209233352806 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233352806 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233352807 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233352807 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233352810 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233352810 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233352810 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:33:54.619997 run patchelf(pid=30105): Terminating (SIGINT) 23:33:54.799726 run patchelf(pid=30105): Terminated: ok {rc=0} 23:33:54.929321 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=30102): Process ended prematurely: osmo-stp_10.42.42.5(pid=30102) [trial-2366↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30102)] [trial-2366↪gprs:trx-b200↪cs_paging_gprs_active.py:38] 23:33:54.939479 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 23:33:54.968151 run osmo-hlr_10.42.42.2(pid=30099): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-b200↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30099)] 23:33:55.017984 run osmo-hlr_10.42.42.2(pid=30099): stdout: | (launched: 2022-12-09_23:33:51.624616) 23:33:55.069555 run osmo-hlr_10.42.42.2(pid=30099): stderr: | 20221209233351819 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209233351819 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209233351819 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209233351820 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209233351820 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209233351820 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209233351832 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-b200/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209233351840 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209233351840 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209233351840 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:33:55.121749 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30092): Terminating (SIGTERM) 23:33:55.163727 run iperf3-srv_10.42.42.10(pid=30093): Terminating (SIGTERM) 23:33:55.205765 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30094): Terminating (SIGTERM) 23:33:55.247635 run iperf3-srv_10.42.42.10(pid=30095): Terminating (SIGTERM) 23:33:55.289384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30098): Terminating (SIGTERM) 23:33:55.331249 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30101): Terminating (SIGTERM) 23:33:55.372934 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30104): Terminating (SIGTERM) 23:33:55.414955 --- ParallelTerminationStrategy: PID 30092 died... 23:33:55.434787 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30092): Terminated: ok {rc=0} 23:33:55.481407 --- ParallelTerminationStrategy: PID 30093 died... 23:33:55.500809 run iperf3-srv_10.42.42.10(pid=30093): Terminated {rc=256} 23:33:55.546983 --- ParallelTerminationStrategy: PID 30094 died... 23:33:55.566368 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30094): Terminated: ok {rc=0} 23:33:55.612510 --- ParallelTerminationStrategy: PID 30095 died... 23:33:55.631797 run iperf3-srv_10.42.42.10(pid=30095): Terminated {rc=256} 23:33:55.677871 --- ParallelTerminationStrategy: PID 30098 died... 23:33:55.697369 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30098): Terminated: ok {rc=0} 23:33:55.743416 --- ParallelTerminationStrategy: PID 30101 died... 23:33:55.762864 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30101): Terminated: ok {rc=0} 23:33:55.809197 --- ParallelTerminationStrategy: PID 30104 died... 23:33:55.828446 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30104): Terminated: ok {rc=0} 23:33:55.915514 bus /gobi_0: Setting Powered False 23:33:57.015773 bus /gobi_0: Setting Powered False 23:33:58.131582 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-b200 iperf3.py ---------------------------------------------- 23:33:59.273939 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:33:59.284996 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 23:33:59.335803 tst iperf3.py: using LAC 24439 23:33:59.453361 tst iperf3.py: using RAC 214 23:33:59.571117 tst iperf3.py: using CellId 24439 23:33:59.690581 tst iperf3.py: using BVCI 24440 23:33:59.799842 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:33:59.810518 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:33:59.820894 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:33:59.831254 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:33:59.841479 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:33:59.851653 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:33:59.862166 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:33:59.872392 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:33:59.882810 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 23:33:59.999998 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:34:00.217074 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:34:00.538294 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30106): Launched 23:34:00.815902 run iperf3-srv_10.42.42.10(pid=30107): Launched 23:34:00.945503 tst iperf3.py:8: start network... 23:34:01.166840 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:34:01.675323 run create_hlr_db(pid=30108): Launched 23:34:01.832868 bus /gobi_6: Setting Powered False 23:34:02.896155 run create_hlr_db(pid=30108): Terminated: ok {rc=0} 23:34:03.339454 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30110): Launched 23:34:03.657524 run osmo-hlr_10.42.42.2(pid=30111): Launched 23:34:03.779246 run osmo-stp_10.42.42.5: Starting osmo-stp 23:34:04.330936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30113): Launched 23:34:04.650042 run osmo-stp_10.42.42.5(pid=30114): Launched 23:34:04.771823 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:34:05.320614 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30116): Launched 23:34:05.442905 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:34:05.712620 run patchelf(pid=30117): Launched 23:34:05.889781 run osmo-stp_10.42.42.5(pid=30114): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30114)] 23:34:06.025067 run osmo-stp_10.42.42.5(pid=30114): stdout: | (launched: 2022-12-09_23:34:04.592440) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:34:06.162547 run osmo-stp_10.42.42.5(pid=30114): stderr: | 20221209233404782 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233404782 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233404783 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233404783 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233404783 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233404784 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233404784 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:34:06.300402 run osmo-stp_10.42.42.5(pid=30114): stdout: | (launched: 2022-12-09_23:34:04.592440) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:34:06.431254 run osmo-stp_10.42.42.5(pid=30114): stderr: | 20221209233404782 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233404782 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233404783 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233404783 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233404783 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233404784 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233404784 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:34:06.587305 run patchelf(pid=30117): Terminating (SIGINT) 23:34:06.766832 run patchelf(pid=30117): Terminated: ok {rc=0} 23:34:06.896080 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30114): Process ended prematurely: osmo-stp_10.42.42.5(pid=30114) [trial-2366↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30114)] [trial-2366↪gprs:trx-b200↪iperf3.py:8] 23:34:06.906288 tst iperf3.py:8: Test FAILED (7.7 sec) 23:34:06.934988 run osmo-hlr_10.42.42.2(pid=30111): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-b200↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30111)] 23:34:06.984666 run osmo-hlr_10.42.42.2(pid=30111): stdout: | (launched: 2022-12-09_23:34:03.600141) 23:34:07.036329 run osmo-hlr_10.42.42.2(pid=30111): stderr: | 20221209233403796 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209233403796 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209233403796 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209233403796 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209233403796 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209233403796 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209233403807 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-b200/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209233403816 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209233403816 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209233403816 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:34:07.088267 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30106): Terminating (SIGTERM) 23:34:07.130213 run iperf3-srv_10.42.42.10(pid=30107): Terminating (SIGTERM) 23:34:07.171802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30110): Terminating (SIGTERM) 23:34:07.213767 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30113): Terminating (SIGTERM) 23:34:07.255211 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30116): Terminating (SIGTERM) 23:34:07.297589 --- ParallelTerminationStrategy: PID 30106 died... 23:34:07.317391 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30106): Terminated: ok {rc=0} 23:34:07.363784 --- ParallelTerminationStrategy: PID 30107 died... 23:34:07.383027 run iperf3-srv_10.42.42.10(pid=30107): Terminated {rc=256} 23:34:07.429283 --- ParallelTerminationStrategy: PID 30110 died... 23:34:07.448486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30110): Terminated: ok {rc=0} 23:34:07.494909 --- ParallelTerminationStrategy: PID 30113 died... 23:34:07.514649 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30113): Terminated: ok {rc=0} 23:34:07.561069 --- ParallelTerminationStrategy: PID 30116 died... 23:34:07.580537 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30116): Terminated: ok {rc=0} 23:34:07.667907 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-b200 iperf3m4.py ---------------------------------------------- 23:34:08.820827 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:08.832402 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 23:34:08.880586 tst iperf3m4.py: using LAC 24440 23:34:09.007136 tst iperf3m4.py: using RAC 215 23:34:09.132922 tst iperf3m4.py: using CellId 24440 23:34:09.259063 tst iperf3m4.py: using BVCI 24441 23:34:09.375264 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:09.386577 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:09.397382 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:09.408584 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:09.419964 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:09.430941 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:09.442128 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:09.453131 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:09.464159 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 23:34:09.582158 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 23:34:09.699101 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 23:34:09.818350 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 23:34:09.936740 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:34:10.152855 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:34:10.472650 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30118): Launched 23:34:10.750389 run iperf3-srv_10.42.42.10(pid=30119): Launched 23:34:10.869993 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:34:11.085617 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:34:11.405624 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30120): Launched 23:34:11.682053 run iperf3-srv_10.42.42.10(pid=30121): Launched 23:34:11.801093 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:34:12.016899 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:34:12.336296 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30122): Launched 23:34:12.613380 run iperf3-srv_10.42.42.10(pid=30123): Launched 23:34:12.732653 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:34:12.948288 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:34:13.268408 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30124): Launched 23:34:13.545265 run iperf3-srv_10.42.42.10(pid=30125): Launched 23:34:13.664452 tst iperf3m4.py:8: start network... 23:34:13.879289 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:34:14.375874 run create_hlr_db(pid=30126): Launched 23:34:14.496861 bus /gobi_6: Setting Powered False 23:34:15.560250 run create_hlr_db(pid=30126): Terminated: ok {rc=0} 23:34:16.018260 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30128): Launched 23:34:16.357419 run osmo-hlr_10.42.42.2(pid=30129): Launched 23:34:16.481597 run osmo-stp_10.42.42.5: Starting osmo-stp 23:34:17.120373 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30131): Launched 23:34:17.438857 run osmo-stp_10.42.42.5(pid=30132): Launched 23:34:17.561108 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:34:18.111628 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30134): Launched 23:34:18.233972 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:34:18.503380 run patchelf(pid=30135): Launched 23:34:18.681527 run osmo-stp_10.42.42.5(pid=30132): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30132)] 23:34:18.817381 run osmo-stp_10.42.42.5(pid=30132): stdout: | (launched: 2022-12-09_23:34:17.381637) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:34:18.954827 run osmo-stp_10.42.42.5(pid=30132): stderr: | 20221209233417578 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233417578 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233417579 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233417579 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233417580 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233417580 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233417580 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:34:19.092666 run osmo-stp_10.42.42.5(pid=30132): stdout: | (launched: 2022-12-09_23:34:17.381637) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:34:19.223722 run osmo-stp_10.42.42.5(pid=30132): stderr: | 20221209233417578 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233417578 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233417579 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233417579 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233417580 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233417580 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233417580 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:34:19.379730 run patchelf(pid=30135): Terminating (SIGINT) 23:34:19.560146 run patchelf(pid=30135): Terminated: ok {rc=0} 23:34:19.689910 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30132): Process ended prematurely: osmo-stp_10.42.42.5(pid=30132) [trial-2366↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30132)] [trial-2366↪gprs:trx-b200↪iperf3m4.py:8] 23:34:19.700080 tst iperf3m4.py:8: Test FAILED (10.9 sec) 23:34:19.729718 run osmo-hlr_10.42.42.2(pid=30129): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-b200↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30129)] 23:34:19.780412 run osmo-hlr_10.42.42.2(pid=30129): stdout: | (launched: 2022-12-09_23:34:16.293935) 23:34:19.832675 run osmo-hlr_10.42.42.2(pid=30129): stderr: | 20221209233416703 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209233416703 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209233416704 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209233416704 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209233416704 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209233416704 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209233416731 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-b200/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209233416750 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209233416750 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209233416750 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:34:19.885419 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30118): Terminating (SIGTERM) 23:34:19.928301 run iperf3-srv_10.42.42.10(pid=30119): Terminating (SIGTERM) 23:34:19.970637 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30120): Terminating (SIGTERM) 23:34:20.012884 run iperf3-srv_10.42.42.10(pid=30121): Terminating (SIGTERM) 23:34:20.054840 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30122): Terminating (SIGTERM) 23:34:20.096756 run iperf3-srv_10.42.42.10(pid=30123): Terminating (SIGTERM) 23:34:20.138531 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30124): Terminating (SIGTERM) 23:34:20.180131 run iperf3-srv_10.42.42.10(pid=30125): Terminating (SIGTERM) 23:34:20.221816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30128): Terminating (SIGTERM) 23:34:20.263581 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30131): Terminating (SIGTERM) 23:34:20.305245 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30134): Terminating (SIGTERM) 23:34:20.347307 --- ParallelTerminationStrategy: PID 30118 died... 23:34:20.367156 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30118): Terminated: ok {rc=0} 23:34:20.414769 --- ParallelTerminationStrategy: PID 30119 died... 23:34:20.434357 run iperf3-srv_10.42.42.10(pid=30119): Terminated {rc=256} 23:34:20.480813 --- ParallelTerminationStrategy: PID 30120 died... 23:34:20.500266 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30120): Terminated: ok {rc=0} 23:34:20.547160 --- ParallelTerminationStrategy: PID 30121 died... 23:34:20.566851 run iperf3-srv_10.42.42.10(pid=30121): Terminated {rc=256} 23:34:20.613407 --- ParallelTerminationStrategy: PID 30122 died... 23:34:20.632708 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30122): Terminated: ok {rc=0} 23:34:20.679461 --- ParallelTerminationStrategy: PID 30123 died... 23:34:20.698940 run iperf3-srv_10.42.42.10(pid=30123): Terminated {rc=256} 23:34:20.745194 --- ParallelTerminationStrategy: PID 30124 died... 23:34:20.764427 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30124): Terminated: ok {rc=0} 23:34:20.810720 --- ParallelTerminationStrategy: PID 30125 died... 23:34:20.830043 run iperf3-srv_10.42.42.10(pid=30125): Terminated {rc=256} 23:34:20.876246 --- ParallelTerminationStrategy: PID 30128 died... 23:34:20.895642 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30128): Terminated: ok {rc=0} 23:34:20.941786 --- ParallelTerminationStrategy: PID 30131 died... 23:34:20.961347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30131): Terminated: ok {rc=0} 23:34:21.007685 --- ParallelTerminationStrategy: PID 30134 died... 23:34:21.027253 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30134): Terminated: ok {rc=0} 23:34:21.115562 bus /gobi_4: Setting Powered False 23:34:22.215932 bus /gobi_4: Setting Powered False 23:34:23.332512 bus /gobi_1: Setting Powered False 23:34:24.431131 bus /gobi_1: Setting Powered False 23:34:25.547333 bus /gobi_0: Setting Powered False 23:34:26.645971 bus /gobi_0: Setting Powered False 23:34:27.763886 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-b200 ping.py ---------------------------------------------- 23:34:28.863352 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:28.874474 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 23:34:28.927492 tst ping.py: using LAC 24441 23:34:29.041836 tst ping.py: using RAC 216 23:34:29.155723 tst ping.py: using CellId 24441 23:34:29.269312 tst ping.py: using BVCI 24442 23:34:29.375173 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:29.385791 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:29.396084 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:29.406481 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:29.416616 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:29.426995 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:29.437427 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:29.447699 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 23:34:29.562959 tst ping.py:19: start network... 23:34:29.757750 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:34:30.209547 run create_hlr_db(pid=30136): Launched 23:34:30.329266 bus /gobi_6: Setting Powered False 23:34:31.401745 run create_hlr_db(pid=30136): Terminated: ok {rc=0} 23:34:31.956510 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30138): Launched 23:34:32.297819 run osmo-hlr_10.42.42.2(pid=30139): Launched 23:34:32.419822 run osmo-stp_10.42.42.5: Starting osmo-stp 23:34:32.965111 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30141): Launched 23:34:33.278922 run osmo-stp_10.42.42.5(pid=30142): Launched 23:34:33.399512 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:34:33.941744 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30144): Launched 23:34:34.062391 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:34:34.328478 run patchelf(pid=30145): Launched 23:34:34.503172 run osmo-stp_10.42.42.5(pid=30142): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30142)] 23:34:34.637110 run osmo-stp_10.42.42.5(pid=30142): stdout: | (launched: 2022-12-09_23:34:33.221684) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:34:34.771793 run osmo-stp_10.42.42.5(pid=30142): stderr: | 20221209233433412 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233433412 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233433412 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233433413 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233433413 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233433413 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233433413 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:34:34.907039 run osmo-stp_10.42.42.5(pid=30142): stdout: | (launched: 2022-12-09_23:34:33.221684) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:34:35.035367 run osmo-stp_10.42.42.5(pid=30142): stderr: | 20221209233433412 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233433412 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233433412 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233433413 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233433413 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233433413 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233433413 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:34:35.188209 run patchelf(pid=30145): Terminating (SIGINT) 23:34:35.364467 run patchelf(pid=30145): Terminated: ok {rc=0} 23:34:35.491119 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30142): Process ended prematurely: osmo-stp_10.42.42.5(pid=30142) [trial-2366↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30142)] [trial-2366↪gprs:trx-b200↪ping.py:22] 23:34:35.500402 tst ping.py:22: Test FAILED (6.6 sec) 23:34:35.529203 run osmo-hlr_10.42.42.2(pid=30139): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-b200↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30139)] 23:34:35.579311 run osmo-hlr_10.42.42.2(pid=30139): stdout: | (launched: 2022-12-09_23:34:32.234017) 23:34:35.631173 run osmo-hlr_10.42.42.2(pid=30139): stderr: | 20221209233432437 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209233432437 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209233432437 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209233432437 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209233432437 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209233432437 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209233432449 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-b200/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209233432458 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209233432458 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209233432458 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:34:35.683522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30138): Terminating (SIGTERM) 23:34:35.725652 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30141): Terminating (SIGTERM) 23:34:35.767727 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30144): Terminating (SIGTERM) 23:34:35.810078 --- ParallelTerminationStrategy: PID 30138 died... 23:34:35.830067 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30138): Terminated: ok {rc=0} 23:34:35.877157 --- ParallelTerminationStrategy: PID 30141 died... 23:34:35.896885 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30141): Terminated: ok {rc=0} 23:34:35.943152 --- ParallelTerminationStrategy: PID 30144 died... 23:34:35.962814 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30144): Terminated: ok {rc=0} 23:34:36.050579 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-b200 ping_idle_ping.py ---------------------------------------------- 23:34:37.138069 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:37.150193 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 23:34:37.201342 tst ping_idle_ping.py: using LAC 24442 23:34:37.326010 tst ping_idle_ping.py: using RAC 217 23:34:37.451094 tst ping_idle_ping.py: using CellId 24442 23:34:37.575344 tst ping_idle_ping.py: using BVCI 24443 23:34:37.690554 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:37.701780 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:37.712874 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:37.724178 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:37.735455 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:37.746688 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:37.757846 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 23:34:37.769078 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 23:34:37.887186 tst ping_idle_ping.py:24: start network... 23:34:38.099792 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:34:38.590694 run create_hlr_db(pid=30146): Launched 23:34:38.710366 bus /gobi_6: Setting Powered False 23:34:39.774034 run create_hlr_db(pid=30146): Terminated: ok {rc=0} 23:34:40.196227 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30148): Launched 23:34:40.489287 run osmo-hlr_10.42.42.2(pid=30149): Launched 23:34:40.601815 run osmo-stp_10.42.42.5: Starting osmo-stp 23:34:41.106552 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30151): Launched 23:34:41.397742 run osmo-stp_10.42.42.5(pid=30152): Launched 23:34:41.509247 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:34:42.016423 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30154): Launched 23:34:42.128039 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:34:42.375383 run patchelf(pid=30155): Launched 23:34:42.538284 run osmo-stp_10.42.42.5(pid=30152): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30152)] 23:34:42.662267 run osmo-stp_10.42.42.5(pid=30152): stdout: | (launched: 2022-12-09_23:34:41.344524) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:34:42.788855 run osmo-stp_10.42.42.5(pid=30152): stderr: | 20221209233441515 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233441515 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233441515 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233441515 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233441516 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233441516 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233441516 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:34:42.914920 run osmo-stp_10.42.42.5(pid=30152): stdout: | (launched: 2022-12-09_23:34:41.344524) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:34:43.035155 run osmo-stp_10.42.42.5(pid=30152): stderr: | 20221209233441515 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233441515 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233441515 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233441515 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233441516 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233441516 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233441516 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:34:43.177612 run patchelf(pid=30155): Terminating (SIGINT) 23:34:43.342054 run patchelf(pid=30155): Terminated: ok {rc=0} 23:34:43.460380 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30152): Process ended prematurely: osmo-stp_10.42.42.5(pid=30152) [trial-2366↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30152)] [trial-2366↪gprs:trx-b200↪ping_idle_ping.py:27] 23:34:43.469303 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 23:34:43.495935 run osmo-hlr_10.42.42.2(pid=30149): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-b200↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30149)] 23:34:43.543373 run osmo-hlr_10.42.42.2(pid=30149): stdout: | (launched: 2022-12-09_23:34:40.435596) 23:34:43.592818 run osmo-hlr_10.42.42.2(pid=30149): stderr: | 20221209233440608 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209233440608 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209233440608 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209233440608 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209233440608 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209233440608 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209233440620 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-b200/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209233440630 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209233440630 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209233440630 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:34:43.642386 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30148): Terminating (SIGTERM) 23:34:43.681811 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30151): Terminating (SIGTERM) 23:34:43.721273 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30154): Terminating (SIGTERM) 23:34:43.761102 --- ParallelTerminationStrategy: PID 30148 died... 23:34:43.780231 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30148): Terminated: ok {rc=0} 23:34:43.824136 --- ParallelTerminationStrategy: PID 30151 died... 23:34:43.842674 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30151): Terminated: ok {rc=0} 23:34:43.886252 --- ParallelTerminationStrategy: PID 30154 died... 23:34:43.904746 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30154): Terminated: ok {rc=0} 23:34:43.990671 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2366 gprs:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 gprs:trx-b200+mod-bts0-egprs --------------------------------------------------------------------- 23:34:45.293868 tst gprs:trx-b200+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:34:45.299805 tst gprs:trx-b200+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 23:34:45.332438 tst gprs:trx-b200+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 23:34:45.370569 tst gprs:trx-b200+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 23:34:45.457357 tst gprs:trx-b200+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 23:34:45.490175 tst gprs:trx-b200+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 23:34:45.527583 tst gprs:trx-b200+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 23:34:46.123465 tst gprs:trx-b200+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2366 gprs:trx-b200+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 23:34:46.187892 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:34:46.201471 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:34:46.255482 tst cs_paging_gprs_active.py: using LAC 24443 23:34:46.401404 tst cs_paging_gprs_active.py: using RAC 218 23:34:46.567360 tst cs_paging_gprs_active.py: using CellId 24443 23:34:46.697095 tst cs_paging_gprs_active.py: using BVCI 24444 23:34:46.809550 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:34:46.820813 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:34:46.832109 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:34:46.843283 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:34:46.854597 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:34:46.865681 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:34:46.877617 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:34:46.888601 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:34:46.900607 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:34:47.030285 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:34:47.152123 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:34:47.361649 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:34:47.660798 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30160): Launched 23:34:47.920130 run iperf3-srv_10.42.42.10(pid=30161): Launched 23:34:48.031159 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:34:48.230116 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:34:48.528059 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30162): Launched 23:34:48.786025 run iperf3-srv_10.42.42.10(pid=30163): Launched 23:34:48.897407 tst cs_paging_gprs_active.py:38: start network... 23:34:49.097640 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:34:49.557357 run create_hlr_db(pid=30164): Launched 23:34:49.679282 bus /gobi_6: Setting Powered False 23:34:50.738609 run create_hlr_db(pid=30164): Terminated: ok {rc=0} 23:34:51.175556 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30166): Launched 23:34:51.477511 run osmo-hlr_10.42.42.2(pid=30167): Launched 23:34:51.591481 run osmo-stp_10.42.42.5: Starting osmo-stp 23:34:52.117450 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30169): Launched 23:34:52.414684 run osmo-stp_10.42.42.5(pid=30170): Launched 23:34:52.526866 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:34:53.039525 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30172): Launched 23:34:53.152725 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:34:53.403200 run patchelf(pid=30173): Launched 23:34:53.568148 run osmo-stp_10.42.42.5(pid=30170): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30170)] 23:34:53.693855 run osmo-stp_10.42.42.5(pid=30170): stdout: | (launched: 2022-12-09_23:34:52.360350) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:34:53.821580 run osmo-stp_10.42.42.5(pid=30170): stderr: | 20221209233452531 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233452532 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233452532 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233452532 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233452533 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233452533 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233452533 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:34:53.948885 run osmo-stp_10.42.42.5(pid=30170): stdout: | (launched: 2022-12-09_23:34:52.360350) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:34:54.070736 run osmo-stp_10.42.42.5(pid=30170): stderr: | 20221209233452531 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233452532 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233452532 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233452532 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233452533 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233452533 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233452533 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:34:54.214845 run patchelf(pid=30173): Terminating (SIGINT) 23:34:54.382595 run patchelf(pid=30173): Terminated: ok {rc=0} 23:34:54.503387 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=30170): Process ended prematurely: osmo-stp_10.42.42.5(pid=30170) [trial-2366↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30170)] [trial-2366↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 23:34:54.512735 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 23:34:54.539444 run osmo-hlr_10.42.42.2(pid=30167): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30167)] 23:34:54.586280 run osmo-hlr_10.42.42.2(pid=30167): stdout: | (launched: 2022-12-09_23:34:51.423487) 23:34:54.634817 run osmo-hlr_10.42.42.2(pid=30167): stderr: | 20221209233451601 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209233451601 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209233451601 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209233451601 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209233451601 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209233451601 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209233451614 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-b200+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209233451624 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209233451624 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209233451625 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:34:54.683615 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30160): Terminating (SIGTERM) 23:34:54.722708 run iperf3-srv_10.42.42.10(pid=30161): Terminating (SIGTERM) 23:34:54.761554 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30162): Terminating (SIGTERM) 23:34:54.800331 run iperf3-srv_10.42.42.10(pid=30163): Terminating (SIGTERM) 23:34:54.839516 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30166): Terminating (SIGTERM) 23:34:54.878421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30169): Terminating (SIGTERM) 23:34:54.917218 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30172): Terminating (SIGTERM) 23:34:54.956169 --- ParallelTerminationStrategy: PID 30160 died... 23:34:54.974815 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30160): Terminated: ok {rc=0} 23:34:55.017543 --- ParallelTerminationStrategy: PID 30161 died... 23:34:55.035484 run iperf3-srv_10.42.42.10(pid=30161): Terminated {rc=256} 23:34:55.078581 --- ParallelTerminationStrategy: PID 30162 died... 23:34:55.096646 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30162): Terminated: ok {rc=0} 23:34:55.139345 --- ParallelTerminationStrategy: PID 30163 died... 23:34:55.157278 run iperf3-srv_10.42.42.10(pid=30163): Terminated {rc=256} 23:34:55.199720 --- ParallelTerminationStrategy: PID 30166 died... 23:34:55.217740 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30166): Terminated: ok {rc=0} 23:34:55.261138 --- ParallelTerminationStrategy: PID 30169 died... 23:34:55.279227 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30169): Terminated: ok {rc=0} 23:34:55.322087 --- ParallelTerminationStrategy: PID 30172 died... 23:34:55.340143 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30172): Terminated: ok {rc=0} 23:34:55.425126 bus /gobi_0: Setting Powered False 23:34:56.523180 bus /gobi_0: Setting Powered False 23:34:57.634057 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-b200+mod-bts0-egprs iperf3.py ---------------------------------------------- 23:34:58.781194 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:34:58.793043 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:34:58.847017 tst iperf3.py: using LAC 24444 23:34:58.974497 tst iperf3.py: using RAC 219 23:34:59.099057 tst iperf3.py: using CellId 24444 23:34:59.224458 tst iperf3.py: using BVCI 24445 23:34:59.340614 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:34:59.352178 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:34:59.363152 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:34:59.374476 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:34:59.385746 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:34:59.396806 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:34:59.408232 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:34:59.419397 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:34:59.430731 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:34:59.546937 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:34:59.747905 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:35:00.046211 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30174): Launched 23:35:00.304922 run iperf3-srv_10.42.42.10(pid=30175): Launched 23:35:00.416398 tst iperf3.py:8: start network... 23:35:00.617076 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:35:01.095079 run create_hlr_db(pid=30176): Launched 23:35:01.254929 bus /gobi_6: Setting Powered False 23:35:02.330626 run create_hlr_db(pid=30176): Terminated: ok {rc=0} 23:35:02.778574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30181): Launched 23:35:03.097202 run osmo-hlr_10.42.42.2(pid=30182): Launched 23:35:03.218935 run osmo-stp_10.42.42.5: Starting osmo-stp 23:35:03.771472 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30184): Launched 23:35:04.088599 run osmo-stp_10.42.42.5(pid=30185): Launched 23:35:04.209452 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:35:04.758336 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30187): Launched 23:35:04.879914 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:35:05.149306 run patchelf(pid=30188): Launched 23:35:05.326643 run osmo-stp_10.42.42.5(pid=30185): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30185)] 23:35:05.462074 run osmo-stp_10.42.42.5(pid=30185): stdout: | (launched: 2022-12-09_23:35:04.031190) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:35:05.600041 run osmo-stp_10.42.42.5(pid=30185): stderr: | 20221209233504223 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233504223 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233504224 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233504224 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233504225 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233504225 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233504225 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:35:05.737716 run osmo-stp_10.42.42.5(pid=30185): stdout: | (launched: 2022-12-09_23:35:04.031190) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:35:05.868879 run osmo-stp_10.42.42.5(pid=30185): stderr: | 20221209233504223 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233504223 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233504224 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233504224 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233504225 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233504225 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233504225 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:35:06.024294 run patchelf(pid=30188): Terminating (SIGINT) 23:35:06.204058 run patchelf(pid=30188): Terminated: ok {rc=0} 23:35:06.333542 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30185): Process ended prematurely: osmo-stp_10.42.42.5(pid=30185) [trial-2366↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30185)] [trial-2366↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8] 23:35:06.343627 tst iperf3.py:8: Test FAILED (7.6 sec) 23:35:06.372400 run osmo-hlr_10.42.42.2(pid=30182): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30182)] 23:35:06.422429 run osmo-hlr_10.42.42.2(pid=30182): stdout: | (launched: 2022-12-09_23:35:03.039758) 23:35:06.474242 run osmo-hlr_10.42.42.2(pid=30182): stderr: | 20221209233503237 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209233503237 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209233503237 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209233503237 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209233503237 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209233503237 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209233503250 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-b200+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209233503258 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209233503259 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209233503259 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:35:06.526702 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30174): Terminating (SIGTERM) 23:35:06.568787 run iperf3-srv_10.42.42.10(pid=30175): Terminating (SIGTERM) 23:35:06.610648 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30181): Terminating (SIGTERM) 23:35:06.652338 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30184): Terminating (SIGTERM) 23:35:06.694162 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30187): Terminating (SIGTERM) 23:35:06.736129 --- ParallelTerminationStrategy: PID 30174 died... 23:35:06.755968 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30174): Terminated: ok {rc=0} 23:35:06.802173 --- ParallelTerminationStrategy: PID 30175 died... 23:35:06.821628 run iperf3-srv_10.42.42.10(pid=30175): Terminated {rc=256} 23:35:06.867811 --- ParallelTerminationStrategy: PID 30181 died... 23:35:06.887192 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30181): Terminated: ok {rc=0} 23:35:06.933646 --- ParallelTerminationStrategy: PID 30184 died... 23:35:06.953146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30184): Terminated: ok {rc=0} 23:35:06.999453 --- ParallelTerminationStrategy: PID 30187 died... 23:35:07.018827 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30187): Terminated: ok {rc=0} 23:35:07.106589 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-b200+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 23:35:08.259311 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:08.271055 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:35:08.320448 tst iperf3m4.py: using LAC 24445 23:35:08.447378 tst iperf3m4.py: using RAC 220 23:35:08.574944 tst iperf3m4.py: using CellId 24445 23:35:08.700046 tst iperf3m4.py: using BVCI 24446 23:35:08.816588 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:08.827907 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:08.838956 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:08.850256 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:08.861450 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:08.872540 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:08.884017 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:08.895204 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:08.906758 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:35:09.029796 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:35:09.151179 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:35:09.268745 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:35:09.385203 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:35:09.586411 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:35:09.885545 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30189): Launched 23:35:10.146081 run iperf3-srv_10.42.42.10(pid=30190): Launched 23:35:10.257632 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:35:10.457528 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:35:10.756411 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30191): Launched 23:35:11.016341 run iperf3-srv_10.42.42.10(pid=30192): Launched 23:35:11.128082 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:35:11.328587 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:35:11.627284 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30193): Launched 23:35:11.886331 run iperf3-srv_10.42.42.10(pid=30194): Launched 23:35:11.997790 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:35:12.197493 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:35:12.496102 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30195): Launched 23:35:12.755678 run iperf3-srv_10.42.42.10(pid=30196): Launched 23:35:12.867273 tst iperf3m4.py:8: start network... 23:35:13.066901 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:35:13.528565 run create_hlr_db(pid=30197): Launched 23:35:13.653559 bus /gobi_6: Setting Powered False 23:35:14.717194 run create_hlr_db(pid=30197): Terminated: ok {rc=0} 23:35:15.145062 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30199): Launched 23:35:15.444373 run osmo-hlr_10.42.42.2(pid=30200): Launched 23:35:15.558101 run osmo-stp_10.42.42.5: Starting osmo-stp 23:35:16.134955 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30202): Launched 23:35:16.473839 run osmo-stp_10.42.42.5(pid=30203): Launched 23:35:16.741422 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:35:17.280019 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30205): Launched 23:35:17.396896 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:35:17.649976 run patchelf(pid=30206): Launched 23:35:17.815857 run osmo-stp_10.42.42.5(pid=30203): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30203)] 23:35:17.942450 run osmo-stp_10.42.42.5(pid=30203): stdout: | (launched: 2022-12-09_23:35:16.409984) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:35:18.071134 run osmo-stp_10.42.42.5(pid=30203): stderr: | 20221209233516621 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233516621 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233516621 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233516622 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233516622 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233516622 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233516622 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:35:18.199492 run osmo-stp_10.42.42.5(pid=30203): stdout: | (launched: 2022-12-09_23:35:16.409984) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:35:18.321885 run osmo-stp_10.42.42.5(pid=30203): stderr: | 20221209233516621 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233516621 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233516621 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233516622 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233516622 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233516622 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233516622 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:35:18.466892 run patchelf(pid=30206): Terminating (SIGINT) 23:35:18.635282 run patchelf(pid=30206): Terminated: ok {rc=0} 23:35:18.756476 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30203): Process ended prematurely: osmo-stp_10.42.42.5(pid=30203) [trial-2366↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30203)] [trial-2366↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8] 23:35:18.766045 tst iperf3m4.py:8: Test FAILED (10.5 sec) 23:35:18.793469 run osmo-hlr_10.42.42.2(pid=30200): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30200)] 23:35:18.840791 run osmo-hlr_10.42.42.2(pid=30200): stdout: | (launched: 2022-12-09_23:35:15.389674) 23:35:18.889808 run osmo-hlr_10.42.42.2(pid=30200): stderr: | 20221209233515567 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209233515567 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209233515567 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209233515567 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209233515567 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209233515568 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209233515579 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-b200+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209233515588 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209233515589 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209233515589 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:35:18.939356 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30189): Terminating (SIGTERM) 23:35:18.979413 run iperf3-srv_10.42.42.10(pid=30190): Terminating (SIGTERM) 23:35:19.019059 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30191): Terminating (SIGTERM) 23:35:19.059060 run iperf3-srv_10.42.42.10(pid=30192): Terminating (SIGTERM) 23:35:19.098558 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30193): Terminating (SIGTERM) 23:35:19.138170 run iperf3-srv_10.42.42.10(pid=30194): Terminating (SIGTERM) 23:35:19.177587 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30195): Terminating (SIGTERM) 23:35:19.216921 run iperf3-srv_10.42.42.10(pid=30196): Terminating (SIGTERM) 23:35:19.256311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30199): Terminating (SIGTERM) 23:35:19.295750 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30202): Terminating (SIGTERM) 23:35:19.335351 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30205): Terminating (SIGTERM) 23:35:19.375259 --- ParallelTerminationStrategy: PID 30189 died... 23:35:19.394316 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30189): Terminated: ok {rc=0} 23:35:19.438595 --- ParallelTerminationStrategy: PID 30190 died... 23:35:19.457222 run iperf3-srv_10.42.42.10(pid=30190): Terminated {rc=256} 23:35:19.501330 --- ParallelTerminationStrategy: PID 30191 died... 23:35:19.519838 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30191): Terminated: ok {rc=0} 23:35:19.563909 --- ParallelTerminationStrategy: PID 30192 died... 23:35:19.582628 run iperf3-srv_10.42.42.10(pid=30192): Terminated {rc=256} 23:35:19.626363 --- ParallelTerminationStrategy: PID 30193 died... 23:35:19.645312 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30193): Terminated: ok {rc=0} 23:35:19.689295 --- ParallelTerminationStrategy: PID 30194 died... 23:35:19.707859 run iperf3-srv_10.42.42.10(pid=30194): Terminated {rc=256} 23:35:19.751574 --- ParallelTerminationStrategy: PID 30195 died... 23:35:19.770136 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30195): Terminated: ok {rc=0} 23:35:19.813932 --- ParallelTerminationStrategy: PID 30196 died... 23:35:19.832682 run iperf3-srv_10.42.42.10(pid=30196): Terminated {rc=256} 23:35:19.876368 --- ParallelTerminationStrategy: PID 30199 died... 23:35:19.895134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30199): Terminated: ok {rc=0} 23:35:19.938818 --- ParallelTerminationStrategy: PID 30202 died... 23:35:19.957354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30202): Terminated: ok {rc=0} 23:35:20.000914 --- ParallelTerminationStrategy: PID 30205 died... 23:35:20.019442 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30205): Terminated: ok {rc=0} 23:35:20.104169 bus /gobi_4: Setting Powered False 23:35:21.204022 bus /gobi_4: Setting Powered False 23:35:22.319017 bus /gobi_1: Setting Powered False 23:35:23.418015 bus /gobi_1: Setting Powered False 23:35:24.534101 bus /gobi_0: Setting Powered False 23:35:25.628768 bus /gobi_0: Setting Powered False 23:35:26.744481 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-b200+mod-bts0-egprs ping.py ---------------------------------------------- 23:35:27.847038 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:27.858467 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:35:27.909195 tst ping.py: using LAC 24446 23:35:28.029721 tst ping.py: using RAC 221 23:35:28.154208 tst ping.py: using CellId 24446 23:35:28.276456 tst ping.py: using BVCI 24447 23:35:28.390901 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:28.402392 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:28.413621 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:28.425483 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:28.436785 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:28.448455 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:28.460264 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:28.472201 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:35:28.586482 tst ping.py:19: start network... 23:35:28.782884 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:35:29.235878 run create_hlr_db(pid=30207): Launched 23:35:29.355827 bus /gobi_6: Setting Powered False 23:35:30.414632 run create_hlr_db(pid=30207): Terminated: ok {rc=0} 23:35:30.824414 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30209): Launched 23:35:31.135039 run osmo-hlr_10.42.42.2(pid=30210): Launched 23:35:31.334279 run osmo-stp_10.42.42.5: Starting osmo-stp 23:35:31.983149 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30212): Launched 23:35:32.317566 run osmo-stp_10.42.42.5(pid=30213): Launched 23:35:32.440882 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:35:32.989167 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30215): Launched 23:35:33.109440 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:35:33.375182 run patchelf(pid=30216): Launched 23:35:33.549439 run osmo-stp_10.42.42.5(pid=30213): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30213)] 23:35:33.682805 run osmo-stp_10.42.42.5(pid=30213): stdout: | (launched: 2022-12-09_23:35:32.260403) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:35:33.817933 run osmo-stp_10.42.42.5(pid=30213): stderr: | 20221209233532448 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233532448 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233532449 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233532449 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233532449 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233532449 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233532450 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:35:33.952938 run osmo-stp_10.42.42.5(pid=30213): stdout: | (launched: 2022-12-09_23:35:32.260403) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:35:34.082303 run osmo-stp_10.42.42.5(pid=30213): stderr: | 20221209233532448 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233532448 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233532449 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233532449 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233532449 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233532449 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233532450 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:35:34.235170 run patchelf(pid=30216): Terminating (SIGINT) 23:35:34.410964 run patchelf(pid=30216): Terminated: ok {rc=0} 23:35:34.537631 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30213): Process ended prematurely: osmo-stp_10.42.42.5(pid=30213) [trial-2366↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30213)] [trial-2366↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22] 23:35:34.547102 tst ping.py:22: Test FAILED (6.7 sec) 23:35:34.576278 run osmo-hlr_10.42.42.2(pid=30210): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-b200+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30210)] 23:35:34.627179 run osmo-hlr_10.42.42.2(pid=30210): stdout: | (launched: 2022-12-09_23:35:31.068261) 23:35:34.679603 run osmo-hlr_10.42.42.2(pid=30210): stderr: | 20221209233531354 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209233531354 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209233531354 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209233531354 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209233531354 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209233531354 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209233531373 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-b200+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209233531398 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209233531398 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209233531398 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:35:34.732251 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30209): Terminating (SIGTERM) 23:35:34.774716 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30212): Terminating (SIGTERM) 23:35:34.817731 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30215): Terminating (SIGTERM) 23:35:34.860892 --- ParallelTerminationStrategy: PID 30209 died... 23:35:34.881134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30209): Terminated: ok {rc=0} 23:35:34.928541 --- ParallelTerminationStrategy: PID 30212 died... 23:35:34.948213 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30212): Terminated: ok {rc=0} 23:35:34.995754 --- ParallelTerminationStrategy: PID 30215 died... 23:35:35.015559 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30215): Terminated: ok {rc=0} 23:35:35.104506 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-b200+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 23:35:36.192205 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:36.204602 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:35:36.258634 tst ping_idle_ping.py: using LAC 24447 23:35:36.383794 tst ping_idle_ping.py: using RAC 222 23:35:36.506551 tst ping_idle_ping.py: using CellId 24447 23:35:36.631001 tst ping_idle_ping.py: using BVCI 24448 23:35:36.738763 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:36.749739 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:36.760301 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:36.772626 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:36.785303 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:36.796531 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:36.808353 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:35:36.819949 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:35:36.937128 tst ping_idle_ping.py:24: start network... 23:35:37.135560 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:35:37.593698 run create_hlr_db(pid=30217): Launched 23:35:37.712914 bus /gobi_6: Setting Powered False 23:35:38.772137 run create_hlr_db(pid=30217): Terminated: ok {rc=0} 23:35:39.203075 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30219): Launched 23:35:39.518138 run osmo-hlr_10.42.42.2(pid=30220): Launched 23:35:39.640271 run osmo-stp_10.42.42.5: Starting osmo-stp 23:35:40.185170 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30222): Launched 23:35:40.499533 run osmo-stp_10.42.42.5(pid=30223): Launched 23:35:40.621808 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:35:41.164510 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30225): Launched 23:35:41.285580 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:35:41.552067 run patchelf(pid=30226): Launched 23:35:41.728093 run osmo-stp_10.42.42.5(pid=30223): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30223)] 23:35:41.861701 run osmo-stp_10.42.42.5(pid=30223): stdout: | (launched: 2022-12-09_23:35:40.442491) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:35:41.996913 run osmo-stp_10.42.42.5(pid=30223): stderr: | 20221209233540631 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233540632 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233540632 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233540632 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233540633 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233540633 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233540633 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:35:42.132682 run osmo-stp_10.42.42.5(pid=30223): stdout: | (launched: 2022-12-09_23:35:40.442491) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:35:42.262304 run osmo-stp_10.42.42.5(pid=30223): stderr: | 20221209233540631 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233540632 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233540632 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233540632 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233540633 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233540633 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233540633 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:35:42.415417 run patchelf(pid=30226): Terminating (SIGINT) 23:35:42.592603 run patchelf(pid=30226): Terminated: ok {rc=0} 23:35:42.720107 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30223): Process ended prematurely: osmo-stp_10.42.42.5(pid=30223) [trial-2366↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30223)] [trial-2366↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27] 23:35:42.729972 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 23:35:42.758331 run osmo-hlr_10.42.42.2(pid=30220): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30220)] 23:35:42.809287 run osmo-hlr_10.42.42.2(pid=30220): stdout: | (launched: 2022-12-09_23:35:39.460683) 23:35:42.861551 run osmo-hlr_10.42.42.2(pid=30220): stderr: | 20221209233539656 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209233539656 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209233539656 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209233539656 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209233539656 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209233539656 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209233539667 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-b200+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209233539675 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209233539676 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209233539676 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:35:42.914400 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30219): Terminating (SIGTERM) 23:35:42.956547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30222): Terminating (SIGTERM) 23:35:42.998989 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30225): Terminating (SIGTERM) 23:35:43.041738 --- ParallelTerminationStrategy: PID 30219 died... 23:35:43.061906 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30219): Terminated: ok {rc=0} 23:35:43.109203 --- ParallelTerminationStrategy: PID 30222 died... 23:35:43.128891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30222): Terminated: ok {rc=0} 23:35:43.175933 --- ParallelTerminationStrategy: PID 30225 died... 23:35:43.195639 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30225): Terminated: ok {rc=0} 23:35:43.284924 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2366 gprs:trx-b200+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 gprs:trx-b200+mod-bts0-dynts-ipa --------------------------------------------------------------------- 23:35:44.597601 tst gprs:trx-b200+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:35:44.604156 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 23:35:44.639304 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 23:35:44.679069 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 23:35:44.767510 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 23:35:44.801884 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 23:35:44.841814 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 23:35:45.437284 tst gprs:trx-b200+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2366 gprs:trx-b200+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 23:35:45.489993 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:35:45.501507 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:35:45.573817 tst cs_paging_gprs_active.py: using LAC 24448 23:35:45.693874 tst cs_paging_gprs_active.py: using RAC 223 23:35:45.821383 tst cs_paging_gprs_active.py: using CellId 24448 23:35:45.955267 tst cs_paging_gprs_active.py: using BVCI 24449 23:35:46.076791 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:35:46.088719 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:35:46.100537 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:35:46.112661 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:35:46.125070 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:35:46.137166 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:35:46.149739 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:35:46.161625 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:35:46.173958 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:35:46.292681 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:35:46.440341 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:35:46.699043 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:35:47.037719 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30230): Launched 23:35:47.326622 run iperf3-srv_10.42.42.10(pid=30231): Launched 23:35:47.446214 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:35:47.663366 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:35:47.984166 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30232): Launched 23:35:48.262345 run iperf3-srv_10.42.42.10(pid=30233): Launched 23:35:48.382281 tst cs_paging_gprs_active.py:38: start network... 23:35:48.598916 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:35:49.093380 run create_hlr_db(pid=30234): Launched 23:35:49.215274 bus /gobi_6: Setting Powered False 23:35:50.278408 run create_hlr_db(pid=30234): Terminated: ok {rc=0} 23:35:50.705486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30236): Launched 23:35:51.003611 run osmo-hlr_10.42.42.2(pid=30237): Launched 23:35:51.117100 run osmo-stp_10.42.42.5: Starting osmo-stp 23:35:51.644027 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30239): Launched 23:35:51.941966 run osmo-stp_10.42.42.5(pid=30240): Launched 23:35:52.056507 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:35:52.569899 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30242): Launched 23:35:52.683301 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:35:52.935089 run patchelf(pid=30243): Launched 23:35:53.100722 run osmo-stp_10.42.42.5(pid=30240): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30240)] 23:35:53.227043 run osmo-stp_10.42.42.5(pid=30240): stdout: | (launched: 2022-12-09_23:35:51.888033) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:35:53.356131 run osmo-stp_10.42.42.5(pid=30240): stderr: | 20221209233552060 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233552060 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233552060 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233552061 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233552061 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233552061 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233552061 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:35:53.484652 run osmo-stp_10.42.42.5(pid=30240): stdout: | (launched: 2022-12-09_23:35:51.888033) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:35:53.606680 run osmo-stp_10.42.42.5(pid=30240): stderr: | 20221209233552060 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233552060 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233552060 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233552061 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233552061 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233552061 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233552061 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:35:53.751310 run patchelf(pid=30243): Terminating (SIGINT) 23:35:53.919137 run patchelf(pid=30243): Terminated: ok {rc=0} 23:35:54.040158 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=30240): Process ended prematurely: osmo-stp_10.42.42.5(pid=30240) [trial-2366↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30240)] [trial-2366↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 23:35:54.049617 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 23:35:54.076350 run osmo-hlr_10.42.42.2(pid=30237): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30237)] 23:35:54.123474 run osmo-hlr_10.42.42.2(pid=30237): stdout: | (launched: 2022-12-09_23:35:50.949650) 23:35:54.172783 run osmo-hlr_10.42.42.2(pid=30237): stderr: | 20221209233551128 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209233551128 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209233551128 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209233551128 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209233551128 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209233551128 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209233551141 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-b200+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209233551149 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209233551149 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209233551149 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:35:54.222370 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30230): Terminating (SIGTERM) 23:35:54.261891 run iperf3-srv_10.42.42.10(pid=30231): Terminating (SIGTERM) 23:35:54.301131 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30232): Terminating (SIGTERM) 23:35:54.340344 run iperf3-srv_10.42.42.10(pid=30233): Terminating (SIGTERM) 23:35:54.379488 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30236): Terminating (SIGTERM) 23:35:54.418913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30239): Terminating (SIGTERM) 23:35:54.458779 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30242): Terminating (SIGTERM) 23:35:54.498256 --- ParallelTerminationStrategy: PID 30230 died... 23:35:54.517192 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30230): Terminated: ok {rc=0} 23:35:54.561190 --- ParallelTerminationStrategy: PID 30231 died... 23:35:54.579704 run iperf3-srv_10.42.42.10(pid=30231): Terminated {rc=256} 23:35:54.623041 --- ParallelTerminationStrategy: PID 30232 died... 23:35:54.641734 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30232): Terminated: ok {rc=0} 23:35:54.685159 --- ParallelTerminationStrategy: PID 30233 died... 23:35:54.703526 run iperf3-srv_10.42.42.10(pid=30233): Terminated {rc=256} 23:35:54.747051 --- ParallelTerminationStrategy: PID 30236 died... 23:35:54.765594 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30236): Terminated: ok {rc=0} 23:35:54.809151 --- ParallelTerminationStrategy: PID 30239 died... 23:35:54.827743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30239): Terminated: ok {rc=0} 23:35:54.871326 --- ParallelTerminationStrategy: PID 30242 died... 23:35:54.889935 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30242): Terminated: ok {rc=0} 23:35:54.972803 bus /gobi_0: Setting Powered False 23:35:56.071027 bus /gobi_0: Setting Powered False 23:35:57.186891 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-b200+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 23:35:58.335509 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:35:58.347626 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:35:58.421732 tst iperf3.py: using LAC 24449 23:35:58.548623 tst iperf3.py: using RAC 224 23:35:58.675811 tst iperf3.py: using CellId 24449 23:35:58.800501 tst iperf3.py: using BVCI 24450 23:35:58.916649 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:35:58.927965 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:35:58.939045 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:35:58.950370 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:35:58.961707 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:35:58.973003 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:35:58.984431 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:35:58.995778 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:35:59.007350 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:35:59.123353 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:35:59.325479 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:35:59.625558 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30244): Launched 23:35:59.885425 run iperf3-srv_10.42.42.10(pid=30245): Launched 23:35:59.996912 tst iperf3.py:8: start network... 23:36:00.197305 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:36:00.659593 run create_hlr_db(pid=30246): Launched 23:36:00.782486 bus /gobi_6: Setting Powered False 23:36:01.842529 run create_hlr_db(pid=30246): Terminated: ok {rc=0} 23:36:02.298468 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30248): Launched 23:36:02.597280 run osmo-hlr_10.42.42.2(pid=30249): Launched 23:36:02.710975 run osmo-stp_10.42.42.5: Starting osmo-stp 23:36:03.222424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30251): Launched 23:36:03.519731 run osmo-stp_10.42.42.5(pid=30252): Launched 23:36:03.631976 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:36:04.147906 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30254): Launched 23:36:04.261488 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:36:04.513086 run patchelf(pid=30255): Launched 23:36:04.678757 run osmo-stp_10.42.42.5(pid=30252): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30252)] 23:36:04.805251 run osmo-stp_10.42.42.5(pid=30252): stdout: | (launched: 2022-12-09_23:36:03.465853) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:36:04.933502 run osmo-stp_10.42.42.5(pid=30252): stderr: | 20221209233603637 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233603637 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233603637 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233603638 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233603638 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233603638 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233603638 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:36:05.061421 run osmo-stp_10.42.42.5(pid=30252): stdout: | (launched: 2022-12-09_23:36:03.465853) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:36:05.183967 run osmo-stp_10.42.42.5(pid=30252): stderr: | 20221209233603637 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233603637 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233603637 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233603638 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233603638 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233603638 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233603638 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:36:05.328897 run patchelf(pid=30255): Terminating (SIGINT) 23:36:05.497530 run patchelf(pid=30255): Terminated: ok {rc=0} 23:36:05.618792 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30252): Process ended prematurely: osmo-stp_10.42.42.5(pid=30252) [trial-2366↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30252)] [trial-2366↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8] 23:36:05.628113 tst iperf3.py:8: Test FAILED (7.3 sec) 23:36:05.655148 run osmo-hlr_10.42.42.2(pid=30249): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30249)] 23:36:05.702787 run osmo-hlr_10.42.42.2(pid=30249): stdout: | (launched: 2022-12-09_23:36:02.543062) 23:36:05.752123 run osmo-hlr_10.42.42.2(pid=30249): stderr: | 20221209233602721 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209233602721 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209233602721 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209233602721 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209233602721 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209233602721 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209233602734 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209233602744 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209233602745 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209233602745 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:36:05.802016 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30244): Terminating (SIGTERM) 23:36:05.841449 run iperf3-srv_10.42.42.10(pid=30245): Terminating (SIGTERM) 23:36:05.880892 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30248): Terminating (SIGTERM) 23:36:05.920297 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30251): Terminating (SIGTERM) 23:36:05.959809 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30254): Terminating (SIGTERM) 23:36:05.999553 --- ParallelTerminationStrategy: PID 30244 died... 23:36:06.018708 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30244): Terminated: ok {rc=0} 23:36:06.063103 --- ParallelTerminationStrategy: PID 30245 died... 23:36:06.081752 run iperf3-srv_10.42.42.10(pid=30245): Terminated {rc=256} 23:36:06.125350 --- ParallelTerminationStrategy: PID 30248 died... 23:36:06.143906 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30248): Terminated: ok {rc=0} 23:36:06.187603 --- ParallelTerminationStrategy: PID 30251 died... 23:36:06.206052 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30251): Terminated: ok {rc=0} 23:36:06.249748 --- ParallelTerminationStrategy: PID 30254 died... 23:36:06.268453 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30254): Terminated: ok {rc=0} 23:36:06.353446 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-b200+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 23:36:07.501766 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:07.513274 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:36:07.589089 tst iperf3m4.py: using LAC 24450 23:36:07.705558 tst iperf3m4.py: using RAC 225 23:36:07.821123 tst iperf3m4.py: using CellId 24450 23:36:07.937416 tst iperf3m4.py: using BVCI 24451 23:36:08.047670 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:08.058492 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:08.069063 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:08.079577 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:08.090049 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:08.100550 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:08.111235 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:08.121794 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:08.132414 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:36:08.246516 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:36:08.367036 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:36:08.483314 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:36:08.600342 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:36:08.801725 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:36:09.102100 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30257): Launched 23:36:09.361583 run iperf3-srv_10.42.42.10(pid=30258): Launched 23:36:09.474908 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:36:09.676814 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:36:09.978103 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30259): Launched 23:36:10.238275 run iperf3-srv_10.42.42.10(pid=30260): Launched 23:36:10.350294 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:36:10.550624 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:36:10.850437 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30261): Launched 23:36:11.109681 run iperf3-srv_10.42.42.10(pid=30262): Launched 23:36:11.221193 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:36:11.421704 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:36:11.722299 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30263): Launched 23:36:11.981811 run iperf3-srv_10.42.42.10(pid=30264): Launched 23:36:12.093530 tst iperf3m4.py:8: start network... 23:36:12.293426 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:36:12.755752 run create_hlr_db(pid=30265): Launched 23:36:12.878592 bus /gobi_6: Setting Powered False 23:36:13.942125 run create_hlr_db(pid=30265): Terminated: ok {rc=0} 23:36:14.388022 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30267): Launched 23:36:14.708774 run osmo-hlr_10.42.42.2(pid=30268): Launched 23:36:14.831104 run osmo-stp_10.42.42.5: Starting osmo-stp 23:36:15.384505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30270): Launched 23:36:15.703735 run osmo-stp_10.42.42.5(pid=30271): Launched 23:36:15.825326 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:36:16.464275 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30273): Launched 23:36:16.589712 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:36:16.864457 run patchelf(pid=30274): Launched 23:36:17.043736 run osmo-stp_10.42.42.5(pid=30271): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30271)] 23:36:17.173967 run osmo-stp_10.42.42.5(pid=30271): stdout: | (launched: 2022-12-09_23:36:15.646181) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:36:17.306369 run osmo-stp_10.42.42.5(pid=30271): stderr: | 20221209233615838 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233615838 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233615838 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233615838 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233615839 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233615839 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233615839 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:36:17.435280 run osmo-stp_10.42.42.5(pid=30271): stdout: | (launched: 2022-12-09_23:36:15.646181) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:36:17.558897 run osmo-stp_10.42.42.5(pid=30271): stderr: | 20221209233615838 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233615838 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233615838 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233615838 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233615839 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233615839 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233615839 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:36:17.704516 run patchelf(pid=30274): Terminating (SIGINT) 23:36:17.873550 run patchelf(pid=30274): Terminated: ok {rc=0} 23:36:17.995133 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30271): Process ended prematurely: osmo-stp_10.42.42.5(pid=30271) [trial-2366↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30271)] [trial-2366↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8] 23:36:18.004795 tst iperf3m4.py:8: Test FAILED (10.5 sec) 23:36:18.032792 run osmo-hlr_10.42.42.2(pid=30268): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30268)] 23:36:18.081084 run osmo-hlr_10.42.42.2(pid=30268): stdout: | (launched: 2022-12-09_23:36:14.650831) 23:36:18.131295 run osmo-hlr_10.42.42.2(pid=30268): stderr: | 20221209233614847 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209233614847 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209233614847 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209233614847 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209233614847 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209233614847 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209233614859 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209233614867 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209233614868 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209233614868 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:36:18.181406 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30257): Terminating (SIGTERM) 23:36:18.221589 run iperf3-srv_10.42.42.10(pid=30258): Terminating (SIGTERM) 23:36:18.261683 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30259): Terminating (SIGTERM) 23:36:18.301848 run iperf3-srv_10.42.42.10(pid=30260): Terminating (SIGTERM) 23:36:18.341719 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30261): Terminating (SIGTERM) 23:36:18.382181 run iperf3-srv_10.42.42.10(pid=30262): Terminating (SIGTERM) 23:36:18.422195 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30263): Terminating (SIGTERM) 23:36:18.462241 run iperf3-srv_10.42.42.10(pid=30264): Terminating (SIGTERM) 23:36:18.502198 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30267): Terminating (SIGTERM) 23:36:18.542335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30270): Terminating (SIGTERM) 23:36:18.582417 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30273): Terminating (SIGTERM) 23:36:18.622765 --- ParallelTerminationStrategy: PID 30257 died... 23:36:18.642398 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30257): Terminated: ok {rc=0} 23:36:18.687386 --- ParallelTerminationStrategy: PID 30258 died... 23:36:18.706331 run iperf3-srv_10.42.42.10(pid=30258): Terminated {rc=256} 23:36:18.750878 --- ParallelTerminationStrategy: PID 30259 died... 23:36:18.769838 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30259): Terminated: ok {rc=0} 23:36:18.814217 --- ParallelTerminationStrategy: PID 30260 died... 23:36:18.833216 run iperf3-srv_10.42.42.10(pid=30260): Terminated {rc=256} 23:36:18.877977 --- ParallelTerminationStrategy: PID 30261 died... 23:36:18.897182 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30261): Terminated: ok {rc=0} 23:36:18.941271 --- ParallelTerminationStrategy: PID 30262 died... 23:36:18.960100 run iperf3-srv_10.42.42.10(pid=30262): Terminated {rc=256} 23:36:19.004263 --- ParallelTerminationStrategy: PID 30263 died... 23:36:19.023095 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30263): Terminated: ok {rc=0} 23:36:19.067622 --- ParallelTerminationStrategy: PID 30264 died... 23:36:19.086310 run iperf3-srv_10.42.42.10(pid=30264): Terminated {rc=256} 23:36:19.130413 --- ParallelTerminationStrategy: PID 30267 died... 23:36:19.149383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30267): Terminated: ok {rc=0} 23:36:19.193451 --- ParallelTerminationStrategy: PID 30270 died... 23:36:19.212213 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30270): Terminated: ok {rc=0} 23:36:19.256195 --- ParallelTerminationStrategy: PID 30273 died... 23:36:19.275123 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30273): Terminated: ok {rc=0} 23:36:19.360614 bus /gobi_4: Setting Powered False 23:36:20.461832 bus /gobi_4: Setting Powered False 23:36:21.577415 bus /gobi_1: Setting Powered False 23:36:22.673876 bus /gobi_1: Setting Powered False 23:36:23.789367 bus /gobi_0: Setting Powered False 23:36:24.888759 bus /gobi_0: Setting Powered False 23:36:26.003300 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-b200+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 23:36:27.106817 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:27.118338 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:36:27.186761 tst ping.py: using LAC 24451 23:36:27.304287 tst ping.py: using RAC 226 23:36:27.425476 tst ping.py: using CellId 24451 23:36:27.540149 tst ping.py: using BVCI 24452 23:36:27.647368 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:27.658274 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:27.668824 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:27.679396 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:27.689938 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:27.701232 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:27.712140 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:27.722761 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:36:27.839652 tst ping.py:19: start network... 23:36:28.052614 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:36:28.540329 run create_hlr_db(pid=30275): Launched 23:36:28.660650 bus /gobi_6: Setting Powered False 23:36:29.723473 run create_hlr_db(pid=30275): Terminated: ok {rc=0} 23:36:30.144095 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30277): Launched 23:36:30.435684 run osmo-hlr_10.42.42.2(pid=30278): Launched 23:36:30.547307 run osmo-stp_10.42.42.5: Starting osmo-stp 23:36:31.093782 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30280): Launched 23:36:31.436038 run osmo-stp_10.42.42.5(pid=30281): Launched 23:36:31.703729 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:36:32.267869 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30283): Launched 23:36:32.383230 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:36:32.631297 run patchelf(pid=30284): Launched 23:36:32.793544 run osmo-stp_10.42.42.5(pid=30281): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30281)] 23:36:32.917948 run osmo-stp_10.42.42.5(pid=30281): stdout: | (launched: 2022-12-09_23:36:31.370721) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:36:33.043466 run osmo-stp_10.42.42.5(pid=30281): stderr: | 20221209233631571 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233631572 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233631572 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233631572 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233631573 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233631573 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233631573 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:36:33.169155 run osmo-stp_10.42.42.5(pid=30281): stdout: | (launched: 2022-12-09_23:36:31.370721) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:36:33.288742 run osmo-stp_10.42.42.5(pid=30281): stderr: | 20221209233631571 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233631572 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233631572 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233631572 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233631573 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233631573 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233631573 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:36:33.430686 run patchelf(pid=30284): Terminating (SIGINT) 23:36:33.594971 run patchelf(pid=30284): Terminated: ok {rc=0} 23:36:33.714528 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30281): Process ended prematurely: osmo-stp_10.42.42.5(pid=30281) [trial-2366↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30281)] [trial-2366↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22] 23:36:33.723220 tst ping.py:22: Test FAILED (6.6 sec) 23:36:33.749938 run osmo-hlr_10.42.42.2(pid=30278): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30278)] 23:36:33.797566 run osmo-hlr_10.42.42.2(pid=30278): stdout: | (launched: 2022-12-09_23:36:30.382601) 23:36:33.847113 run osmo-hlr_10.42.42.2(pid=30278): stderr: | 20221209233630557 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209233630557 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209233630557 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209233630557 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209233630557 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209233630557 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209233630569 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-b200+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209233630577 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209233630578 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209233630578 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:36:33.896911 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30277): Terminating (SIGTERM) 23:36:33.936564 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30280): Terminating (SIGTERM) 23:36:33.976014 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30283): Terminating (SIGTERM) 23:36:34.015694 --- ParallelTerminationStrategy: PID 30277 died... 23:36:34.034613 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30277): Terminated: ok {rc=0} 23:36:34.078998 --- ParallelTerminationStrategy: PID 30280 died... 23:36:34.097785 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30280): Terminated: ok {rc=0} 23:36:34.141646 --- ParallelTerminationStrategy: PID 30283 died... 23:36:34.160252 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30283): Terminated: ok {rc=0} 23:36:34.243747 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-b200+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 23:36:35.331509 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:35.344061 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:36:35.420413 tst ping_idle_ping.py: using LAC 24452 23:36:35.546748 tst ping_idle_ping.py: using RAC 227 23:36:35.673729 tst ping_idle_ping.py: using CellId 24452 23:36:35.790693 tst ping_idle_ping.py: using BVCI 24453 23:36:35.900014 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:35.911057 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:35.921857 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:35.932686 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:35.943464 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:35.954100 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:35.964786 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:36:35.975381 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:36:36.091162 tst ping_idle_ping.py:24: start network... 23:36:36.306450 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:36:36.803248 run create_hlr_db(pid=30285): Launched 23:36:36.923899 bus /gobi_6: Setting Powered False 23:36:37.987331 run create_hlr_db(pid=30285): Terminated: ok {rc=0} 23:36:38.409173 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30287): Launched 23:36:38.701824 run osmo-hlr_10.42.42.2(pid=30288): Launched 23:36:38.814032 run osmo-stp_10.42.42.5: Starting osmo-stp 23:36:39.319467 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30290): Launched 23:36:39.612371 run osmo-stp_10.42.42.5(pid=30291): Launched 23:36:39.725519 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:36:40.281843 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30312): Launched 23:36:40.404804 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:36:40.673744 run patchelf(pid=30314): Launched 23:36:40.847148 run osmo-stp_10.42.42.5(pid=30291): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30291)] 23:36:40.973490 run osmo-stp_10.42.42.5(pid=30291): stdout: | (launched: 2022-12-09_23:36:39.558903) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:36:41.102045 run osmo-stp_10.42.42.5(pid=30291): stderr: | 20221209233639730 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233639730 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233639730 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233639731 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233639731 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233639731 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233639731 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:36:41.230145 run osmo-stp_10.42.42.5(pid=30291): stdout: | (launched: 2022-12-09_23:36:39.558903) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:36:41.353366 run osmo-stp_10.42.42.5(pid=30291): stderr: | 20221209233639730 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233639730 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233639730 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233639731 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233639731 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233639731 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233639731 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:36:41.498924 run patchelf(pid=30314): Terminating (SIGINT) 23:36:41.667339 run patchelf(pid=30314): Terminated: ok {rc=0} 23:36:41.789604 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30291): Process ended prematurely: osmo-stp_10.42.42.5(pid=30291) [trial-2366↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30291)] [trial-2366↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 23:36:41.799653 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 23:36:41.827457 run osmo-hlr_10.42.42.2(pid=30288): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30288)] 23:36:41.877156 run osmo-hlr_10.42.42.2(pid=30288): stdout: | (launched: 2022-12-09_23:36:38.648554) 23:36:41.928005 run osmo-hlr_10.42.42.2(pid=30288): stderr: | 20221209233638820 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209233638820 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209233638820 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209233638820 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209233638821 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209233638821 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209233638833 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-b200+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209233638842 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209233638842 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209233638842 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:36:41.978942 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30287): Terminating (SIGTERM) 23:36:42.018938 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30290): Terminating (SIGTERM) 23:36:42.058801 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30312): Terminating (SIGTERM) 23:36:42.099005 --- ParallelTerminationStrategy: PID 30287 died... 23:36:42.118144 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30287): Terminated: ok {rc=0} 23:36:42.162359 --- ParallelTerminationStrategy: PID 30290 died... 23:36:42.181134 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30290): Terminated: ok {rc=0} 23:36:42.226192 --- ParallelTerminationStrategy: PID 30312 died... 23:36:42.244824 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30312): Terminated: ok {rc=0} 23:36:42.328058 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2366 gprs:trx-b200+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 gprs:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 23:36:43.635129 tst gprs:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:36:43.642099 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 23:36:43.676173 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 23:36:43.716400 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 23:36:43.806674 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 23:36:43.840372 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 23:36:43.878254 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 23:36:44.477744 tst gprs:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2366 gprs:trx-b200+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 23:36:44.529836 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:36:44.541107 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:36:44.615610 tst cs_paging_gprs_active.py: using LAC 24453 23:36:44.741217 tst cs_paging_gprs_active.py: using RAC 228 23:36:44.864943 tst cs_paging_gprs_active.py: using CellId 24453 23:36:44.989240 tst cs_paging_gprs_active.py: using BVCI 24454 23:36:45.101812 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:36:45.112671 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:36:45.123566 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:36:45.135042 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:36:45.146415 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:36:45.157889 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:36:45.169434 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:36:45.180710 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:36:45.192241 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:36:45.313675 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:36:45.433541 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:36:45.651342 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:36:45.985734 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30349): Launched 23:36:46.284546 run iperf3-srv_10.42.42.10(pid=30350): Launched 23:36:46.425978 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:36:46.635240 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:36:46.946901 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30351): Launched 23:36:47.233769 run iperf3-srv_10.42.42.10(pid=30352): Launched 23:36:47.352813 tst cs_paging_gprs_active.py:38: start network... 23:36:47.553441 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:36:48.016303 run create_hlr_db(pid=30353): Launched 23:36:48.138093 bus /gobi_6: Setting Powered False 23:36:49.197682 run create_hlr_db(pid=30353): Terminated: ok {rc=0} 23:36:49.614163 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30355): Launched 23:36:49.913527 run osmo-hlr_10.42.42.2(pid=30356): Launched 23:36:50.026671 run osmo-stp_10.42.42.5: Starting osmo-stp 23:36:50.538219 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30358): Launched 23:36:50.836114 run osmo-stp_10.42.42.5(pid=30359): Launched 23:36:50.948347 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:36:51.461295 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30361): Launched 23:36:51.575479 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:36:51.828329 run patchelf(pid=30362): Launched 23:36:51.993722 run osmo-stp_10.42.42.5(pid=30359): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30359)] 23:36:52.119986 run osmo-stp_10.42.42.5(pid=30359): stdout: | (launched: 2022-12-09_23:36:50.781271) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:36:52.247998 run osmo-stp_10.42.42.5(pid=30359): stderr: | 20221209233650953 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233650953 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233650953 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233650954 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233650954 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233650954 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233650954 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:36:52.375671 run osmo-stp_10.42.42.5(pid=30359): stdout: | (launched: 2022-12-09_23:36:50.781271) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:36:52.497322 run osmo-stp_10.42.42.5(pid=30359): stderr: | 20221209233650953 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233650953 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233650953 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233650954 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233650954 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233650954 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233650954 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:36:52.641823 run patchelf(pid=30362): Terminating (SIGINT) 23:36:52.809507 run patchelf(pid=30362): Terminated: ok {rc=0} 23:36:52.930429 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=30359): Process ended prematurely: osmo-stp_10.42.42.5(pid=30359) [trial-2366↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30359)] [trial-2366↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 23:36:52.939753 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 23:36:52.966460 run osmo-hlr_10.42.42.2(pid=30356): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30356)] 23:36:53.013692 run osmo-hlr_10.42.42.2(pid=30356): stdout: | (launched: 2022-12-09_23:36:49.859424) 23:36:53.062313 run osmo-hlr_10.42.42.2(pid=30356): stderr: | 20221209233650036 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209233650036 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209233650036 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209233650036 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209233650036 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209233650036 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209233650048 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-b200+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209233650059 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209233650059 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209233650059 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:36:53.111319 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30349): Terminating (SIGTERM) 23:36:53.150114 run iperf3-srv_10.42.42.10(pid=30350): Terminating (SIGTERM) 23:36:53.188844 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30351): Terminating (SIGTERM) 23:36:53.227636 run iperf3-srv_10.42.42.10(pid=30352): Terminating (SIGTERM) 23:36:53.266224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30355): Terminating (SIGTERM) 23:36:53.305333 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30358): Terminating (SIGTERM) 23:36:53.344096 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30361): Terminating (SIGTERM) 23:36:53.383000 --- ParallelTerminationStrategy: PID 30349 died... 23:36:53.401716 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30349): Terminated: ok {rc=0} 23:36:53.445237 --- ParallelTerminationStrategy: PID 30350 died... 23:36:53.463434 run iperf3-srv_10.42.42.10(pid=30350): Terminated {rc=256} 23:36:53.506691 --- ParallelTerminationStrategy: PID 30351 died... 23:36:53.525054 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30351): Terminated: ok {rc=0} 23:36:53.568004 --- ParallelTerminationStrategy: PID 30352 died... 23:36:53.586294 run iperf3-srv_10.42.42.10(pid=30352): Terminated {rc=256} 23:36:53.629448 --- ParallelTerminationStrategy: PID 30355 died... 23:36:53.648056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30355): Terminated: ok {rc=0} 23:36:53.691220 --- ParallelTerminationStrategy: PID 30358 died... 23:36:53.709483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30358): Terminated: ok {rc=0} 23:36:53.752572 --- ParallelTerminationStrategy: PID 30361 died... 23:36:53.771183 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30361): Terminated: ok {rc=0} 23:36:53.855261 bus /gobi_0: Setting Powered False 23:36:54.954374 bus /gobi_0: Setting Powered False 23:36:56.069899 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-b200+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 23:36:57.214295 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:36:57.225833 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:36:57.299031 tst iperf3.py: using LAC 24454 23:36:57.415722 tst iperf3.py: using RAC 229 23:36:57.545309 tst iperf3.py: using CellId 24454 23:36:57.670282 tst iperf3.py: using BVCI 24455 23:36:57.787784 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:36:57.799228 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:36:57.810577 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:36:57.822595 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:36:57.834206 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:36:57.845859 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:36:57.857397 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:36:57.868675 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:36:57.880302 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:36:57.999363 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:36:58.215887 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:36:58.536108 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30363): Launched 23:36:58.813708 run iperf3-srv_10.42.42.10(pid=30364): Launched 23:36:58.934098 tst iperf3.py:8: start network... 23:36:59.150783 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:36:59.646356 run create_hlr_db(pid=30365): Launched 23:36:59.767358 bus /gobi_6: Setting Powered False 23:37:00.830852 run create_hlr_db(pid=30365): Terminated: ok {rc=0} 23:37:01.381801 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30367): Launched 23:37:01.708540 run osmo-hlr_10.42.42.2(pid=30368): Launched 23:37:02.010759 run osmo-stp_10.42.42.5: Starting osmo-stp 23:37:02.694610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30370): Launched 23:37:03.012588 run osmo-stp_10.42.42.5(pid=30371): Launched 23:37:03.133941 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:37:03.683914 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30373): Launched 23:37:03.805857 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:37:04.076352 run patchelf(pid=30374): Launched 23:37:04.253868 run osmo-stp_10.42.42.5(pid=30371): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30371)] 23:37:04.389268 run osmo-stp_10.42.42.5(pid=30371): stdout: | (launched: 2022-12-09_23:37:02.954861) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:37:04.527042 run osmo-stp_10.42.42.5(pid=30371): stderr: | 20221209233703148 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233703148 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233703149 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233703149 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233703149 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233703150 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233703150 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:37:04.665184 run osmo-stp_10.42.42.5(pid=30371): stdout: | (launched: 2022-12-09_23:37:02.954861) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:37:04.796249 run osmo-stp_10.42.42.5(pid=30371): stderr: | 20221209233703148 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233703148 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233703149 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233703149 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233703149 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233703150 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233703150 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:37:04.951465 run patchelf(pid=30374): Terminating (SIGINT) 23:37:05.130944 run patchelf(pid=30374): Terminated: ok {rc=0} 23:37:05.260291 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30371): Process ended prematurely: osmo-stp_10.42.42.5(pid=30371) [trial-2366↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30371)] [trial-2366↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8] 23:37:05.270580 tst iperf3.py:8: Test FAILED (8.1 sec) 23:37:05.299480 run osmo-hlr_10.42.42.2(pid=30368): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30368)] 23:37:05.350002 run osmo-hlr_10.42.42.2(pid=30368): stdout: | (launched: 2022-12-09_23:37:01.639014) 23:37:05.402201 run osmo-hlr_10.42.42.2(pid=30368): stderr: | 20221209233701872 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209233701872 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209233701872 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209233701872 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209233701872 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209233701873 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209233701888 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209233701906 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209233701908 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209233701908 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:37:05.454775 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30363): Terminating (SIGTERM) 23:37:05.496887 run iperf3-srv_10.42.42.10(pid=30364): Terminating (SIGTERM) 23:37:05.538916 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30367): Terminating (SIGTERM) 23:37:05.581004 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30370): Terminating (SIGTERM) 23:37:05.623480 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30373): Terminating (SIGTERM) 23:37:05.665858 --- ParallelTerminationStrategy: PID 30363 died... 23:37:05.685885 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30363): Terminated: ok {rc=0} 23:37:05.733062 --- ParallelTerminationStrategy: PID 30364 died... 23:37:05.752655 run iperf3-srv_10.42.42.10(pid=30364): Terminated {rc=256} 23:37:05.799301 --- ParallelTerminationStrategy: PID 30367 died... 23:37:05.818981 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30367): Terminated: ok {rc=0} 23:37:05.865736 --- ParallelTerminationStrategy: PID 30370 died... 23:37:05.885475 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30370): Terminated: ok {rc=0} 23:37:05.932345 --- ParallelTerminationStrategy: PID 30373 died... 23:37:05.952052 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30373): Terminated: ok {rc=0} 23:37:06.040428 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-b200+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 23:37:07.191418 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:07.203331 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:37:07.276050 tst iperf3m4.py: using LAC 24455 23:37:07.403145 tst iperf3m4.py: using RAC 230 23:37:07.523557 tst iperf3m4.py: using CellId 24455 23:37:07.641679 tst iperf3m4.py: using BVCI 24456 23:37:07.754874 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:07.765986 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:07.776772 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:07.788040 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:07.798877 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:07.809844 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:07.820735 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:07.831484 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:07.842488 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:37:07.960008 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:37:08.080227 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:37:08.198607 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:37:08.319690 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:37:08.536453 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:37:08.857735 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30376): Launched 23:37:09.135062 run iperf3-srv_10.42.42.10(pid=30377): Launched 23:37:09.254689 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:37:09.470947 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:37:09.792529 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30378): Launched 23:37:10.069832 run iperf3-srv_10.42.42.10(pid=30379): Launched 23:37:10.189591 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:37:10.405957 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:37:10.726738 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30380): Launched 23:37:11.003715 run iperf3-srv_10.42.42.10(pid=30381): Launched 23:37:11.123107 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:37:11.338844 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:37:11.660124 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30382): Launched 23:37:11.937321 run iperf3-srv_10.42.42.10(pid=30383): Launched 23:37:12.056898 tst iperf3m4.py:8: start network... 23:37:12.272623 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:37:12.767556 run create_hlr_db(pid=30384): Launched 23:37:12.888297 bus /gobi_6: Setting Powered False 23:37:13.952271 run create_hlr_db(pid=30384): Terminated: ok {rc=0} 23:37:14.396334 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30386): Launched 23:37:14.715681 run osmo-hlr_10.42.42.2(pid=30387): Launched 23:37:14.838263 run osmo-stp_10.42.42.5: Starting osmo-stp 23:37:15.392072 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30389): Launched 23:37:15.711171 run osmo-stp_10.42.42.5(pid=30390): Launched 23:37:15.833351 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:37:16.482503 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30392): Launched 23:37:16.617621 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:37:16.894728 run patchelf(pid=30393): Launched 23:37:17.085115 run osmo-stp_10.42.42.5(pid=30390): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30390)] 23:37:17.224324 run osmo-stp_10.42.42.5(pid=30390): stdout: | (launched: 2022-12-09_23:37:15.653507) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:37:17.365233 run osmo-stp_10.42.42.5(pid=30390): stderr: | 20221209233715867 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233715867 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233715867 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233715868 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233715868 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233715868 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233715868 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:37:17.503251 run osmo-stp_10.42.42.5(pid=30390): stdout: | (launched: 2022-12-09_23:37:15.653507) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:37:17.634976 run osmo-stp_10.42.42.5(pid=30390): stderr: | 20221209233715867 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233715867 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233715867 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233715868 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233715868 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233715868 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233715868 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:37:17.790686 run patchelf(pid=30393): Terminating (SIGINT) 23:37:17.969843 run patchelf(pid=30393): Terminated: ok {rc=0} 23:37:18.099463 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30390): Process ended prematurely: osmo-stp_10.42.42.5(pid=30390) [trial-2366↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30390)] [trial-2366↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8] 23:37:18.109623 tst iperf3m4.py:8: Test FAILED (11.0 sec) 23:37:18.138724 run osmo-hlr_10.42.42.2(pid=30387): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30387)] 23:37:18.188515 run osmo-hlr_10.42.42.2(pid=30387): stdout: | (launched: 2022-12-09_23:37:14.657718) 23:37:18.239820 run osmo-hlr_10.42.42.2(pid=30387): stderr: | 20221209233714853 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209233714853 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209233714853 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209233714853 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209233714853 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209233714853 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209233714868 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209233714878 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209233714878 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209233714878 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:37:18.291626 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30376): Terminating (SIGTERM) 23:37:18.333495 run iperf3-srv_10.42.42.10(pid=30377): Terminating (SIGTERM) 23:37:18.375418 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30378): Terminating (SIGTERM) 23:37:18.417071 run iperf3-srv_10.42.42.10(pid=30379): Terminating (SIGTERM) 23:37:18.458601 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30380): Terminating (SIGTERM) 23:37:18.500162 run iperf3-srv_10.42.42.10(pid=30381): Terminating (SIGTERM) 23:37:18.541583 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30382): Terminating (SIGTERM) 23:37:18.582973 run iperf3-srv_10.42.42.10(pid=30383): Terminating (SIGTERM) 23:37:18.624662 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30386): Terminating (SIGTERM) 23:37:18.666572 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30389): Terminating (SIGTERM) 23:37:18.707954 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30392): Terminating (SIGTERM) 23:37:18.749586 --- ParallelTerminationStrategy: PID 30376 died... 23:37:18.769482 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30376): Terminated: ok {rc=0} 23:37:18.815818 --- ParallelTerminationStrategy: PID 30377 died... 23:37:18.835177 run iperf3-srv_10.42.42.10(pid=30377): Terminated {rc=256} 23:37:18.881230 --- ParallelTerminationStrategy: PID 30378 died... 23:37:18.900669 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30378): Terminated: ok {rc=0} 23:37:18.946888 --- ParallelTerminationStrategy: PID 30379 died... 23:37:18.966191 run iperf3-srv_10.42.42.10(pid=30379): Terminated {rc=256} 23:37:19.011946 --- ParallelTerminationStrategy: PID 30380 died... 23:37:19.031339 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30380): Terminated: ok {rc=0} 23:37:19.077746 --- ParallelTerminationStrategy: PID 30381 died... 23:37:19.097049 run iperf3-srv_10.42.42.10(pid=30381): Terminated {rc=256} 23:37:19.142813 --- ParallelTerminationStrategy: PID 30382 died... 23:37:19.162144 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30382): Terminated: ok {rc=0} 23:37:19.208253 --- ParallelTerminationStrategy: PID 30383 died... 23:37:19.227604 run iperf3-srv_10.42.42.10(pid=30383): Terminated {rc=256} 23:37:19.273678 --- ParallelTerminationStrategy: PID 30386 died... 23:37:19.293053 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30386): Terminated: ok {rc=0} 23:37:19.339273 --- ParallelTerminationStrategy: PID 30389 died... 23:37:19.358613 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30389): Terminated: ok {rc=0} 23:37:19.404738 --- ParallelTerminationStrategy: PID 30392 died... 23:37:19.424271 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30392): Terminated: ok {rc=0} 23:37:19.511294 bus /gobi_4: Setting Powered False 23:37:20.610509 bus /gobi_4: Setting Powered False 23:37:21.726102 bus /gobi_1: Setting Powered False 23:37:22.821635 bus /gobi_1: Setting Powered False 23:37:23.935661 bus /gobi_0: Setting Powered False 23:37:25.033356 bus /gobi_0: Setting Powered False 23:37:26.147305 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-b200+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 23:37:27.250222 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:27.261691 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:37:27.334707 tst ping.py: using LAC 24456 23:37:27.450546 tst ping.py: using RAC 231 23:37:27.567281 tst ping.py: using CellId 24456 23:37:27.684374 tst ping.py: using BVCI 24457 23:37:27.792765 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:27.803695 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:27.814336 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:27.824879 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:27.835464 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:27.846159 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:27.856806 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:27.867370 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:37:27.983585 tst ping.py:19: start network... 23:37:28.195582 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:37:28.682043 run create_hlr_db(pid=30394): Launched 23:37:28.802275 bus /gobi_6: Setting Powered False 23:37:29.864696 run create_hlr_db(pid=30394): Terminated: ok {rc=0} 23:37:30.303623 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30396): Launched 23:37:30.618387 run osmo-hlr_10.42.42.2(pid=30397): Launched 23:37:30.739417 run osmo-stp_10.42.42.5: Starting osmo-stp 23:37:31.370332 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30399): Launched 23:37:31.698612 run osmo-stp_10.42.42.5(pid=30400): Launched 23:37:31.844374 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:37:32.528072 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30402): Launched 23:37:32.648571 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:37:32.913452 run patchelf(pid=30403): Launched 23:37:33.088055 run osmo-stp_10.42.42.5(pid=30400): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30400)] 23:37:33.221485 run osmo-stp_10.42.42.5(pid=30400): stdout: | (launched: 2022-12-09_23:37:31.626690) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:37:33.356560 run osmo-stp_10.42.42.5(pid=30400): stderr: | 20221209233732003 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233732003 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233732003 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233732004 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233732004 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233732004 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233732004 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:37:33.492118 run osmo-stp_10.42.42.5(pid=30400): stdout: | (launched: 2022-12-09_23:37:31.626690) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:37:33.622068 run osmo-stp_10.42.42.5(pid=30400): stderr: | 20221209233732003 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233732003 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233732003 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233732004 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233732004 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233732004 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233732004 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:37:33.775377 run patchelf(pid=30403): Terminating (SIGINT) 23:37:33.952100 run patchelf(pid=30403): Terminated: ok {rc=0} 23:37:34.079623 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30400): Process ended prematurely: osmo-stp_10.42.42.5(pid=30400) [trial-2366↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30400)] [trial-2366↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22] 23:37:34.089683 tst ping.py:22: Test FAILED (6.8 sec) 23:37:34.117969 run osmo-hlr_10.42.42.2(pid=30397): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30397)] 23:37:34.167623 run osmo-hlr_10.42.42.2(pid=30397): stdout: | (launched: 2022-12-09_23:37:30.561348) 23:37:34.219011 run osmo-hlr_10.42.42.2(pid=30397): stderr: | 20221209233730757 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209233730757 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209233730757 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209233730757 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209233730757 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209233730757 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209233730770 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-b200+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209233730778 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209233730778 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209233730778 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:37:34.271412 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30396): Terminating (SIGTERM) 23:37:34.313044 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30399): Terminating (SIGTERM) 23:37:34.354506 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30402): Terminating (SIGTERM) 23:37:34.395975 --- ParallelTerminationStrategy: PID 30396 died... 23:37:34.415789 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30396): Terminated: ok {rc=0} 23:37:34.462315 --- ParallelTerminationStrategy: PID 30399 died... 23:37:34.481459 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30399): Terminated: ok {rc=0} 23:37:34.527430 --- ParallelTerminationStrategy: PID 30402 died... 23:37:34.546592 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30402): Terminated: ok {rc=0} 23:37:34.633609 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-b200+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 23:37:35.721315 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:35.733703 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:37:35.807568 tst ping_idle_ping.py: using LAC 24457 23:37:35.932384 tst ping_idle_ping.py: using RAC 232 23:37:36.055939 tst ping_idle_ping.py: using CellId 24457 23:37:36.180545 tst ping_idle_ping.py: using BVCI 24458 23:37:36.294934 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:36.306213 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:36.317341 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:36.328753 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:36.340113 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:36.351273 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:36.362754 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:37:36.374033 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:37:36.487443 tst ping_idle_ping.py:24: start network... 23:37:36.685982 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:37:37.144579 run create_hlr_db(pid=30405): Launched 23:37:37.265159 bus /gobi_6: Setting Powered False 23:37:38.324445 run create_hlr_db(pid=30405): Terminated: ok {rc=0} 23:37:38.755240 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30407): Launched 23:37:39.069765 run osmo-hlr_10.42.42.2(pid=30408): Launched 23:37:39.190241 run osmo-stp_10.42.42.5: Starting osmo-stp 23:37:39.737169 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30410): Launched 23:37:40.051374 run osmo-stp_10.42.42.5(pid=30411): Launched 23:37:40.173075 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:37:40.716935 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30413): Launched 23:37:40.836914 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:37:41.102797 run patchelf(pid=30414): Launched 23:37:41.277704 run osmo-stp_10.42.42.5(pid=30411): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30411)] 23:37:41.411154 run osmo-stp_10.42.42.5(pid=30411): stdout: | (launched: 2022-12-09_23:37:39.994533) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:37:41.546695 run osmo-stp_10.42.42.5(pid=30411): stderr: | 20221209233740185 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233740185 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233740186 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233740186 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233740187 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233740187 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233740187 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:37:41.682845 run osmo-stp_10.42.42.5(pid=30411): stdout: | (launched: 2022-12-09_23:37:39.994533) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:37:41.812328 run osmo-stp_10.42.42.5(pid=30411): stderr: | 20221209233740185 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233740185 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233740186 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233740186 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233740187 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233740187 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233740187 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:37:41.965809 run patchelf(pid=30414): Terminating (SIGINT) 23:37:42.142345 run patchelf(pid=30414): Terminated: ok {rc=0} 23:37:42.270250 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30411): Process ended prematurely: osmo-stp_10.42.42.5(pid=30411) [trial-2366↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30411)] [trial-2366↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 23:37:42.279718 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 23:37:42.308337 run osmo-hlr_10.42.42.2(pid=30408): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30408)] 23:37:42.358218 run osmo-hlr_10.42.42.2(pid=30408): stdout: | (launched: 2022-12-09_23:37:39.012877) 23:37:42.410015 run osmo-hlr_10.42.42.2(pid=30408): stderr: | 20221209233739208 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209233739208 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209233739208 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209233739208 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209233739208 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209233739208 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209233739220 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-b200+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209233739228 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209233739228 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209233739228 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:37:42.462529 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30407): Terminating (SIGTERM) 23:37:42.503975 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30410): Terminating (SIGTERM) 23:37:42.545606 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30413): Terminating (SIGTERM) 23:37:42.587475 --- ParallelTerminationStrategy: PID 30407 died... 23:37:42.607157 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30407): Terminated: ok {rc=0} 23:37:42.653702 --- ParallelTerminationStrategy: PID 30410 died... 23:37:42.673166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30410): Terminated: ok {rc=0} 23:37:42.720159 --- ParallelTerminationStrategy: PID 30413 died... 23:37:42.739603 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30413): Terminated: ok {rc=0} 23:37:42.826987 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2366 gprs:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 23:37:44.135838 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:37:44.142560 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 23:37:44.176933 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 23:37:44.216884 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 23:37:44.306019 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 23:37:44.340596 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 23:37:44.380546 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 23:37:44.982410 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2366 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 23:37:45.034743 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:37:45.046497 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 23:37:45.099502 tst cs_paging_gprs_active.py: using LAC 24458 23:37:45.225608 tst cs_paging_gprs_active.py: using RAC 233 23:37:45.350440 tst cs_paging_gprs_active.py: using CellId 24458 23:37:45.478724 tst cs_paging_gprs_active.py: using BVCI 24459 23:37:45.588125 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:37:45.599621 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:37:45.610845 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:37:45.622061 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:37:45.633119 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:37:45.644325 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:37:45.655815 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:37:45.666926 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:37:45.678363 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 23:37:45.799492 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 23:37:45.929592 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:37:46.153327 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:37:46.487583 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30418): Launched 23:37:46.793822 run iperf3-srv_10.42.42.10(pid=30419): Launched 23:37:46.932419 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:37:47.155532 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:37:47.480827 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30420): Launched 23:37:47.761707 run iperf3-srv_10.42.42.10(pid=30421): Launched 23:37:47.882353 tst cs_paging_gprs_active.py:38: start network... 23:37:48.100061 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:37:48.598252 run create_hlr_db(pid=30422): Launched 23:37:48.721105 bus /gobi_6: Setting Powered False 23:37:49.784659 run create_hlr_db(pid=30422): Terminated: ok {rc=0} 23:37:50.229414 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30424): Launched 23:37:50.549202 run osmo-hlr_10.42.42.2(pid=30425): Launched 23:37:50.672129 run osmo-stp_10.42.42.5: Starting osmo-stp 23:37:51.224204 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30427): Launched 23:37:51.542684 run osmo-stp_10.42.42.5(pid=30428): Launched 23:37:51.665347 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:37:52.215877 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30430): Launched 23:37:52.338822 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:37:52.607920 run patchelf(pid=30431): Launched 23:37:52.785579 run osmo-stp_10.42.42.5(pid=30428): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30428)] 23:37:52.920363 run osmo-stp_10.42.42.5(pid=30428): stdout: | (launched: 2022-12-09_23:37:51.485139) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:37:53.057399 run osmo-stp_10.42.42.5(pid=30428): stderr: | 20221209233751676 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233751676 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233751677 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233751677 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233751678 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233751678 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233751678 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:37:53.194328 run osmo-stp_10.42.42.5(pid=30428): stdout: | (launched: 2022-12-09_23:37:51.485139) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:37:53.325098 run osmo-stp_10.42.42.5(pid=30428): stderr: | 20221209233751676 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233751676 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233751677 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233751677 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233751678 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233751678 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233751678 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:37:53.479719 run patchelf(pid=30431): Terminating (SIGINT) 23:37:53.658484 run patchelf(pid=30431): Terminated: ok {rc=0} 23:37:53.787612 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=30428): Process ended prematurely: osmo-stp_10.42.42.5(pid=30428) [trial-2366↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30428)] [trial-2366↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 23:37:53.797723 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 23:37:53.826438 run osmo-hlr_10.42.42.2(pid=30425): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30425)] 23:37:53.876103 run osmo-hlr_10.42.42.2(pid=30425): stdout: | (launched: 2022-12-09_23:37:50.491317) 23:37:53.927522 run osmo-hlr_10.42.42.2(pid=30425): stderr: | 20221209233750688 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209233750688 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209233750688 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209233750688 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209233750688 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209233750688 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209233750700 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209233750708 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209233750709 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209233750709 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:37:53.979338 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30418): Terminating (SIGTERM) 23:37:54.021057 run iperf3-srv_10.42.42.10(pid=30419): Terminating (SIGTERM) 23:37:54.062562 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30420): Terminating (SIGTERM) 23:37:54.104142 run iperf3-srv_10.42.42.10(pid=30421): Terminating (SIGTERM) 23:37:54.145409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30424): Terminating (SIGTERM) 23:37:54.186847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30427): Terminating (SIGTERM) 23:37:54.228208 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30430): Terminating (SIGTERM) 23:37:54.270076 --- ParallelTerminationStrategy: PID 30418 died... 23:37:54.289899 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30418): Terminated: ok {rc=0} 23:37:54.336085 --- ParallelTerminationStrategy: PID 30419 died... 23:37:54.355322 run iperf3-srv_10.42.42.10(pid=30419): Terminated {rc=256} 23:37:54.401209 --- ParallelTerminationStrategy: PID 30420 died... 23:37:54.420391 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30420): Terminated: ok {rc=0} 23:37:54.466354 --- ParallelTerminationStrategy: PID 30421 died... 23:37:54.485614 run iperf3-srv_10.42.42.10(pid=30421): Terminated {rc=256} 23:37:54.531492 --- ParallelTerminationStrategy: PID 30424 died... 23:37:54.550730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30424): Terminated: ok {rc=0} 23:37:54.596907 --- ParallelTerminationStrategy: PID 30427 died... 23:37:54.616670 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30427): Terminated: ok {rc=0} 23:37:54.663171 --- ParallelTerminationStrategy: PID 30430 died... 23:37:54.682788 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30430): Terminated: ok {rc=0} 23:37:54.771322 bus /gobi_0: Setting Powered False 23:37:55.870054 bus /gobi_0: Setting Powered False 23:37:56.986425 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 23:37:58.135447 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:37:58.147796 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 23:37:58.203699 tst iperf3.py: using LAC 24459 23:37:58.331252 tst iperf3.py: using RAC 234 23:37:58.456097 tst iperf3.py: using CellId 24459 23:37:58.581396 tst iperf3.py: using BVCI 24460 23:37:58.697932 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:37:58.709767 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:37:58.721437 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:37:58.733223 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:37:58.745004 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:37:58.756738 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:37:58.768719 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:37:58.780729 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:37:58.792621 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 23:37:58.910249 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:37:59.111552 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:37:59.411598 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30432): Launched 23:37:59.670919 run iperf3-srv_10.42.42.10(pid=30433): Launched 23:37:59.782647 tst iperf3.py:8: start network... 23:37:59.982782 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:38:00.446557 run create_hlr_db(pid=30434): Launched 23:38:00.568931 bus /gobi_6: Setting Powered False 23:38:01.627666 run create_hlr_db(pid=30434): Terminated: ok {rc=0} 23:38:02.084030 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30437): Launched 23:38:02.434335 run osmo-hlr_10.42.42.2(pid=30447): Launched 23:38:02.714022 run osmo-stp_10.42.42.5: Starting osmo-stp 23:38:03.306440 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30450): Launched 23:38:03.644932 run osmo-stp_10.42.42.5(pid=30451): Launched 23:38:03.891283 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:38:04.538562 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30453): Launched 23:38:04.676013 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:38:04.956006 run patchelf(pid=30454): Launched 23:38:05.151438 run osmo-stp_10.42.42.5(pid=30451): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30451)] 23:38:05.291702 run osmo-stp_10.42.42.5(pid=30451): stdout: | (launched: 2022-12-09_23:38:03.582150) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:38:05.434159 run osmo-stp_10.42.42.5(pid=30451): stderr: | 20221209233803878 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233803878 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233803879 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233803879 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233803881 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233803881 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233803881 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:38:05.577611 run osmo-stp_10.42.42.5(pid=30451): stdout: | (launched: 2022-12-09_23:38:03.582150) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:38:05.712579 run osmo-stp_10.42.42.5(pid=30451): stderr: | 20221209233803878 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233803878 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233803879 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233803879 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233803881 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233803881 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233803881 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:38:05.871799 run patchelf(pid=30454): Terminating (SIGINT) 23:38:06.055962 run patchelf(pid=30454): Terminated: ok {rc=0} 23:38:06.189083 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30451): Process ended prematurely: osmo-stp_10.42.42.5(pid=30451) [trial-2366↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30451)] [trial-2366↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 23:38:06.200210 tst iperf3.py:8: Test FAILED (8.1 sec) 23:38:06.232424 run osmo-hlr_10.42.42.2(pid=30447): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30447)] 23:38:06.285651 run osmo-hlr_10.42.42.2(pid=30447): stdout: | (launched: 2022-12-09_23:38:02.375275) 23:38:06.340705 run osmo-hlr_10.42.42.2(pid=30447): stderr: | 20221209233802569 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209233802570 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209233802570 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209233802570 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209233802570 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209233802570 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209233802591 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209233802599 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209233802599 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209233802599 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:38:06.397538 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30432): Terminating (SIGTERM) 23:38:06.442920 run iperf3-srv_10.42.42.10(pid=30433): Terminating (SIGTERM) 23:38:06.490833 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30437): Terminating (SIGTERM) 23:38:06.536146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30450): Terminating (SIGTERM) 23:38:06.582387 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30453): Terminating (SIGTERM) 23:38:06.628902 --- ParallelTerminationStrategy: PID 30432 died... 23:38:06.649779 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30432): Terminated: ok {rc=0} 23:38:06.701310 --- ParallelTerminationStrategy: PID 30433 died... 23:38:06.721982 run iperf3-srv_10.42.42.10(pid=30433): Terminated {rc=256} 23:38:06.772244 --- ParallelTerminationStrategy: PID 30437 died... 23:38:06.793074 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30437): Terminated: ok {rc=0} 23:38:06.842846 --- ParallelTerminationStrategy: PID 30450 died... 23:38:06.863582 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30450): Terminated: ok {rc=0} 23:38:06.912741 --- ParallelTerminationStrategy: PID 30453 died... 23:38:06.933472 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30453): Terminated: ok {rc=0} 23:38:07.026223 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 23:38:08.182888 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:08.196227 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 23:38:08.253196 tst iperf3m4.py: using LAC 24460 23:38:08.381377 tst iperf3m4.py: using RAC 235 23:38:08.520745 tst iperf3m4.py: using CellId 24460 23:38:08.657250 tst iperf3m4.py: using BVCI 24461 23:38:08.778986 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:08.791896 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:08.804470 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:08.817882 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:08.830684 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:08.844604 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:08.857490 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:08.872370 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:08.885015 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 23:38:09.011914 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 23:38:09.141541 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 23:38:09.267661 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 23:38:09.394859 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:38:09.620204 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:38:09.965739 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30457): Launched 23:38:10.265481 run iperf3-srv_10.42.42.10(pid=30458): Launched 23:38:10.403900 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:38:10.629112 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:38:10.973709 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30459): Launched 23:38:11.294581 run iperf3-srv_10.42.42.10(pid=30468): Launched 23:38:11.438063 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:38:11.668791 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:38:12.042059 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30510): Launched 23:38:12.442913 run iperf3-srv_10.42.42.10(pid=30552): Launched 23:38:12.600160 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:38:12.865923 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:38:13.268930 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30656): Launched 23:38:13.619936 run iperf3-srv_10.42.42.10(pid=30702): Launched 23:38:13.815901 tst iperf3m4.py:8: start network... 23:38:14.053360 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:38:14.570136 run create_hlr_db(pid=30724): Launched 23:38:14.735593 bus /gobi_6: Setting Powered False 23:38:15.799392 run create_hlr_db(pid=30724): Terminated: ok {rc=0} 23:38:16.298944 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30726): Launched 23:38:16.642694 run osmo-hlr_10.42.42.2(pid=30727): Launched 23:38:16.888903 run osmo-stp_10.42.42.5: Starting osmo-stp 23:38:17.645066 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30729): Launched 23:38:18.033169 run osmo-stp_10.42.42.5(pid=30730): Launched 23:38:18.182349 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:38:18.949933 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30732): Launched 23:38:19.078752 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:38:19.343945 run patchelf(pid=30733): Launched 23:38:19.529412 run osmo-stp_10.42.42.5(pid=30730): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30730)] 23:38:19.659771 run osmo-stp_10.42.42.5(pid=30730): stdout: | (launched: 2022-12-09_23:38:17.958470) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:38:19.792081 run osmo-stp_10.42.42.5(pid=30730): stderr: | 20221209233818324 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233818326 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233818326 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233818329 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233818329 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233818329 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233818330 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:38:19.924214 run osmo-stp_10.42.42.5(pid=30730): stdout: | (launched: 2022-12-09_23:38:17.958470) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:38:20.050121 run osmo-stp_10.42.42.5(pid=30730): stderr: | 20221209233818324 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233818326 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233818326 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233818329 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233818329 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233818329 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233818330 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:38:20.198839 run patchelf(pid=30733): Terminating (SIGINT) 23:38:20.371850 run patchelf(pid=30733): Terminated: ok {rc=0} 23:38:20.497317 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30730): Process ended prematurely: osmo-stp_10.42.42.5(pid=30730) [trial-2366↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30730)] [trial-2366↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 23:38:20.508073 tst iperf3m4.py:8: Test FAILED (12.4 sec) 23:38:20.537289 run osmo-hlr_10.42.42.2(pid=30727): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30727)] 23:38:20.587226 run osmo-hlr_10.42.42.2(pid=30727): stdout: | (launched: 2022-12-09_23:38:16.582330) 23:38:20.638495 run osmo-hlr_10.42.42.2(pid=30727): stderr: | 20221209233816840 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209233816840 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209233816840 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209233816840 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209233816840 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209233816840 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209233816855 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209233816872 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209233816872 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209233816872 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:38:20.689973 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30457): Terminating (SIGTERM) 23:38:20.731486 run iperf3-srv_10.42.42.10(pid=30458): Terminating (SIGTERM) 23:38:20.774260 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30459): Terminating (SIGTERM) 23:38:20.815959 run iperf3-srv_10.42.42.10(pid=30468): Terminating (SIGTERM) 23:38:20.858555 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30510): Terminating (SIGTERM) 23:38:20.900798 run iperf3-srv_10.42.42.10(pid=30552): Terminating (SIGTERM) 23:38:20.945488 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30656): Terminating (SIGTERM) 23:38:20.987121 run iperf3-srv_10.42.42.10(pid=30702): Terminating (SIGTERM) 23:38:21.031190 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30726): Terminating (SIGTERM) 23:38:21.072481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30729): Terminating (SIGTERM) 23:38:21.113451 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30732): Terminating (SIGTERM) 23:38:21.156710 --- ParallelTerminationStrategy: PID 30457 died... 23:38:21.176281 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30457): Terminated: ok {rc=0} 23:38:21.223377 --- ParallelTerminationStrategy: PID 30458 died... 23:38:21.242647 run iperf3-srv_10.42.42.10(pid=30458): Terminated {rc=256} 23:38:21.287828 --- ParallelTerminationStrategy: PID 30459 died... 23:38:21.307691 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30459): Terminated: ok {rc=0} 23:38:21.354003 --- ParallelTerminationStrategy: PID 30468 died... 23:38:21.373987 run iperf3-srv_10.42.42.10(pid=30468): Terminated {rc=256} 23:38:21.420097 --- ParallelTerminationStrategy: PID 30510 died... 23:38:21.440135 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30510): Terminated: ok {rc=0} 23:38:21.486183 --- ParallelTerminationStrategy: PID 30552 died... 23:38:21.506067 run iperf3-srv_10.42.42.10(pid=30552): Terminated {rc=256} 23:38:21.551954 --- ParallelTerminationStrategy: PID 30656 died... 23:38:21.571812 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30656): Terminated: ok {rc=0} 23:38:21.618361 --- ParallelTerminationStrategy: PID 30702 died... 23:38:21.637988 run iperf3-srv_10.42.42.10(pid=30702): Terminated {rc=256} 23:38:21.684503 --- ParallelTerminationStrategy: PID 30726 died... 23:38:21.704503 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30726): Terminated: ok {rc=0} 23:38:21.751421 --- ParallelTerminationStrategy: PID 30729 died... 23:38:21.771222 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30729): Terminated: ok {rc=0} 23:38:21.817876 --- ParallelTerminationStrategy: PID 30732 died... 23:38:21.837557 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30732): Terminated: ok {rc=0} 23:38:21.926206 bus /gobi_4: Setting Powered False 23:38:23.025787 bus /gobi_4: Setting Powered False 23:38:24.144598 bus /gobi_1: Setting Powered False 23:38:25.247397 bus /gobi_1: Setting Powered False 23:38:26.367586 bus /gobi_0: Setting Powered False 23:38:27.468725 bus /gobi_0: Setting Powered False 23:38:28.584167 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 23:38:29.682298 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:29.694063 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 23:38:29.746205 tst ping.py: using LAC 24461 23:38:29.861824 tst ping.py: using RAC 236 23:38:29.979110 tst ping.py: using CellId 24461 23:38:30.096779 tst ping.py: using BVCI 24462 23:38:30.202873 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:30.214211 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:30.225291 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:30.236224 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:30.247123 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:30.258115 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:30.269223 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:30.280103 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 23:38:30.392648 tst ping.py:19: start network... 23:38:30.590438 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:38:31.093860 run create_hlr_db(pid=30734): Launched 23:38:31.252279 bus /gobi_6: Setting Powered False 23:38:32.311907 run create_hlr_db(pid=30734): Terminated: ok {rc=0} 23:38:32.757453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30736): Launched 23:38:33.071021 run osmo-hlr_10.42.42.2(pid=30737): Launched 23:38:33.191569 run osmo-stp_10.42.42.5: Starting osmo-stp 23:38:33.733511 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30739): Launched 23:38:34.048139 run osmo-stp_10.42.42.5(pid=30740): Launched 23:38:34.168248 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:38:34.711815 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30742): Launched 23:38:34.832215 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:38:35.097410 run patchelf(pid=30743): Launched 23:38:35.273029 run osmo-stp_10.42.42.5(pid=30740): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30740)] 23:38:35.406873 run osmo-stp_10.42.42.5(pid=30740): stdout: | (launched: 2022-12-09_23:38:33.991138) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:38:35.542189 run osmo-stp_10.42.42.5(pid=30740): stderr: | 20221209233834185 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233834185 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233834185 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233834186 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233834186 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233834186 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233834186 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:38:35.677944 run osmo-stp_10.42.42.5(pid=30740): stdout: | (launched: 2022-12-09_23:38:33.991138) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:38:35.807609 run osmo-stp_10.42.42.5(pid=30740): stderr: | 20221209233834185 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233834185 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233834185 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233834186 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233834186 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233834186 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233834186 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:38:35.961348 run patchelf(pid=30743): Terminating (SIGINT) 23:38:36.138610 run patchelf(pid=30743): Terminated: ok {rc=0} 23:38:36.266181 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30740): Process ended prematurely: osmo-stp_10.42.42.5(pid=30740) [trial-2366↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30740)] [trial-2366↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 23:38:36.275694 tst ping.py:22: Test FAILED (6.6 sec) 23:38:36.304196 run osmo-hlr_10.42.42.2(pid=30737): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30737)] 23:38:36.354278 run osmo-hlr_10.42.42.2(pid=30737): stdout: | (launched: 2022-12-09_23:38:33.014171) 23:38:36.406170 run osmo-hlr_10.42.42.2(pid=30737): stderr: | 20221209233833209 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209233833209 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209233833209 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209233833209 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209233833209 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209233833209 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209233833222 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209233833232 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209233833232 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209233833232 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:38:36.458511 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30736): Terminating (SIGTERM) 23:38:36.500336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30739): Terminating (SIGTERM) 23:38:36.542209 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30742): Terminating (SIGTERM) 23:38:36.584200 --- ParallelTerminationStrategy: PID 30736 died... 23:38:36.604220 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30736): Terminated: ok {rc=0} 23:38:36.650953 --- ParallelTerminationStrategy: PID 30739 died... 23:38:36.670512 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30739): Terminated: ok {rc=0} 23:38:36.717206 --- ParallelTerminationStrategy: PID 30742 died... 23:38:36.736815 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30742): Terminated: ok {rc=0} 23:38:36.825024 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 23:38:37.912725 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:37.925004 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 23:38:37.978355 tst ping_idle_ping.py: using LAC 24462 23:38:38.096212 tst ping_idle_ping.py: using RAC 237 23:38:38.213921 tst ping_idle_ping.py: using CellId 24462 23:38:38.329545 tst ping_idle_ping.py: using BVCI 24463 23:38:38.447150 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:38.459146 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:38.470862 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:38.482843 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:38.494396 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:38.506147 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:38.518453 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:38:38.530562 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 23:38:38.645692 tst ping_idle_ping.py:24: start network... 23:38:38.845201 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:38:39.303866 run create_hlr_db(pid=30744): Launched 23:38:39.425296 bus /gobi_6: Setting Powered False 23:38:40.485233 run create_hlr_db(pid=30744): Terminated: ok {rc=0} 23:38:40.917229 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30746): Launched 23:38:41.232216 run osmo-hlr_10.42.42.2(pid=30747): Launched 23:38:41.353214 run osmo-stp_10.42.42.5: Starting osmo-stp 23:38:41.897492 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30749): Launched 23:38:42.213114 run osmo-stp_10.42.42.5(pid=30750): Launched 23:38:42.333779 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:38:42.879243 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30752): Launched 23:38:42.999482 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:38:43.265262 run patchelf(pid=30753): Launched 23:38:43.440108 run osmo-stp_10.42.42.5(pid=30750): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30750)] 23:38:43.573631 run osmo-stp_10.42.42.5(pid=30750): stdout: | (launched: 2022-12-09_23:38:42.155869) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:38:43.709372 run osmo-stp_10.42.42.5(pid=30750): stderr: | 20221209233842346 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233842346 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233842346 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233842347 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233842347 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233842347 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233842347 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:38:43.844593 run osmo-stp_10.42.42.5(pid=30750): stdout: | (launched: 2022-12-09_23:38:42.155869) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:38:43.974352 run osmo-stp_10.42.42.5(pid=30750): stderr: | 20221209233842346 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233842346 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233842346 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233842347 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233842347 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233842347 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233842347 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:38:44.127887 run patchelf(pid=30753): Terminating (SIGINT) 23:38:44.304862 run patchelf(pid=30753): Terminated: ok {rc=0} 23:38:44.432196 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30750): Process ended prematurely: osmo-stp_10.42.42.5(pid=30750) [trial-2366↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30750)] [trial-2366↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 23:38:44.441965 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 23:38:44.470385 run osmo-hlr_10.42.42.2(pid=30747): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30747)] 23:38:44.520404 run osmo-hlr_10.42.42.2(pid=30747): stdout: | (launched: 2022-12-09_23:38:41.175091) 23:38:44.572101 run osmo-hlr_10.42.42.2(pid=30747): stderr: | 20221209233841371 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209233841371 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209233841371 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209233841371 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209233841371 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209233841371 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209233841384 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209233841393 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209233841393 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209233841393 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:38:44.624448 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30746): Terminating (SIGTERM) 23:38:44.666862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30749): Terminating (SIGTERM) 23:38:44.708839 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30752): Terminating (SIGTERM) 23:38:44.751397 --- ParallelTerminationStrategy: PID 30746 died... 23:38:44.771332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30746): Terminated: ok {rc=0} 23:38:44.818002 --- ParallelTerminationStrategy: PID 30749 died... 23:38:44.837451 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30749): Terminated: ok {rc=0} 23:38:44.883595 --- ParallelTerminationStrategy: PID 30752 died... 23:38:44.903096 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30752): Terminated: ok {rc=0} 23:38:44.989989 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2366 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 23:38:46.339089 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:38:46.350614 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 23:38:46.395452 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 23:38:46.441219 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 23:38:46.509119 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 23:38:46.553848 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 23:38:46.600112 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 23:38:47.157935 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2366 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 23:38:47.164049 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:38:47.176412 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 23:38:47.248374 tst switch_tch_pdch.py: using LAC 24463 23:38:47.368408 tst switch_tch_pdch.py: using RAC 238 23:38:47.484199 tst switch_tch_pdch.py: using CellId 24463 23:38:47.602557 tst switch_tch_pdch.py: using BVCI 24464 23:38:47.709178 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:38:47.720290 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:38:47.731451 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:38:47.743120 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:38:47.754699 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:38:47.766139 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:38:47.777733 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:38:47.789165 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:38:47.903504 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:38:48.021570 tst switch_tch_pdch.py:51: start network... 23:38:48.235051 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:38:48.722729 run create_hlr_db(pid=30757): Launched 23:38:48.842589 bus /gobi_6: Setting Powered False 23:38:49.904853 run create_hlr_db(pid=30757): Terminated: ok {rc=0} 23:38:50.325588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30759): Launched 23:38:50.618889 run osmo-hlr_10.42.42.2(pid=30760): Launched 23:38:50.730705 run osmo-stp_10.42.42.5: Starting osmo-stp 23:38:51.247154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30762): Launched 23:38:51.538976 run osmo-stp_10.42.42.5(pid=30763): Launched 23:38:51.649935 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:38:52.152895 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30765): Launched 23:38:52.263822 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:38:52.509671 run patchelf(pid=30766): Launched 23:38:52.671403 run osmo-stp_10.42.42.5(pid=30763): ERR: Terminated: ERROR {rc=1} [trial-2366↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30763)] 23:38:52.795278 run osmo-stp_10.42.42.5(pid=30763): stdout: | (launched: 2022-12-09_23:38:51.485444) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:38:52.920400 run osmo-stp_10.42.42.5(pid=30763): stderr: | 20221209233851655 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233851655 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233851655 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233851656 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233851656 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233851656 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233851656 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:38:53.045682 run osmo-stp_10.42.42.5(pid=30763): stdout: | (launched: 2022-12-09_23:38:51.485444) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:38:53.165410 run osmo-stp_10.42.42.5(pid=30763): stderr: | 20221209233851655 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233851655 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233851655 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233851656 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233851656 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233851656 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233851656 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:38:53.307699 run patchelf(pid=30766): Terminating (SIGINT) 23:38:53.472143 run patchelf(pid=30766): Terminated: ok {rc=0} 23:38:53.590403 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=30763): Process ended prematurely: osmo-stp_10.42.42.5(pid=30763) [trial-2366↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30763)] [trial-2366↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 23:38:53.599303 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 23:38:53.625581 run osmo-hlr_10.42.42.2(pid=30760): ERR: Terminated: ERROR {rc=237} [trial-2366↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30760)] 23:38:53.672510 run osmo-hlr_10.42.42.2(pid=30760): stdout: | (launched: 2022-12-09_23:38:50.565517) 23:38:53.721159 run osmo-hlr_10.42.42.2(pid=30760): stderr: | 20221209233850739 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209233850739 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209233850739 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209233850739 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209233850739 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209233850739 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209233850751 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209233850760 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209233850761 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209233850761 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:38:53.769931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30759): Terminating (SIGTERM) 23:38:53.809334 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30762): Terminating (SIGTERM) 23:38:53.848479 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30765): Terminating (SIGTERM) 23:38:53.887947 --- ParallelTerminationStrategy: PID 30759 died... 23:38:53.906936 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30759): Terminated: ok {rc=0} 23:38:53.950472 --- ParallelTerminationStrategy: PID 30762 died... 23:38:53.969070 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30762): Terminated: ok {rc=0} 23:38:54.012526 --- ParallelTerminationStrategy: PID 30765 died... 23:38:54.031115 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30765): Terminated: ok {rc=0} 23:38:54.115882 bus /gobi_0: Setting Powered False 23:38:55.215514 bus /gobi_0: Setting Powered False 23:38:56.330795 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2366 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 dynts:trx-b200+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 23:38:57.579104 tst dynts:trx-b200+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:38:57.584705 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 23:38:57.617753 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 23:38:57.651975 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 23:38:57.706553 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 23:38:57.739739 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 23:38:57.774164 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 23:38:58.327291 tst dynts:trx-b200+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2366 dynts:trx-b200+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 23:38:58.332218 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:38:58.343075 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 23:38:58.412300 tst switch_tch_pdch.py: using LAC 24464 23:38:58.529966 tst switch_tch_pdch.py: using RAC 239 23:38:58.644767 tst switch_tch_pdch.py: using CellId 24464 23:38:58.759911 tst switch_tch_pdch.py: using BVCI 24465 23:38:58.866126 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:38:58.876899 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:38:58.887570 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:38:58.898261 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:38:58.908896 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:38:58.919745 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:38:58.930528 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:38:58.941180 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 23:38:59.056539 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 23:38:59.172074 tst switch_tch_pdch.py:51: start network... 23:38:59.368279 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:38:59.797669 run create_hlr_db(pid=30772): Launched 23:38:59.917343 bus /gobi_6: Setting Powered False 23:39:00.992121 run create_hlr_db(pid=30772): Terminated: ok {rc=0} 23:39:01.425075 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30774): Launched 23:39:01.767545 run osmo-hlr_10.42.42.2(pid=30775): Launched 23:39:02.009217 run osmo-stp_10.42.42.5: Starting osmo-stp 23:39:02.547092 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30777): Launched 23:39:02.860897 run osmo-stp_10.42.42.5(pid=30778): Launched 23:39:02.980915 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:39:03.496076 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30780): Launched 23:39:03.616359 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:39:03.881350 run patchelf(pid=30781): Launched 23:39:04.055370 run osmo-stp_10.42.42.5(pid=30778): ERR: Terminated: ERROR {rc=1} [trial-2366↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30778)] 23:39:04.188375 run osmo-stp_10.42.42.5(pid=30778): stdout: | (launched: 2022-12-09_23:39:02.803716) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:39:04.323175 run osmo-stp_10.42.42.5(pid=30778): stderr: | 20221209233902996 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233902996 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233902997 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233902997 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233902998 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233902998 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233902998 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:39:04.458473 run osmo-stp_10.42.42.5(pid=30778): stdout: | (launched: 2022-12-09_23:39:02.803716) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:39:04.587453 run osmo-stp_10.42.42.5(pid=30778): stderr: | 20221209233902996 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233902996 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233902997 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233902997 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233902998 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233902998 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233902998 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:39:04.740531 run patchelf(pid=30781): Terminating (SIGINT) 23:39:04.916834 run patchelf(pid=30781): Terminated: ok {rc=0} 23:39:05.043627 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=30778): Process ended prematurely: osmo-stp_10.42.42.5(pid=30778) [trial-2366↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30778)] [trial-2366↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 23:39:05.053508 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 23:39:05.082011 run osmo-hlr_10.42.42.2(pid=30775): ERR: Terminated: ERROR {rc=237} [trial-2366↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30775)] 23:39:05.131832 run osmo-hlr_10.42.42.2(pid=30775): stdout: | (launched: 2022-12-09_23:39:01.704513) 23:39:05.183612 run osmo-hlr_10.42.42.2(pid=30775): stderr: | 20221209233902014 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209233902014 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209233902014 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209233902014 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209233902014 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209233902014 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209233902027 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/dynts:trx-b200+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209233902043 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209233902044 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209233902044 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:39:05.235910 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30774): Terminating (SIGTERM) 23:39:05.277723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30777): Terminating (SIGTERM) 23:39:05.319516 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30780): Terminating (SIGTERM) 23:39:05.361629 --- ParallelTerminationStrategy: PID 30774 died... 23:39:05.381486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30774): Terminated: ok {rc=0} 23:39:05.427886 --- ParallelTerminationStrategy: PID 30777 died... 23:39:05.447372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30777): Terminated: ok {rc=0} 23:39:05.493738 --- ParallelTerminationStrategy: PID 30780 died... 23:39:05.513216 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30780): Terminated: ok {rc=0} 23:39:05.601166 bus /gobi_0: Setting Powered False 23:39:06.699302 bus /gobi_0: Setting Powered False 23:39:07.814198 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2366 dynts:trx-b200+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 nitb_sms:trx-sysmocell5000 --------------------------------------------------------------------- 23:39:09.062845 tst nitb_sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:39:09.067040 tst nitb_sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 23:39:09.100329 tst nitb_sms:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 23:39:09.106919 tst nitb_sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 23:39:09.156302 tst nitb_sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 23:39:09.189123 tst nitb_sms:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 23:39:09.195691 tst nitb_sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 23:39:09.736307 tst nitb_sms:trx-sysmocell5000: RESERVED RESOURCES for nitb_sms: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 nitb_sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 23:39:09.741147 tst nitb_sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 23:39:09.752008 tst nitb_sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 23:39:09.799500 tst mo_mt_sms.py: using LAC 24465 23:39:09.913475 tst mo_mt_sms.py: using RAC 240 23:39:10.032040 tst mo_mt_sms.py: using CellId 24465 23:39:10.147496 tst mo_mt_sms.py: using BVCI 24466 23:39:10.252798 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 23:39:10.370656 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 23:39:10.489380 tst mo_mt_sms.py:9: start nitb and bts... 23:39:10.702611 run osmo-nitb_10.42.42.2: Starting osmo-nitb 23:39:11.340308 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30785): Launched 23:39:11.654139 run osmo-nitb_10.42.42.2(pid=30786): Launched 23:39:11.828371 run osmo-nitb_10.42.42.2(pid=30786): ERR: Terminated: ERROR {rc=2} [trial-2366↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30786)] 23:39:11.970039 run osmo-nitb_10.42.42.2(pid=30786): stdout: | (launched: 2022-12-09_23:39:11.596853) 23:39:12.112864 run osmo-nitb_10.42.42.2(pid=30786): stderr: | (launched: 2022-12-09_23:39:11.643805) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:39:12.255398 run osmo-nitb_10.42.42.2(pid=30786): stdout: | (launched: 2022-12-09_23:39:11.596853) 23:39:12.392593 run osmo-nitb_10.42.42.2(pid=30786): stderr: | (launched: 2022-12-09_23:39:11.643805) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=30786): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30786) [trial-2366↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30786)] 23:39:12.773776 tst osmo-nitb_10.42.42.2(pid=30786): stdout: | (launched: 2022-12-09_23:39:11.596853) 23:39:12.901498 tst osmo-nitb_10.42.42.2(pid=30786): stderr: | (launched: 2022-12-09_23:39:11.643805) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:39:13.051976 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=30786): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30786) [trial-2366↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30786)] [trial-2366↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11] 23:39:13.061229 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 23:39:13.068213 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30785): Terminating (SIGTERM) 23:39:13.280596 --- ParallelTerminationStrategy: PID 30785 died... 23:39:13.301718 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30785): Terminated: ok {rc=0} 23:39:13.389857 bus /sierra_3: Setting Powered False 23:39:14.487798 bus /sierra_3: Setting Powered False 23:39:15.605104 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 nitb_sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 sms:trx-sysmocell5000 --------------------------------------------------------------------- 23:39:16.838179 tst sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:39:16.845679 tst sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 23:39:16.892904 tst sms:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 23:39:16.930506 tst sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 23:39:16.985222 tst sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 23:39:17.021699 tst sms:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 23:39:17.051244 tst sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 23:39:17.592783 tst sms:trx-sysmocell5000: RESERVED RESOURCES for sms: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 23:39:17.597752 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:39:17.608350 tst sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 23:39:17.656141 tst mo_mt_sms.py: using LAC 24466 23:39:17.771462 tst mo_mt_sms.py: using RAC 241 23:39:17.887742 tst mo_mt_sms.py: using CellId 24466 23:39:18.012195 tst mo_mt_sms.py: using BVCI 24467 23:39:18.126710 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:39:18.137943 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:39:18.149084 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:39:18.160384 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:39:18.171682 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:39:18.182932 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 23:39:18.297094 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 23:39:18.411788 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:39:18.902394 run create_hlr_db(pid=30790): Launched 23:39:19.021642 bus /sierra_2: Setting Powered False 23:39:20.084447 run create_hlr_db(pid=30790): Terminated: ok {rc=0} 23:39:20.523691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30792): Launched 23:39:20.838607 run osmo-hlr_10.42.42.2(pid=30793): Launched 23:39:20.958530 run osmo-stp_10.42.42.5: Starting osmo-stp 23:39:21.502268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30795): Launched 23:39:21.815950 run osmo-stp_10.42.42.5(pid=30796): Launched 23:39:21.936671 run osmo-msc_10.42.42.6: Starting osmo-msc 23:39:22.506446 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30798): Launched 23:39:22.820881 run osmo-msc_10.42.42.6(pid=30799): Launched 23:39:22.997250 run osmo-stp_10.42.42.5(pid=30796): ERR: Terminated: ERROR {rc=1} [trial-2366↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30796)] 23:39:23.130397 run osmo-stp_10.42.42.5(pid=30796): stdout: | (launched: 2022-12-09_23:39:21.758806) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:39:23.263803 run osmo-stp_10.42.42.5(pid=30796): stderr: | 20221209233921948 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233921948 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233921948 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233921949 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233921949 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233921949 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233921949 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:39:23.397200 run osmo-stp_10.42.42.5(pid=30796): stdout: | (launched: 2022-12-09_23:39:21.758806) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:39:23.522403 run osmo-stp_10.42.42.5(pid=30796): stderr: | 20221209233921948 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233921948 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233921948 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233921949 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233921949 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233921949 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233921949 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:39:23.672899 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=30796): Process ended prematurely: osmo-stp_10.42.42.5(pid=30796) [trial-2366↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30796)] [trial-2366↪sms:trx-sysmocell5000↪mo_mt_sms.py:16] 23:39:23.681926 tst mo_mt_sms.py:16: Test FAILED (6.1 sec) 23:39:23.709541 run osmo-hlr_10.42.42.2(pid=30793): ERR: Terminated: ERROR {rc=237} [trial-2366↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30793)] 23:39:23.759508 run osmo-hlr_10.42.42.2(pid=30793): stdout: | (launched: 2022-12-09_23:39:20.781622) 23:39:23.810886 run osmo-hlr_10.42.42.2(pid=30793): stderr: | 20221209233920979 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209233920979 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209233920979 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209233920980 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209233920980 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209233920980 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209233920991 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/sms:trx-sysmocell5000/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209233921000 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209233921000 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209233921000 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:39:23.882865 run osmo-msc_10.42.42.6(pid=30799): ERR: Terminated: ERROR {rc=2} [trial-2366↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30799)] 23:39:23.932530 run osmo-msc_10.42.42.6(pid=30799): stdout: | (launched: 2022-12-09_23:39:22.763623) 23:39:23.983851 run osmo-msc_10.42.42.6(pid=30799): stderr: | 20221209233923081 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209233923082 DLGLOBAL DEBUG validating counter group 0x7f13961a9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209233923082 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209233923082 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209233923082 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209233923082 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209233923084 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209233923084 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209233923084 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209233923084 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:39:24.035801 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30792): Terminating (SIGTERM) 23:39:24.077030 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30795): Terminating (SIGTERM) 23:39:24.118309 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30798): Terminating (SIGTERM) 23:39:24.160074 --- ParallelTerminationStrategy: PID 30792 died... 23:39:24.179753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30792): Terminated: ok {rc=0} 23:39:24.226211 --- ParallelTerminationStrategy: PID 30795 died... 23:39:24.245623 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30795): Terminated: ok {rc=0} 23:39:24.291663 --- ParallelTerminationStrategy: PID 30798 died... 23:39:24.311063 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30798): Terminated: ok {rc=0} 23:39:24.397398 bus /sierra_3: Setting Powered False 23:39:25.495057 bus /sierra_3: Setting Powered False 23:39:26.610219 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 nitb_ussd:trx-sysmocell5000 --------------------------------------------------------------------- 23:39:27.837732 tst nitb_ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:39:27.841511 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 23:39:27.874605 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 23:39:27.881294 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 23:39:27.914809 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 23:39:27.947612 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 23:39:27.954158 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 23:39:28.476501 tst nitb_ussd:trx-sysmocell5000: RESERVED RESOURCES for nitb_ussd: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2366 nitb_ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 23:39:28.481669 tst nitb_ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 23:39:28.492505 tst nitb_ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 23:39:28.540342 tst assert_extension.py: using LAC 24467 23:39:28.655612 tst assert_extension.py: using RAC 242 23:39:28.768513 tst assert_extension.py: using CellId 24467 23:39:28.882072 tst assert_extension.py: using BVCI 24468 23:39:28.987066 tst nitb_ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 23:39:29.103706 tst assert_extension.py:10: start nitb and bts... 23:39:29.314963 run osmo-nitb_10.42.42.2: Starting osmo-nitb 23:39:29.955165 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30804): Launched 23:39:30.268418 run osmo-nitb_10.42.42.2(pid=30805): Launched 23:39:30.442679 run osmo-nitb_10.42.42.2(pid=30805): ERR: Terminated: ERROR {rc=2} [trial-2366↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30805)] 23:39:30.583451 run osmo-nitb_10.42.42.2(pid=30805): stdout: | (launched: 2022-12-09_23:39:30.211679) 23:39:30.726664 run osmo-nitb_10.42.42.2(pid=30805): stderr: | (launched: 2022-12-09_23:39:30.258261) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:39:30.880506 run osmo-nitb_10.42.42.2(pid=30805): stdout: | (launched: 2022-12-09_23:39:30.211679) 23:39:31.043106 run osmo-nitb_10.42.42.2(pid=30805): stderr: | (launched: 2022-12-09_23:39:30.258261) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=30805): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30805) [trial-2366↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30805)] 23:39:31.386679 tst osmo-nitb_10.42.42.2(pid=30805): stdout: | (launched: 2022-12-09_23:39:30.211679) 23:39:31.545158 tst osmo-nitb_10.42.42.2(pid=30805): stderr: | (launched: 2022-12-09_23:39:30.258261) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:39:31.735262 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=30805): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30805) [trial-2366↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30805)] [trial-2366↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12] 23:39:31.748147 tst assert_extension.py:12: Test FAILED (3.3 sec) 23:39:31.758026 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30804): Terminating (SIGTERM) 23:39:31.979513 --- ParallelTerminationStrategy: PID 30804 died... 23:39:31.999619 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30804): Terminated: ok {rc=0} 23:39:32.111300 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 nitb_ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 ussd:trx-sysmocell5000 --------------------------------------------------------------------- 23:39:33.303121 tst ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:39:33.306997 tst ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 23:39:33.340433 tst ussd:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 23:39:33.367179 tst ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 23:39:33.402987 tst ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 23:39:33.436500 tst ussd:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 23:39:33.463058 tst ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 23:39:33.994726 tst ussd:trx-sysmocell5000: RESERVED RESOURCES for ussd: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2366 ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 23:39:34.001993 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:39:34.012939 tst ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 23:39:34.060197 tst assert_extension.py: using LAC 24468 23:39:34.177171 tst assert_extension.py: using RAC 243 23:39:34.292000 tst assert_extension.py: using CellId 24468 23:39:34.408505 tst assert_extension.py: using BVCI 24469 23:39:34.514432 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:39:34.525140 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:39:34.535606 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:39:34.545971 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:39:34.556288 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:39:34.566776 tst ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 23:39:34.682199 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:39:35.168277 run create_hlr_db(pid=30809): Launched 23:39:35.287529 bus /sierra_2: Setting Powered False 23:39:36.349969 run create_hlr_db(pid=30809): Terminated: ok {rc=0} 23:39:36.787431 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30811): Launched 23:39:37.101116 run osmo-hlr_10.42.42.2(pid=30812): Launched 23:39:37.225893 run osmo-stp_10.42.42.5: Starting osmo-stp 23:39:37.855261 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30814): Launched 23:39:38.163052 run osmo-stp_10.42.42.5(pid=30815): Launched 23:39:38.281788 run osmo-msc_10.42.42.6: Starting osmo-msc 23:39:38.839809 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30817): Launched 23:39:39.148184 run osmo-msc_10.42.42.6(pid=30818): Launched 23:39:39.320143 run osmo-stp_10.42.42.5(pid=30815): ERR: Terminated: ERROR {rc=1} [trial-2366↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30815)] 23:39:39.451950 run osmo-stp_10.42.42.5(pid=30815): stdout: | (launched: 2022-12-09_23:39:38.107193) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:39:39.583411 run osmo-stp_10.42.42.5(pid=30815): stderr: | 20221209233938296 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233938296 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233938297 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233938297 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233938297 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233938298 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233938298 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:39:39.715324 run osmo-stp_10.42.42.5(pid=30815): stdout: | (launched: 2022-12-09_23:39:38.107193) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:39:39.839169 run osmo-stp_10.42.42.5(pid=30815): stderr: | 20221209233938296 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233938296 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233938297 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233938297 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233938297 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233938298 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233938298 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:39:39.987335 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=30815): Process ended prematurely: osmo-stp_10.42.42.5(pid=30815) [trial-2366↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30815)] [trial-2366↪ussd:trx-sysmocell5000↪assert_extension.py:17] 23:39:39.996302 tst assert_extension.py:17: Test FAILED (6.0 sec) 23:39:40.023822 run osmo-hlr_10.42.42.2(pid=30812): ERR: Terminated: ERROR {rc=237} [trial-2366↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30812)] 23:39:40.073908 run osmo-hlr_10.42.42.2(pid=30812): stdout: | (launched: 2022-12-09_23:39:37.043729) 23:39:40.125706 run osmo-hlr_10.42.42.2(pid=30812): stderr: | 20221209233937242 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209233937242 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209233937242 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209233937242 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209233937242 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209233937242 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209233937253 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/ussd:trx-sysmocell5000/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209233937261 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209233937261 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209233937261 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:39:40.197391 run osmo-msc_10.42.42.6(pid=30818): ERR: Terminated: ERROR {rc=2} [trial-2366↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30818)] 23:39:40.247271 run osmo-msc_10.42.42.6(pid=30818): stdout: | (launched: 2022-12-09_23:39:39.092008) 23:39:40.298955 run osmo-msc_10.42.42.6(pid=30818): stderr: | 20221209233939411 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209233939411 DLGLOBAL DEBUG validating counter group 0x7f508ee7fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209233939411 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209233939411 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209233939411 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209233939412 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209233939415 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209233939416 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209233939416 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209233939416 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:39:40.351297 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30811): Terminating (SIGTERM) 23:39:40.393068 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30814): Terminating (SIGTERM) 23:39:40.434916 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30817): Terminating (SIGTERM) 23:39:40.476828 --- ParallelTerminationStrategy: PID 30811 died... 23:39:40.496629 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30811): Terminated: ok {rc=0} 23:39:40.542819 --- ParallelTerminationStrategy: PID 30814 died... 23:39:40.562023 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30814): Terminated: ok {rc=0} 23:39:40.607738 --- ParallelTerminationStrategy: PID 30817 died... 23:39:40.626944 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30817): Terminated: ok {rc=0} 23:39:40.714701 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 23:39:41.925296 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:39:41.932277 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 23:39:41.966820 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 23:39:41.993679 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 23:39:42.045453 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 23:39:42.079437 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 23:39:42.106114 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 23:39:42.656898 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 23:39:42.705713 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:39:42.716823 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 23:39:42.786314 tst mo_mt_call.py: using LAC 24469 23:39:42.905058 tst mo_mt_call.py: using RAC 244 23:39:43.020390 tst mo_mt_call.py: using CellId 24469 23:39:43.135740 tst mo_mt_call.py: using BVCI 24470 23:39:43.251404 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:39:43.263525 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:39:43.275102 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:39:43.287737 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:39:43.299189 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:39:43.311523 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:39:43.431164 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:39:43.549408 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:39:44.037434 run create_hlr_db(pid=30823): Launched 23:39:44.158109 bus /sierra_2: Setting Powered False 23:39:45.219992 run create_hlr_db(pid=30823): Terminated: ok {rc=0} 23:39:45.640549 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30825): Launched 23:39:45.975032 run osmo-hlr_10.42.42.2(pid=30826): Launched 23:39:46.240893 run osmo-stp_10.42.42.5: Starting osmo-stp 23:39:47.019018 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30828): Launched 23:39:47.316297 run osmo-stp_10.42.42.5(pid=30829): Launched 23:39:47.429284 run osmo-msc_10.42.42.6: Starting osmo-msc 23:39:47.963095 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30831): Launched 23:39:48.256192 run osmo-msc_10.42.42.6(pid=30832): Launched 23:39:48.420463 run osmo-stp_10.42.42.5(pid=30829): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30829)] 23:39:48.544861 run osmo-stp_10.42.42.5(pid=30829): stdout: | (launched: 2022-12-09_23:39:47.262788) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:39:48.669954 run osmo-stp_10.42.42.5(pid=30829): stderr: | 20221209233947431 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233947431 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233947432 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233947432 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233947433 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233947433 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233947433 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:39:48.792713 run osmo-stp_10.42.42.5(pid=30829): stdout: | (launched: 2022-12-09_23:39:47.262788) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:39:48.910448 run osmo-stp_10.42.42.5(pid=30829): stderr: | 20221209233947431 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233947431 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233947432 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233947432 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233947433 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233947433 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233947433 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:39:49.050729 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30829): Process ended prematurely: osmo-stp_10.42.42.5(pid=30829) [trial-2366↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30829)] [trial-2366↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 23:39:49.059622 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 23:39:49.086223 run osmo-hlr_10.42.42.2(pid=30826): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30826)] 23:39:49.133510 run osmo-hlr_10.42.42.2(pid=30826): stdout: | (launched: 2022-12-09_23:39:45.893394) 23:39:49.183252 run osmo-hlr_10.42.42.2(pid=30826): stderr: | 20221209233946353 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209233946354 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209233946354 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209233946354 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209233946354 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209233946354 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209233946379 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209233946387 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209233946388 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209233946388 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:39:49.251801 run osmo-msc_10.42.42.6(pid=30832): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30832)] 23:39:49.299106 run osmo-msc_10.42.42.6(pid=30832): stdout: | (launched: 2022-12-09_23:39:48.202818) 23:39:49.347974 run osmo-msc_10.42.42.6(pid=30832): stderr: | 20221209233948475 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209233948475 DLGLOBAL DEBUG validating counter group 0x7fea49a3ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209233948475 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209233948475 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209233948476 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209233948476 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209233948478 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209233948478 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209233948478 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209233948478 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:39:49.397313 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30825): Terminating (SIGTERM) 23:39:49.436550 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30828): Terminating (SIGTERM) 23:39:49.475579 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30831): Terminating (SIGTERM) 23:39:49.515132 --- ParallelTerminationStrategy: PID 30825 died... 23:39:49.534059 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30825): Terminated: ok {rc=0} 23:39:49.577909 --- ParallelTerminationStrategy: PID 30828 died... 23:39:49.596427 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30828): Terminated: ok {rc=0} 23:39:49.640145 --- ParallelTerminationStrategy: PID 30831 died... 23:39:49.658567 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30831): Terminated: ok {rc=0} 23:39:49.744565 bus /sierra_3: Setting Powered False 23:39:50.844140 bus /sierra_3: Setting Powered False 23:39:51.957193 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 23:39:53.103853 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:39:53.116121 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 23:39:53.190583 tst mo_mt_call_osmux.py: using LAC 24470 23:39:53.314468 tst mo_mt_call_osmux.py: using RAC 245 23:39:53.436209 tst mo_mt_call_osmux.py: using CellId 24470 23:39:53.559527 tst mo_mt_call_osmux.py: using BVCI 24471 23:39:53.675814 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:39:53.687714 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:39:53.699199 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:39:53.710963 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:39:53.722661 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:39:53.734455 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:39:53.852386 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:39:53.971757 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:39:54.458474 run create_hlr_db(pid=30834): Launched 23:39:54.578323 bus /sierra_2: Setting Powered False 23:39:55.641086 run create_hlr_db(pid=30834): Terminated: ok {rc=0} 23:39:56.081032 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30836): Launched 23:39:56.394924 run osmo-hlr_10.42.42.2(pid=30837): Launched 23:39:56.516136 run osmo-stp_10.42.42.5: Starting osmo-stp 23:39:57.059979 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30839): Launched 23:39:57.375177 run osmo-stp_10.42.42.5(pid=30840): Launched 23:39:57.495733 run osmo-msc_10.42.42.6: Starting osmo-msc 23:39:58.065906 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30842): Launched 23:39:58.379413 run osmo-msc_10.42.42.6(pid=30843): Launched 23:39:58.555938 run osmo-stp_10.42.42.5(pid=30840): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30840)] 23:39:58.690349 run osmo-stp_10.42.42.5(pid=30840): stdout: | (launched: 2022-12-09_23:39:57.318416) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:39:58.824642 run osmo-stp_10.42.42.5(pid=30840): stderr: | 20221209233957509 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233957509 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233957509 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233957509 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233957510 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233957510 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233957510 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:39:58.958225 run osmo-stp_10.42.42.5(pid=30840): stdout: | (launched: 2022-12-09_23:39:57.318416) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:39:59.084247 run osmo-stp_10.42.42.5(pid=30840): stderr: | 20221209233957509 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209233957509 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209233957509 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209233957509 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209233957510 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209233957510 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209233957510 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:39:59.235327 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30840): Process ended prematurely: osmo-stp_10.42.42.5(pid=30840) [trial-2366↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30840)] [trial-2366↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 23:39:59.245156 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 23:39:59.272911 run osmo-hlr_10.42.42.2(pid=30837): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30837)] 23:39:59.323514 run osmo-hlr_10.42.42.2(pid=30837): stdout: | (launched: 2022-12-09_23:39:56.338211) 23:39:59.375238 run osmo-hlr_10.42.42.2(pid=30837): stderr: | 20221209233956534 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209233956534 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209233956535 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209233956535 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209233956535 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209233956535 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209233956547 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209233956555 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209233956555 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209233956555 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:39:59.447178 run osmo-msc_10.42.42.6(pid=30843): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30843)] 23:39:59.497188 run osmo-msc_10.42.42.6(pid=30843): stdout: | (launched: 2022-12-09_23:39:58.322698) 23:39:59.548431 run osmo-msc_10.42.42.6(pid=30843): stderr: | 20221209233958642 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209233958642 DLGLOBAL DEBUG validating counter group 0x7f923644cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209233958642 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209233958642 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209233958642 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209233958642 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209233958644 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209233958644 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209233958644 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209233958645 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:39:59.600059 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30836): Terminating (SIGTERM) 23:39:59.641526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30839): Terminating (SIGTERM) 23:39:59.683484 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30842): Terminating (SIGTERM) 23:39:59.726030 --- ParallelTerminationStrategy: PID 30836 died... 23:39:59.746443 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30836): Terminated: ok {rc=0} 23:39:59.792587 --- ParallelTerminationStrategy: PID 30839 died... 23:39:59.811897 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30839): Terminated: ok {rc=0} 23:39:59.858041 --- ParallelTerminationStrategy: PID 30842 died... 23:39:59.877365 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30842): Terminated: ok {rc=0} 23:39:59.965117 bus /sierra_3: Setting Powered False 23:40:01.063119 bus /sierra_3: Setting Powered False 23:40:02.181571 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 23:40:03.433158 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:40:03.440099 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 23:40:03.474832 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 23:40:03.502064 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 23:40:03.554749 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 23:40:03.588457 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 23:40:03.615094 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 23:40:04.167819 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 23:40:04.216067 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:40:04.227191 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 23:40:04.302423 tst mo_mt_call.py: using LAC 24471 23:40:04.425387 tst mo_mt_call.py: using RAC 246 23:40:04.546473 tst mo_mt_call.py: using CellId 24471 23:40:04.668481 tst mo_mt_call.py: using BVCI 24472 23:40:04.783722 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:40:04.795461 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:40:04.807060 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:40:04.818905 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:40:04.831405 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:40:04.842943 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:40:04.957406 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:40:05.075577 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:40:05.563339 run create_hlr_db(pid=30851): Launched 23:40:05.684087 bus /sierra_2: Setting Powered False 23:40:06.746591 run create_hlr_db(pid=30851): Terminated: ok {rc=0} 23:40:07.167897 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30853): Launched 23:40:07.462953 run osmo-hlr_10.42.42.2(pid=30854): Launched 23:40:07.577524 run osmo-stp_10.42.42.5: Starting osmo-stp 23:40:08.086643 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30856): Launched 23:40:08.379876 run osmo-stp_10.42.42.5(pid=30857): Launched 23:40:08.492213 run osmo-msc_10.42.42.6: Starting osmo-msc 23:40:09.030771 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30859): Launched 23:40:09.324942 run osmo-msc_10.42.42.6(pid=30860): Launched 23:40:09.490239 run osmo-stp_10.42.42.5(pid=30857): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30857)] 23:40:09.616753 run osmo-stp_10.42.42.5(pid=30857): stdout: | (launched: 2022-12-09_23:40:08.326443) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:40:09.741233 run osmo-stp_10.42.42.5(pid=30857): stderr: | 20221209234008497 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234008497 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234008497 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234008498 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234008498 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234008498 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234008498 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:40:09.863789 run osmo-stp_10.42.42.5(pid=30857): stdout: | (launched: 2022-12-09_23:40:08.326443) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:40:09.981114 run osmo-stp_10.42.42.5(pid=30857): stderr: | 20221209234008497 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234008497 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234008497 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234008498 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234008498 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234008498 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234008498 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:40:10.121567 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30857): Process ended prematurely: osmo-stp_10.42.42.5(pid=30857) [trial-2366↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30857)] [trial-2366↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 23:40:10.130308 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 23:40:10.156053 run osmo-hlr_10.42.42.2(pid=30854): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30854)] 23:40:10.202977 run osmo-hlr_10.42.42.2(pid=30854): stdout: | (launched: 2022-12-09_23:40:07.409539) 23:40:10.251688 run osmo-hlr_10.42.42.2(pid=30854): stderr: | 20221209234007582 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209234007582 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209234007582 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209234007582 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209234007582 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209234007583 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209234007595 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209234007603 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209234007604 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209234007604 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:40:10.319794 run osmo-msc_10.42.42.6(pid=30860): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30860)] 23:40:10.366647 run osmo-msc_10.42.42.6(pid=30860): stdout: | (launched: 2022-12-09_23:40:09.271143) 23:40:10.415302 run osmo-msc_10.42.42.6(pid=30860): stderr: | 20221209234009541 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209234009542 DLGLOBAL DEBUG validating counter group 0x7fc19e17cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209234009542 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209234009542 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209234009542 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209234009542 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209234009544 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209234009544 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209234009544 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209234009544 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:40:10.464489 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30853): Terminating (SIGTERM) 23:40:10.503350 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30856): Terminating (SIGTERM) 23:40:10.542238 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30859): Terminating (SIGTERM) 23:40:10.581421 --- ParallelTerminationStrategy: PID 30853 died... 23:40:10.600081 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30853): Terminated: ok {rc=0} 23:40:10.643194 --- ParallelTerminationStrategy: PID 30856 died... 23:40:10.661960 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30856): Terminated: ok {rc=0} 23:40:10.704883 --- ParallelTerminationStrategy: PID 30859 died... 23:40:10.723184 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30859): Terminated: ok {rc=0} 23:40:10.807812 bus /sierra_3: Setting Powered False 23:40:11.905388 bus /sierra_3: Setting Powered False 23:40:13.019557 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 23:40:14.163420 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:40:14.175233 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 23:40:14.245559 tst mo_mt_call_osmux.py: using LAC 24472 23:40:14.362965 tst mo_mt_call_osmux.py: using RAC 247 23:40:14.480662 tst mo_mt_call_osmux.py: using CellId 24472 23:40:14.606357 tst mo_mt_call_osmux.py: using BVCI 24473 23:40:14.722488 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:40:14.734468 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:40:14.746064 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:40:14.758210 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:40:14.770657 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:40:14.783009 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:40:14.903393 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:40:15.023823 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:40:15.512040 run create_hlr_db(pid=30862): Launched 23:40:15.631122 bus /sierra_2: Setting Powered False 23:40:16.689236 run create_hlr_db(pid=30862): Terminated: ok {rc=0} 23:40:17.125726 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30864): Launched 23:40:17.426804 run osmo-hlr_10.42.42.2(pid=30865): Launched 23:40:17.540590 run osmo-stp_10.42.42.5: Starting osmo-stp 23:40:18.062796 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30867): Launched 23:40:18.356580 run osmo-stp_10.42.42.5(pid=30868): Launched 23:40:18.468022 run osmo-msc_10.42.42.6: Starting osmo-msc 23:40:19.001232 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30870): Launched 23:40:19.295203 run osmo-msc_10.42.42.6(pid=30871): Launched 23:40:19.460835 run osmo-stp_10.42.42.5(pid=30868): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30868)] 23:40:19.585966 run osmo-stp_10.42.42.5(pid=30868): stdout: | (launched: 2022-12-09_23:40:18.303230) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:40:19.712652 run osmo-stp_10.42.42.5(pid=30868): stderr: | 20221209234018472 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234018472 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234018472 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234018473 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234018473 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234018473 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234018473 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:40:19.835793 run osmo-stp_10.42.42.5(pid=30868): stdout: | (launched: 2022-12-09_23:40:18.303230) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:40:19.953543 run osmo-stp_10.42.42.5(pid=30868): stderr: | 20221209234018472 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234018472 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234018472 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234018473 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234018473 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234018473 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234018473 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:40:20.094328 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30868): Process ended prematurely: osmo-stp_10.42.42.5(pid=30868) [trial-2366↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30868)] [trial-2366↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 23:40:20.103121 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 23:40:20.128850 run osmo-hlr_10.42.42.2(pid=30865): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30865)] 23:40:20.175615 run osmo-hlr_10.42.42.2(pid=30865): stdout: | (launched: 2022-12-09_23:40:17.372520) 23:40:20.224129 run osmo-hlr_10.42.42.2(pid=30865): stderr: | 20221209234017547 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209234017547 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209234017547 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209234017547 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209234017548 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209234017548 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209234017563 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209234017573 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209234017573 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209234017573 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:40:20.291640 run osmo-msc_10.42.42.6(pid=30871): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30871)] 23:40:20.338321 run osmo-msc_10.42.42.6(pid=30871): stdout: | (launched: 2022-12-09_23:40:19.241693) 23:40:20.386386 run osmo-msc_10.42.42.6(pid=30871): stderr: | 20221209234019515 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209234019515 DLGLOBAL DEBUG validating counter group 0x7f32aba42c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209234019515 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209234019515 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209234019515 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209234019516 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209234019517 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209234019518 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209234019518 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209234019518 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:40:20.434952 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30864): Terminating (SIGTERM) 23:40:20.473922 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30867): Terminating (SIGTERM) 23:40:20.513093 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30870): Terminating (SIGTERM) 23:40:20.552217 --- ParallelTerminationStrategy: PID 30864 died... 23:40:20.571012 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30864): Terminated: ok {rc=0} 23:40:20.614249 --- ParallelTerminationStrategy: PID 30867 died... 23:40:20.632305 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30867): Terminated: ok {rc=0} 23:40:20.675195 --- ParallelTerminationStrategy: PID 30870 died... 23:40:20.693364 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30870): Terminated: ok {rc=0} 23:40:20.777172 bus /sierra_3: Setting Powered False 23:40:21.876042 bus /sierra_3: Setting Powered False 23:40:22.989576 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 23:40:24.239280 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:40:24.245977 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 23:40:24.279579 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 23:40:24.305838 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 23:40:24.356711 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 23:40:24.389859 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 23:40:24.416330 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 23:40:24.969853 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 23:40:25.016822 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:40:25.028277 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 23:40:25.098573 tst mo_mt_call.py: using LAC 24473 23:40:25.216304 tst mo_mt_call.py: using RAC 248 23:40:25.333797 tst mo_mt_call.py: using CellId 24473 23:40:25.449576 tst mo_mt_call.py: using BVCI 24474 23:40:25.567664 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:40:25.579531 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:40:25.591152 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:40:25.603991 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:40:25.615633 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:40:25.627663 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:40:25.745083 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:40:25.865330 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:40:26.355809 run create_hlr_db(pid=30876): Launched 23:40:26.476016 bus /sierra_2: Setting Powered False 23:40:27.538150 run create_hlr_db(pid=30876): Terminated: ok {rc=0} 23:40:27.961535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30878): Launched 23:40:28.257416 run osmo-hlr_10.42.42.2(pid=30879): Launched 23:40:28.372126 run osmo-stp_10.42.42.5: Starting osmo-stp 23:40:28.881959 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30881): Launched 23:40:29.176204 run osmo-stp_10.42.42.5(pid=30882): Launched 23:40:29.288298 run osmo-msc_10.42.42.6: Starting osmo-msc 23:40:29.824285 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30884): Launched 23:40:30.119674 run osmo-msc_10.42.42.6(pid=30885): Launched 23:40:30.283704 run osmo-stp_10.42.42.5(pid=30882): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30882)] 23:40:30.409405 run osmo-stp_10.42.42.5(pid=30882): stdout: | (launched: 2022-12-09_23:40:29.122646) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:40:30.535517 run osmo-stp_10.42.42.5(pid=30882): stderr: | 20221209234029291 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234029291 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234029291 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234029291 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234029292 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234029292 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234029292 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:40:30.658643 run osmo-stp_10.42.42.5(pid=30882): stdout: | (launched: 2022-12-09_23:40:29.122646) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:40:30.776637 run osmo-stp_10.42.42.5(pid=30882): stderr: | 20221209234029291 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234029291 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234029291 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234029291 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234029292 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234029292 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234029292 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:40:30.925480 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30882): Process ended prematurely: osmo-stp_10.42.42.5(pid=30882) [trial-2366↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30882)] [trial-2366↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 23:40:30.936036 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 23:40:30.963371 run osmo-hlr_10.42.42.2(pid=30879): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30879)] 23:40:31.011367 run osmo-hlr_10.42.42.2(pid=30879): stdout: | (launched: 2022-12-09_23:40:28.203583) 23:40:31.061733 run osmo-hlr_10.42.42.2(pid=30879): stderr: | 20221209234028378 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209234028378 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209234028378 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209234028378 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209234028378 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209234028378 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209234028389 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209234028398 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209234028398 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209234028398 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:40:31.131707 run osmo-msc_10.42.42.6(pid=30885): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30885)] 23:40:31.179620 run osmo-msc_10.42.42.6(pid=30885): stdout: | (launched: 2022-12-09_23:40:30.065549) 23:40:31.229794 run osmo-msc_10.42.42.6(pid=30885): stderr: | 20221209234030337 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209234030337 DLGLOBAL DEBUG validating counter group 0x7f38d8715c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209234030337 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209234030337 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209234030337 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209234030338 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209234030339 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209234030340 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209234030340 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209234030340 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:40:31.279860 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30878): Terminating (SIGTERM) 23:40:31.320880 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30881): Terminating (SIGTERM) 23:40:31.363329 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30884): Terminating (SIGTERM) 23:40:31.405687 --- ParallelTerminationStrategy: PID 30878 died... 23:40:31.425076 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30878): Terminated: ok {rc=0} 23:40:31.470106 --- ParallelTerminationStrategy: PID 30881 died... 23:40:31.489070 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30881): Terminated: ok {rc=0} 23:40:31.534489 --- ParallelTerminationStrategy: PID 30884 died... 23:40:31.553894 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30884): Terminated: ok {rc=0} 23:40:31.643689 bus /sierra_3: Setting Powered False 23:40:32.748617 bus /sierra_3: Setting Powered False 23:40:33.861886 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 23:40:35.006421 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:40:35.018145 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 23:40:35.087673 tst mo_mt_call_osmux.py: using LAC 24474 23:40:35.205958 tst mo_mt_call_osmux.py: using RAC 249 23:40:35.321086 tst mo_mt_call_osmux.py: using CellId 24474 23:40:35.436929 tst mo_mt_call_osmux.py: using BVCI 24475 23:40:35.544412 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:40:35.555722 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:40:35.566696 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:40:35.577751 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:40:35.588704 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:40:35.599641 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:40:35.717586 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:40:35.838480 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:40:36.329157 run create_hlr_db(pid=30887): Launched 23:40:36.450188 bus /sierra_2: Setting Powered False 23:40:37.513552 run create_hlr_db(pid=30887): Terminated: ok {rc=0} 23:40:37.938685 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30889): Launched 23:40:38.234565 run osmo-hlr_10.42.42.2(pid=30890): Launched 23:40:38.347338 run osmo-stp_10.42.42.5: Starting osmo-stp 23:40:38.855530 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30892): Launched 23:40:39.149622 run osmo-stp_10.42.42.5(pid=30893): Launched 23:40:39.262326 run osmo-msc_10.42.42.6: Starting osmo-msc 23:40:39.800422 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30895): Launched 23:40:40.095856 run osmo-msc_10.42.42.6(pid=30896): Launched 23:40:40.262539 run osmo-stp_10.42.42.5(pid=30893): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30893)] 23:40:40.388461 run osmo-stp_10.42.42.5(pid=30893): stdout: | (launched: 2022-12-09_23:40:39.095745) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:40:40.513785 run osmo-stp_10.42.42.5(pid=30893): stderr: | 20221209234039264 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234039264 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234039264 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234039265 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234039265 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234039265 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234039265 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:40:40.637140 run osmo-stp_10.42.42.5(pid=30893): stdout: | (launched: 2022-12-09_23:40:39.095745) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:40:40.755201 run osmo-stp_10.42.42.5(pid=30893): stderr: | 20221209234039264 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234039264 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234039264 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234039265 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234039265 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234039265 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234039265 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:40:40.896824 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30893): Process ended prematurely: osmo-stp_10.42.42.5(pid=30893) [trial-2366↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30893)] [trial-2366↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 23:40:40.905925 tst mo_mt_call_osmux.py:8: Test FAILED (5.9 sec) 23:40:40.932046 run osmo-hlr_10.42.42.2(pid=30890): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30890)] 23:40:40.979272 run osmo-hlr_10.42.42.2(pid=30890): stdout: | (launched: 2022-12-09_23:40:38.180293) 23:40:41.028893 run osmo-hlr_10.42.42.2(pid=30890): stderr: | 20221209234038357 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209234038357 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209234038357 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209234038357 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209234038357 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209234038357 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209234038370 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209234038378 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209234038379 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209234038379 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:40:41.097471 run osmo-msc_10.42.42.6(pid=30896): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30896)] 23:40:41.144562 run osmo-msc_10.42.42.6(pid=30896): stdout: | (launched: 2022-12-09_23:40:40.042117) 23:40:41.193324 run osmo-msc_10.42.42.6(pid=30896): stderr: | 20221209234040315 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209234040315 DLGLOBAL DEBUG validating counter group 0x7f0e1276dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209234040315 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209234040315 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209234040315 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209234040316 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209234040317 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209234040318 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209234040318 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209234040318 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:40:41.242510 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30889): Terminating (SIGTERM) 23:40:41.281407 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30892): Terminating (SIGTERM) 23:40:41.320438 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30895): Terminating (SIGTERM) 23:40:41.359583 --- ParallelTerminationStrategy: PID 30889 died... 23:40:41.378304 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30889): Terminated: ok {rc=0} 23:40:41.421794 --- ParallelTerminationStrategy: PID 30892 died... 23:40:41.440066 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30892): Terminated: ok {rc=0} 23:40:41.483304 --- ParallelTerminationStrategy: PID 30895 died... 23:40:41.501682 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30895): Terminated: ok {rc=0} 23:40:41.586004 bus /sierra_3: Setting Powered False 23:40:42.686895 bus /sierra_3: Setting Powered False 23:40:43.801897 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 23:40:45.053898 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:40:45.061089 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 23:40:45.096267 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 23:40:45.123481 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 23:40:45.177150 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 23:40:45.212551 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 23:40:45.239826 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 23:40:45.799596 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 23:40:45.862675 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:40:45.880818 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 23:40:45.960172 tst mo_mt_call.py: using LAC 24475 23:40:46.083317 tst mo_mt_call.py: using RAC 250 23:40:46.206122 tst mo_mt_call.py: using CellId 24475 23:40:46.367454 tst mo_mt_call.py: using BVCI 24476 23:40:46.491246 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:40:46.504012 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:40:46.517785 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:40:46.531498 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:40:46.545283 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:40:46.559395 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:40:46.685351 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:40:46.810566 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:40:47.289653 run create_hlr_db(pid=30901): Launched 23:40:47.413930 bus /sierra_2: Setting Powered False 23:40:48.476402 run create_hlr_db(pid=30901): Terminated: ok {rc=0} 23:40:48.916780 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30903): Launched 23:40:49.231924 run osmo-hlr_10.42.42.2(pid=30904): Launched 23:40:49.352558 run osmo-stp_10.42.42.5: Starting osmo-stp 23:40:49.895388 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30906): Launched 23:40:50.211324 run osmo-stp_10.42.42.5(pid=30907): Launched 23:40:50.332349 run osmo-msc_10.42.42.6: Starting osmo-msc 23:40:50.905658 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30909): Launched 23:40:51.222403 run osmo-msc_10.42.42.6(pid=30910): Launched 23:40:51.398902 run osmo-stp_10.42.42.5(pid=30907): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30907)] 23:40:51.532452 run osmo-stp_10.42.42.5(pid=30907): stdout: | (launched: 2022-12-09_23:40:50.154290) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:40:51.667332 run osmo-stp_10.42.42.5(pid=30907): stderr: | 20221209234050342 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234050342 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234050343 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234050343 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234050346 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234050346 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234050346 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:40:51.801611 run osmo-stp_10.42.42.5(pid=30907): stdout: | (launched: 2022-12-09_23:40:50.154290) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:40:51.928324 run osmo-stp_10.42.42.5(pid=30907): stderr: | 20221209234050342 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234050342 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234050343 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234050343 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234050346 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234050346 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234050346 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:40:52.079571 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30907): Process ended prematurely: osmo-stp_10.42.42.5(pid=30907) [trial-2366↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30907)] [trial-2366↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 23:40:52.089086 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 23:40:52.116933 run osmo-hlr_10.42.42.2(pid=30904): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30904)] 23:40:52.166439 run osmo-hlr_10.42.42.2(pid=30904): stdout: | (launched: 2022-12-09_23:40:49.174904) 23:40:52.217993 run osmo-hlr_10.42.42.2(pid=30904): stderr: | 20221209234049371 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209234049371 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209234049371 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209234049371 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209234049371 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209234049371 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209234049383 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209234049392 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209234049392 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209234049392 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:40:52.289595 run osmo-msc_10.42.42.6(pid=30910): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30910)] 23:40:52.339355 run osmo-msc_10.42.42.6(pid=30910): stdout: | (launched: 2022-12-09_23:40:51.165334) 23:40:52.390874 run osmo-msc_10.42.42.6(pid=30910): stderr: | 20221209234051486 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209234051486 DLGLOBAL DEBUG validating counter group 0x7f63a8b48c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209234051486 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209234051486 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209234051486 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209234051486 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209234051488 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209234051488 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209234051489 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209234051489 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:40:52.442647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30903): Terminating (SIGTERM) 23:40:52.484005 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30906): Terminating (SIGTERM) 23:40:52.525528 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30909): Terminating (SIGTERM) 23:40:52.567383 --- ParallelTerminationStrategy: PID 30903 died... 23:40:52.587080 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30903): Terminated: ok {rc=0} 23:40:52.633119 --- ParallelTerminationStrategy: PID 30906 died... 23:40:52.652265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30906): Terminated: ok {rc=0} 23:40:52.697933 --- ParallelTerminationStrategy: PID 30909 died... 23:40:52.717392 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30909): Terminated: ok {rc=0} 23:40:52.804327 bus /sierra_3: Setting Powered False 23:40:53.903030 bus /sierra_3: Setting Powered False 23:40:55.017766 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 23:40:56.165463 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:40:56.177937 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 23:40:56.249308 tst mo_mt_call_osmux.py: using LAC 24476 23:40:56.374307 tst mo_mt_call_osmux.py: using RAC 251 23:40:56.500432 tst mo_mt_call_osmux.py: using CellId 24476 23:40:56.626082 tst mo_mt_call_osmux.py: using BVCI 24477 23:40:56.743319 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:40:56.755010 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:40:56.766636 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:40:56.778287 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:40:56.789962 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:40:56.801585 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:40:56.918051 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:40:57.032419 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:40:57.490679 run create_hlr_db(pid=30912): Launched 23:40:57.612815 bus /sierra_2: Setting Powered False 23:40:58.672330 run create_hlr_db(pid=30912): Terminated: ok {rc=0} 23:40:59.105230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30914): Launched 23:40:59.421543 run osmo-hlr_10.42.42.2(pid=30915): Launched 23:40:59.542902 run osmo-stp_10.42.42.5: Starting osmo-stp 23:41:00.094300 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30917): Launched 23:41:00.411169 run osmo-stp_10.42.42.5(pid=30918): Launched 23:41:00.532010 run osmo-msc_10.42.42.6: Starting osmo-msc 23:41:01.149792 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30920): Launched 23:41:01.478304 run osmo-msc_10.42.42.6(pid=30921): Launched 23:41:01.833710 run osmo-stp_10.42.42.5(pid=30918): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30918)] 23:41:01.977667 run osmo-stp_10.42.42.5(pid=30918): stdout: | (launched: 2022-12-09_23:41:00.354201) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:41:02.144497 run osmo-stp_10.42.42.5(pid=30918): stderr: | 20221209234100547 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234100547 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234100547 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234100547 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234100548 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234100548 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234100548 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:41:02.362184 run osmo-stp_10.42.42.5(pid=30918): stdout: | (launched: 2022-12-09_23:41:00.354201) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:41:02.481143 run osmo-stp_10.42.42.5(pid=30918): stderr: | 20221209234100547 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234100547 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234100547 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234100547 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234100548 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234100548 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234100548 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:41:02.622816 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30918): Process ended prematurely: osmo-stp_10.42.42.5(pid=30918) [trial-2366↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30918)] [trial-2366↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 23:41:02.631745 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 23:41:02.657989 run osmo-hlr_10.42.42.2(pid=30915): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30915)] 23:41:02.705457 run osmo-hlr_10.42.42.2(pid=30915): stdout: | (launched: 2022-12-09_23:40:59.364222) 23:41:02.755124 run osmo-hlr_10.42.42.2(pid=30915): stderr: | 20221209234059563 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209234059563 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209234059563 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209234059563 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209234059563 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209234059563 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209234059576 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209234059584 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209234059585 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209234059585 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:41:02.823804 run osmo-msc_10.42.42.6(pid=30921): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30921)] 23:41:02.871553 run osmo-msc_10.42.42.6(pid=30921): stdout: | (launched: 2022-12-09_23:41:01.416016) 23:41:02.920571 run osmo-msc_10.42.42.6(pid=30921): stderr: | 20221209234101955 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209234101955 DLGLOBAL DEBUG validating counter group 0x7f00a7012c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209234101955 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209234101955 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209234101955 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209234101955 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209234101962 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209234101962 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209234101962 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209234101962 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:41:02.970003 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30914): Terminating (SIGTERM) 23:41:03.009452 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30917): Terminating (SIGTERM) 23:41:03.048867 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30920): Terminating (SIGTERM) 23:41:03.088352 --- ParallelTerminationStrategy: PID 30914 died... 23:41:03.107335 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30914): Terminated: ok {rc=0} 23:41:03.151191 --- ParallelTerminationStrategy: PID 30917 died... 23:41:03.169789 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30917): Terminated: ok {rc=0} 23:41:03.213244 --- ParallelTerminationStrategy: PID 30920 died... 23:41:03.231703 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30920): Terminated: ok {rc=0} 23:41:03.316722 bus /sierra_3: Setting Powered False 23:41:04.415485 bus /sierra_3: Setting Powered False 23:41:05.530059 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 23:41:06.783696 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:41:06.791975 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 23:41:06.826568 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 23:41:06.853603 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 23:41:06.907399 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 23:41:06.942482 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 23:41:06.969599 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 23:41:07.523711 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 23:41:07.576081 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:41:07.587763 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 23:41:07.659711 tst mo_mt_call.py: using LAC 24477 23:41:07.785885 tst mo_mt_call.py: using RAC 252 23:41:07.911823 tst mo_mt_call.py: using CellId 24477 23:41:08.037056 tst mo_mt_call.py: using BVCI 24478 23:41:08.153754 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:41:08.165360 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:41:08.176715 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:41:08.188526 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:41:08.200304 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:41:08.211945 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:41:08.327673 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:41:08.447156 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:41:08.909247 run create_hlr_db(pid=30926): Launched 23:41:09.029948 bus /sierra_2: Setting Powered False 23:41:10.089536 run create_hlr_db(pid=30926): Terminated: ok {rc=0} 23:41:10.503555 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30928): Launched 23:41:10.798699 run osmo-hlr_10.42.42.2(pid=30929): Launched 23:41:10.910627 run osmo-stp_10.42.42.5: Starting osmo-stp 23:41:11.416216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30931): Launched 23:41:11.712086 run osmo-stp_10.42.42.5(pid=30932): Launched 23:41:11.824737 run osmo-msc_10.42.42.6: Starting osmo-msc 23:41:12.361074 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30934): Launched 23:41:12.656820 run osmo-msc_10.42.42.6(pid=30935): Launched 23:41:12.823280 run osmo-stp_10.42.42.5(pid=30932): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30932)] 23:41:12.949731 run osmo-stp_10.42.42.5(pid=30932): stdout: | (launched: 2022-12-09_23:41:11.657315) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:41:13.075015 run osmo-stp_10.42.42.5(pid=30932): stderr: | 20221209234111825 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234111826 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234111826 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234111826 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234111828 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234111829 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234111829 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:41:13.199059 run osmo-stp_10.42.42.5(pid=30932): stdout: | (launched: 2022-12-09_23:41:11.657315) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:41:13.317239 run osmo-stp_10.42.42.5(pid=30932): stderr: | 20221209234111825 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234111826 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234111826 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234111826 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234111828 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234111829 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234111829 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:41:13.458781 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30932): Process ended prematurely: osmo-stp_10.42.42.5(pid=30932) [trial-2366↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30932)] [trial-2366↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 23:41:13.467405 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 23:41:13.493306 run osmo-hlr_10.42.42.2(pid=30929): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30929)] 23:41:13.540203 run osmo-hlr_10.42.42.2(pid=30929): stdout: | (launched: 2022-12-09_23:41:10.744904) 23:41:13.588727 run osmo-hlr_10.42.42.2(pid=30929): stderr: | 20221209234110921 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209234110921 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209234110921 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209234110921 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209234110921 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209234110921 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209234110937 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209234110945 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209234110946 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209234110946 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:41:13.656798 run osmo-msc_10.42.42.6(pid=30935): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30935)] 23:41:13.703466 run osmo-msc_10.42.42.6(pid=30935): stdout: | (launched: 2022-12-09_23:41:12.602658) 23:41:13.751953 run osmo-msc_10.42.42.6(pid=30935): stderr: | 20221209234112873 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209234112873 DLGLOBAL DEBUG validating counter group 0x7f377c581c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209234112873 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209234112873 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209234112873 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209234112873 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209234112875 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209234112876 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209234112876 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209234112876 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:41:13.800793 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30928): Terminating (SIGTERM) 23:41:13.840264 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30931): Terminating (SIGTERM) 23:41:13.879506 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30934): Terminating (SIGTERM) 23:41:13.918779 --- ParallelTerminationStrategy: PID 30928 died... 23:41:13.937582 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30928): Terminated: ok {rc=0} 23:41:13.980815 --- ParallelTerminationStrategy: PID 30931 died... 23:41:13.999057 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30931): Terminated: ok {rc=0} 23:41:14.042803 --- ParallelTerminationStrategy: PID 30934 died... 23:41:14.061156 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30934): Terminated: ok {rc=0} 23:41:14.143611 bus /sierra_3: Setting Powered False 23:41:15.240324 bus /sierra_3: Setting Powered False 23:41:16.357714 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 23:41:17.508813 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:41:17.521291 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 23:41:17.593824 tst mo_mt_call_osmux.py: using LAC 24478 23:41:17.720867 tst mo_mt_call_osmux.py: using RAC 253 23:41:17.847388 tst mo_mt_call_osmux.py: using CellId 24478 23:41:17.971691 tst mo_mt_call_osmux.py: using BVCI 24479 23:41:18.087007 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:41:18.098927 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:41:18.110535 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:41:18.122302 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:41:18.134105 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:41:18.145862 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:41:18.261440 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:41:18.377968 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:41:18.836093 run create_hlr_db(pid=30937): Launched 23:41:18.957843 bus /sierra_2: Setting Powered False 23:41:20.018695 run create_hlr_db(pid=30937): Terminated: ok {rc=0} 23:41:20.452784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30939): Launched 23:41:20.771053 run osmo-hlr_10.42.42.2(pid=30940): Launched 23:41:20.891767 run osmo-stp_10.42.42.5: Starting osmo-stp 23:41:21.441096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30942): Launched 23:41:21.758659 run osmo-stp_10.42.42.5(pid=30943): Launched 23:41:21.879497 run osmo-msc_10.42.42.6: Starting osmo-msc 23:41:22.454180 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30945): Launched 23:41:22.772384 run osmo-msc_10.42.42.6(pid=30946): Launched 23:41:22.949751 run osmo-stp_10.42.42.5(pid=30943): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30943)] 23:41:23.084881 run osmo-stp_10.42.42.5(pid=30943): stdout: | (launched: 2022-12-09_23:41:21.700738) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:41:23.220552 run osmo-stp_10.42.42.5(pid=30943): stderr: | 20221209234121890 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234121890 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234121891 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234121891 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234121891 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234121891 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234121892 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:41:23.355244 run osmo-stp_10.42.42.5(pid=30943): stdout: | (launched: 2022-12-09_23:41:21.700738) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:41:23.482406 run osmo-stp_10.42.42.5(pid=30943): stderr: | 20221209234121890 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234121890 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234121891 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234121891 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234121891 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234121891 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234121892 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:41:23.634672 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30943): Process ended prematurely: osmo-stp_10.42.42.5(pid=30943) [trial-2366↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30943)] [trial-2366↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 23:41:23.644193 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 23:41:23.672194 run osmo-hlr_10.42.42.2(pid=30940): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30940)] 23:41:23.722160 run osmo-hlr_10.42.42.2(pid=30940): stdout: | (launched: 2022-12-09_23:41:20.713260) 23:41:23.775114 run osmo-hlr_10.42.42.2(pid=30940): stderr: | 20221209234120911 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209234120911 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209234120911 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209234120911 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209234120911 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209234120911 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209234120924 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209234120934 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209234120934 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209234120934 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:41:23.847157 run osmo-msc_10.42.42.6(pid=30946): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30946)] 23:41:23.897123 run osmo-msc_10.42.42.6(pid=30946): stdout: | (launched: 2022-12-09_23:41:22.714350) 23:41:23.948840 run osmo-msc_10.42.42.6(pid=30946): stderr: | 20221209234123032 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209234123032 DLGLOBAL DEBUG validating counter group 0x7f5ac0ea5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209234123032 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209234123033 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209234123033 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209234123033 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209234123036 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209234123037 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209234123037 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209234123037 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:41:24.001048 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30939): Terminating (SIGTERM) 23:41:24.042537 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30942): Terminating (SIGTERM) 23:41:24.084018 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30945): Terminating (SIGTERM) 23:41:24.125635 --- ParallelTerminationStrategy: PID 30939 died... 23:41:24.145466 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30939): Terminated: ok {rc=0} 23:41:24.191467 --- ParallelTerminationStrategy: PID 30942 died... 23:41:24.210582 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30942): Terminated: ok {rc=0} 23:41:24.256516 --- ParallelTerminationStrategy: PID 30945 died... 23:41:24.275777 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30945): Terminated: ok {rc=0} 23:41:24.362932 bus /sierra_3: Setting Powered False 23:41:25.461590 bus /sierra_3: Setting Powered False 23:41:26.579487 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 23:41:27.838377 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:41:27.845320 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 23:41:27.880074 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 23:41:27.907341 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 23:41:27.958977 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 23:41:27.993614 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 23:41:28.021141 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 23:41:28.572003 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 23:41:28.619777 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:41:28.631196 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 23:41:28.705677 tst mo_mt_call.py: using LAC 24479 23:41:28.821876 tst mo_mt_call.py: using RAC 254 23:41:28.940097 tst mo_mt_call.py: using CellId 24479 23:41:29.055692 tst mo_mt_call.py: using BVCI 24480 23:41:29.163377 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:41:29.174607 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:41:29.185534 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:41:29.196487 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:41:29.207507 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:41:29.218556 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:41:29.334842 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:41:29.454413 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:41:29.944552 run create_hlr_db(pid=30952): Launched 23:41:30.066610 bus /sierra_2: Setting Powered False 23:41:31.141699 run create_hlr_db(pid=30952): Terminated: ok {rc=0} 23:41:31.618290 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30954): Launched 23:41:31.965679 run osmo-hlr_10.42.42.2(pid=30955): Launched 23:41:32.282638 run osmo-stp_10.42.42.5: Starting osmo-stp 23:41:32.806771 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30957): Launched 23:41:33.102056 run osmo-stp_10.42.42.5(pid=30958): Launched 23:41:33.214419 run osmo-msc_10.42.42.6: Starting osmo-msc 23:41:33.749691 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30960): Launched 23:41:34.046365 run osmo-msc_10.42.42.6(pid=30961): Launched 23:41:34.211317 run osmo-stp_10.42.42.5(pid=30958): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30958)] 23:41:34.336455 run osmo-stp_10.42.42.5(pid=30958): stdout: | (launched: 2022-12-09_23:41:33.048181) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:41:34.462540 run osmo-stp_10.42.42.5(pid=30958): stderr: | 20221209234133218 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234133218 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234133219 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234133219 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234133219 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234133219 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234133220 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:41:34.585676 run osmo-stp_10.42.42.5(pid=30958): stdout: | (launched: 2022-12-09_23:41:33.048181) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:41:34.703866 run osmo-stp_10.42.42.5(pid=30958): stderr: | 20221209234133218 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234133218 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234133219 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234133219 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234133219 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234133219 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234133220 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:41:34.845198 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30958): Process ended prematurely: osmo-stp_10.42.42.5(pid=30958) [trial-2366↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30958)] [trial-2366↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 23:41:34.854232 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 23:41:34.880153 run osmo-hlr_10.42.42.2(pid=30955): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30955)] 23:41:34.927710 run osmo-hlr_10.42.42.2(pid=30955): stdout: | (launched: 2022-12-09_23:41:31.894806) 23:41:34.976323 run osmo-hlr_10.42.42.2(pid=30955): stderr: | 20221209234132115 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209234132115 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209234132115 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209234132115 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209234132115 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209234132115 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209234132128 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209234132140 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209234132145 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209234132145 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:41:35.044199 run osmo-msc_10.42.42.6(pid=30961): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30961)] 23:41:35.091212 run osmo-msc_10.42.42.6(pid=30961): stdout: | (launched: 2022-12-09_23:41:33.991699) 23:41:35.140003 run osmo-msc_10.42.42.6(pid=30961): stderr: | 20221209234134263 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209234134263 DLGLOBAL DEBUG validating counter group 0x7fe2ea73fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209234134263 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209234134263 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209234134263 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209234134264 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209234134265 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209234134266 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209234134266 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209234134266 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:41:35.189193 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30954): Terminating (SIGTERM) 23:41:35.227995 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30957): Terminating (SIGTERM) 23:41:35.267118 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30960): Terminating (SIGTERM) 23:41:35.306360 --- ParallelTerminationStrategy: PID 30954 died... 23:41:35.325296 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30954): Terminated: ok {rc=0} 23:41:35.368808 --- ParallelTerminationStrategy: PID 30957 died... 23:41:35.387641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30957): Terminated: ok {rc=0} 23:41:35.431027 --- ParallelTerminationStrategy: PID 30960 died... 23:41:35.449487 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30960): Terminated: ok {rc=0} 23:41:35.533961 bus /sierra_3: Setting Powered False 23:41:36.632864 bus /sierra_3: Setting Powered False 23:41:37.744744 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 23:41:38.891686 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:41:38.904048 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 23:41:38.976554 tst mo_mt_call_osmux.py: using LAC 24480 23:41:39.101392 tst mo_mt_call_osmux.py: using RAC 255 23:41:39.225558 tst mo_mt_call_osmux.py: using CellId 24480 23:41:39.343857 tst mo_mt_call_osmux.py: using BVCI 24481 23:41:39.461142 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:41:39.472764 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:41:39.484331 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:41:39.496174 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:41:39.509574 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:41:39.523159 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:41:39.642014 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:41:39.762863 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:41:40.255703 run create_hlr_db(pid=30963): Launched 23:41:40.377103 bus /sierra_2: Setting Powered False 23:41:41.440325 run create_hlr_db(pid=30963): Terminated: ok {rc=0} 23:41:41.883589 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30965): Launched 23:41:42.200543 run osmo-hlr_10.42.42.2(pid=30966): Launched 23:41:42.322540 run osmo-stp_10.42.42.5: Starting osmo-stp 23:41:42.873728 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30968): Launched 23:41:43.189009 run osmo-stp_10.42.42.5(pid=30969): Launched 23:41:43.310543 run osmo-msc_10.42.42.6: Starting osmo-msc 23:41:43.884743 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30971): Launched 23:41:44.201565 run osmo-msc_10.42.42.6(pid=30972): Launched 23:41:44.379966 run osmo-stp_10.42.42.5(pid=30969): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30969)] 23:41:44.515521 run osmo-stp_10.42.42.5(pid=30969): stdout: | (launched: 2022-12-09_23:41:43.131992) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:41:44.651494 run osmo-stp_10.42.42.5(pid=30969): stderr: | 20221209234143325 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234143325 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234143326 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234143326 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234143326 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234143327 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234143327 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:41:44.786950 run osmo-stp_10.42.42.5(pid=30969): stdout: | (launched: 2022-12-09_23:41:43.131992) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:41:44.914525 run osmo-stp_10.42.42.5(pid=30969): stderr: | 20221209234143325 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234143325 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234143326 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234143326 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234143326 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234143327 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234143327 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:41:45.067751 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30969): Process ended prematurely: osmo-stp_10.42.42.5(pid=30969) [trial-2366↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30969)] [trial-2366↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 23:41:45.077346 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 23:41:45.105439 run osmo-hlr_10.42.42.2(pid=30966): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30966)] 23:41:45.155534 run osmo-hlr_10.42.42.2(pid=30966): stdout: | (launched: 2022-12-09_23:41:42.143360) 23:41:45.207287 run osmo-hlr_10.42.42.2(pid=30966): stderr: | 20221209234142342 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209234142342 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209234142342 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209234142342 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209234142342 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209234142342 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209234142355 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209234142365 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209234142366 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209234142366 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:41:45.278951 run osmo-msc_10.42.42.6(pid=30972): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30972)] 23:41:45.328707 run osmo-msc_10.42.42.6(pid=30972): stdout: | (launched: 2022-12-09_23:41:44.144276) 23:41:45.379816 run osmo-msc_10.42.42.6(pid=30972): stderr: | 20221209234144465 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209234144465 DLGLOBAL DEBUG validating counter group 0x7f05a7dafc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209234144465 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209234144465 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209234144466 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209234144466 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209234144467 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209234144468 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209234144468 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209234144468 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:41:45.431380 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30965): Terminating (SIGTERM) 23:41:45.472575 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30968): Terminating (SIGTERM) 23:41:45.514027 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30971): Terminating (SIGTERM) 23:41:45.555668 --- ParallelTerminationStrategy: PID 30965 died... 23:41:45.575377 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30965): Terminated: ok {rc=0} 23:41:45.621741 --- ParallelTerminationStrategy: PID 30968 died... 23:41:45.640918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30968): Terminated: ok {rc=0} 23:41:45.687038 --- ParallelTerminationStrategy: PID 30971 died... 23:41:45.706358 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30971): Terminated: ok {rc=0} 23:41:45.793526 bus /sierra_3: Setting Powered False 23:41:46.906696 bus /sierra_3: Setting Powered False 23:41:48.033426 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 voice:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 23:41:49.281566 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:41:49.287187 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 23:41:49.320353 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 23:41:49.347159 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 23:41:49.397960 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 23:41:49.430981 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 23:41:49.457157 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 23:41:50.008916 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 23:41:50.056294 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:41:50.067293 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:41:50.137606 tst mo_mt_call.py: using LAC 24481 23:41:50.257786 tst mo_mt_call.py: using RAC 1 23:41:50.374531 tst mo_mt_call.py: using CellId 24481 23:41:50.491384 tst mo_mt_call.py: using BVCI 24482 23:41:50.600399 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:41:50.611444 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:41:50.622217 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:41:50.633077 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:41:50.643982 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:41:50.654804 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:41:50.772668 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:41:50.890402 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:41:51.350308 run create_hlr_db(pid=30977): Launched 23:41:51.471256 bus /sierra_2: Setting Powered False 23:41:52.530987 run create_hlr_db(pid=30977): Terminated: ok {rc=0} 23:41:52.965641 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30979): Launched 23:41:53.284303 run osmo-hlr_10.42.42.2(pid=30980): Launched 23:41:53.406231 run osmo-stp_10.42.42.5: Starting osmo-stp 23:41:53.961107 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30982): Launched 23:41:54.278952 run osmo-stp_10.42.42.5(pid=30983): Launched 23:41:54.400486 run osmo-msc_10.42.42.6: Starting osmo-msc 23:41:54.976702 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30985): Launched 23:41:55.294264 run osmo-msc_10.42.42.6(pid=30986): Launched 23:41:55.472622 run osmo-stp_10.42.42.5(pid=30983): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30983)] 23:41:55.607187 run osmo-stp_10.42.42.5(pid=30983): stdout: | (launched: 2022-12-09_23:41:54.221434) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:41:55.742663 run osmo-stp_10.42.42.5(pid=30983): stderr: | 20221209234154412 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234154412 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234154412 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234154413 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234154413 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234154413 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234154413 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:41:55.877163 run osmo-stp_10.42.42.5(pid=30983): stdout: | (launched: 2022-12-09_23:41:54.221434) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:41:56.004219 run osmo-stp_10.42.42.5(pid=30983): stderr: | 20221209234154412 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234154412 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234154412 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234154413 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234154413 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234154413 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234154413 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:41:56.156642 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30983): Process ended prematurely: osmo-stp_10.42.42.5(pid=30983) [trial-2366↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30983)] [trial-2366↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 23:41:56.166269 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 23:41:56.195127 run osmo-hlr_10.42.42.2(pid=30980): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30980)] 23:41:56.245412 run osmo-hlr_10.42.42.2(pid=30980): stdout: | (launched: 2022-12-09_23:41:53.226769) 23:41:56.297246 run osmo-hlr_10.42.42.2(pid=30980): stderr: | 20221209234153424 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209234153424 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209234153424 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209234153424 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209234153425 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209234153425 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209234153436 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209234153445 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209234153445 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209234153445 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:41:56.369602 run osmo-msc_10.42.42.6(pid=30986): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30986)] 23:41:56.419693 run osmo-msc_10.42.42.6(pid=30986): stdout: | (launched: 2022-12-09_23:41:55.236517) 23:41:56.471446 run osmo-msc_10.42.42.6(pid=30986): stderr: | 20221209234155559 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209234155559 DLGLOBAL DEBUG validating counter group 0x7ff46300bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209234155559 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209234155559 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209234155559 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209234155560 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209234155561 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209234155562 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209234155562 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209234155562 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:41:56.523700 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30979): Terminating (SIGTERM) 23:41:56.565445 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30982): Terminating (SIGTERM) 23:41:56.607184 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30985): Terminating (SIGTERM) 23:41:56.649151 --- ParallelTerminationStrategy: PID 30979 died... 23:41:56.669091 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30979): Terminated: ok {rc=0} 23:41:56.715634 --- ParallelTerminationStrategy: PID 30982 died... 23:41:56.734980 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30982): Terminated: ok {rc=0} 23:41:56.781530 --- ParallelTerminationStrategy: PID 30985 died... 23:41:56.801154 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30985): Terminated: ok {rc=0} 23:41:56.888613 bus /sierra_3: Setting Powered False 23:41:57.987117 bus /sierra_3: Setting Powered False 23:41:59.103020 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 23:42:00.246748 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:42:00.258526 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:42:00.332248 tst mo_mt_call_osmux.py: using LAC 24482 23:42:00.449571 tst mo_mt_call_osmux.py: using RAC 2 23:42:00.567322 tst mo_mt_call_osmux.py: using CellId 24482 23:42:00.683895 tst mo_mt_call_osmux.py: using BVCI 24483 23:42:00.791516 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:42:00.802554 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:42:00.813612 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:42:00.824311 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:42:00.835363 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:42:00.848503 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:42:01.008649 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:42:01.154781 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:42:01.638529 run create_hlr_db(pid=30990): Launched 23:42:01.792261 bus /sierra_2: Setting Powered False 23:42:02.851605 run create_hlr_db(pid=30990): Terminated: ok {rc=0} 23:42:03.285014 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30992): Launched 23:42:03.601424 run osmo-hlr_10.42.42.2(pid=30993): Launched 23:42:03.722785 run osmo-stp_10.42.42.5: Starting osmo-stp 23:42:04.274771 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30995): Launched 23:42:04.591716 run osmo-stp_10.42.42.5(pid=30996): Launched 23:42:04.713287 run osmo-msc_10.42.42.6: Starting osmo-msc 23:42:05.287789 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30998): Launched 23:42:05.604640 run osmo-msc_10.42.42.6(pid=30999): Launched 23:42:05.783832 run osmo-stp_10.42.42.5(pid=30996): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30996)] 23:42:05.918704 run osmo-stp_10.42.42.5(pid=30996): stdout: | (launched: 2022-12-09_23:42:04.534544) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:42:06.053592 run osmo-stp_10.42.42.5(pid=30996): stderr: | 20221209234204725 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234204725 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234204726 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234204726 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234204726 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234204727 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234204727 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:42:06.187796 run osmo-stp_10.42.42.5(pid=30996): stdout: | (launched: 2022-12-09_23:42:04.534544) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:42:06.315062 run osmo-stp_10.42.42.5(pid=30996): stderr: | 20221209234204725 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234204725 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234204726 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234204726 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234204726 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234204727 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234204727 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:42:06.466656 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30996): Process ended prematurely: osmo-stp_10.42.42.5(pid=30996) [trial-2366↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30996)] [trial-2366↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 23:42:06.476165 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 23:42:06.504024 run osmo-hlr_10.42.42.2(pid=30993): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30993)] 23:42:06.554067 run osmo-hlr_10.42.42.2(pid=30993): stdout: | (launched: 2022-12-09_23:42:03.544149) 23:42:06.605757 run osmo-hlr_10.42.42.2(pid=30993): stderr: | 20221209234203742 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209234203742 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209234203742 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209234203742 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209234203742 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209234203743 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209234203755 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209234203765 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209234203765 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209234203765 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:42:06.677291 run osmo-msc_10.42.42.6(pid=30999): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30999)] 23:42:06.726835 run osmo-msc_10.42.42.6(pid=30999): stdout: | (launched: 2022-12-09_23:42:05.547338) 23:42:06.778325 run osmo-msc_10.42.42.6(pid=30999): stderr: | 20221209234205865 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209234205865 DLGLOBAL DEBUG validating counter group 0x7efd47305c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209234205865 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209234205865 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209234205866 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209234205866 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209234205867 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209234205868 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209234205868 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209234205868 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:42:06.829899 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30992): Terminating (SIGTERM) 23:42:06.870805 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30995): Terminating (SIGTERM) 23:42:06.911781 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30998): Terminating (SIGTERM) 23:42:06.953093 --- ParallelTerminationStrategy: PID 30992 died... 23:42:06.972804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30992): Terminated: ok {rc=0} 23:42:07.018961 --- ParallelTerminationStrategy: PID 30995 died... 23:42:07.038125 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30995): Terminated: ok {rc=0} 23:42:07.084099 --- ParallelTerminationStrategy: PID 30998 died... 23:42:07.103227 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30998): Terminated: ok {rc=0} 23:42:07.189496 bus /sierra_3: Setting Powered False 23:42:08.287491 bus /sierra_3: Setting Powered False 23:42:09.402829 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 voice:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 emergency:trx-sysmocell5000 --------------------------------------------------------------------- 23:42:10.652935 tst emergency:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:42:10.657879 tst emergency:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 23:42:10.693051 tst emergency:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 23:42:10.720338 tst emergency:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 23:42:10.806447 tst emergency:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 23:42:10.841069 tst emergency:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 23:42:10.868653 tst emergency:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 23:42:11.455009 tst emergency:trx-sysmocell5000: RESERVED RESOURCES for emergency: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2366 emergency:trx-sysmocell5000 emergency_mo_mt_call.py ---------------------------------------------- 23:42:11.460207 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:42:11.471331 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 23:42:11.522491 tst emergency_mo_mt_call.py: using LAC 24483 23:42:11.646540 tst emergency_mo_mt_call.py: using RAC 3 23:42:11.768508 tst emergency_mo_mt_call.py: using CellId 24483 23:42:11.895910 tst emergency_mo_mt_call.py: using BVCI 24484 23:42:12.010267 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:42:12.021582 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:42:12.032493 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:42:12.043653 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:42:12.054820 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:42:12.066115 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 23:42:12.180150 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 23:42:12.297423 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:42:12.781271 run create_hlr_db(pid=31004): Launched 23:42:12.899981 bus /sierra_2: Setting Powered False 23:42:13.962696 run create_hlr_db(pid=31004): Terminated: ok {rc=0} 23:42:14.397150 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31006): Launched 23:42:14.707856 run osmo-hlr_10.42.42.2(pid=31007): Launched 23:42:14.828321 run osmo-stp_10.42.42.5: Starting osmo-stp 23:42:15.346221 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31009): Launched 23:42:15.635788 run osmo-stp_10.42.42.5(pid=31010): Launched 23:42:15.757732 tst emergency_mo_mt_call.py: using MSISDN 7438 23:42:15.919071 run osmo-msc_10.42.42.6: Starting osmo-msc 23:42:16.526329 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31012): Launched 23:42:16.828183 run osmo-msc_10.42.42.6(pid=31013): Launched 23:42:17.155755 run osmo-stp_10.42.42.5(pid=31010): ERR: Terminated: ERROR {rc=1} [trial-2366↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31010)] 23:42:17.324295 run osmo-stp_10.42.42.5(pid=31010): stdout: | (launched: 2022-12-09_23:42:15.582919) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:42:17.448420 run osmo-stp_10.42.42.5(pid=31010): stderr: | 20221209234215753 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234215753 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234215753 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234215754 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234215755 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234215755 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234215755 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:42:17.569599 run osmo-stp_10.42.42.5(pid=31010): stdout: | (launched: 2022-12-09_23:42:15.582919) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:42:17.685548 run osmo-stp_10.42.42.5(pid=31010): stderr: | 20221209234215753 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234215753 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234215753 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234215754 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234215755 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234215755 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234215755 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:42:17.824129 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=31010): Process ended prematurely: osmo-stp_10.42.42.5(pid=31010) [trial-2366↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31010)] [trial-2366↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19] 23:42:17.832451 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 23:42:17.858226 run osmo-hlr_10.42.42.2(pid=31007): ERR: Terminated: ERROR {rc=237} [trial-2366↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31007)] 23:42:17.905871 run osmo-hlr_10.42.42.2(pid=31007): stdout: | (launched: 2022-12-09_23:42:14.651313) 23:42:17.954991 run osmo-hlr_10.42.42.2(pid=31007): stderr: | 20221209234214847 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209234214847 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209234214847 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209234214847 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209234214847 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209234214847 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209234214860 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/emergency:trx-sysmocell5000/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209234214868 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209234214868 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209234214868 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:42:18.023207 run osmo-msc_10.42.42.6(pid=31013): ERR: Terminated: ERROR {rc=2} [trial-2366↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31013)] 23:42:18.070505 run osmo-msc_10.42.42.6(pid=31013): stdout: | (launched: 2022-12-09_23:42:16.769071) 23:42:18.119369 run osmo-msc_10.42.42.6(pid=31013): stderr: | 20221209234217285 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209234217285 DLGLOBAL DEBUG validating counter group 0x7f6176211c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209234217285 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209234217285 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209234217285 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209234217286 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209234217287 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209234217288 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209234217288 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209234217288 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:42:18.169178 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31006): Terminating (SIGTERM) 23:42:18.208463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31009): Terminating (SIGTERM) 23:42:18.247787 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31012): Terminating (SIGTERM) 23:42:18.287209 --- ParallelTerminationStrategy: PID 31006 died... 23:42:18.306134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31006): Terminated: ok {rc=0} 23:42:18.350299 --- ParallelTerminationStrategy: PID 31009 died... 23:42:18.368927 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31009): Terminated: ok {rc=0} 23:42:18.412703 --- ParallelTerminationStrategy: PID 31012 died... 23:42:18.431151 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31012): Terminated: ok {rc=0} 23:42:18.516103 bus /sierra_3: Setting Powered False 23:42:19.615700 bus /sierra_3: Setting Powered False 23:42:20.727499 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 emergency:trx-sysmocell5000 emergency_preemptive_call.py ---------------------------------------------- 23:42:21.810873 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:42:21.822217 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 23:42:21.873637 tst emergency_preemptive_call.py: using LAC 24484 23:42:21.992189 tst emergency_preemptive_call.py: using RAC 4 23:42:22.106649 tst emergency_preemptive_call.py: using CellId 24484 23:42:22.218912 tst emergency_preemptive_call.py: using BVCI 24485 23:42:22.324023 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:42:22.334806 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:42:22.345411 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:42:22.355862 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:42:22.366478 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 23:42:22.376897 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 23:42:22.493942 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 23:42:22.611301 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 23:42:22.728775 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 23:42:22.847722 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:42:23.299830 run create_hlr_db(pid=31015): Launched 23:42:23.418675 bus /sierra_2: Setting Powered False 23:42:24.480705 run create_hlr_db(pid=31015): Terminated: ok {rc=0} 23:42:24.899504 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31017): Launched 23:42:25.189546 run osmo-hlr_10.42.42.2(pid=31018): Launched 23:42:25.300024 run osmo-stp_10.42.42.5: Starting osmo-stp 23:42:25.802219 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31020): Launched 23:42:26.094171 run osmo-stp_10.42.42.5(pid=31021): Launched 23:42:26.213847 tst emergency_preemptive_call.py: using MSISDN 7439 23:42:26.363056 run osmo-msc_10.42.42.6: Starting osmo-msc 23:42:26.885529 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31023): Launched 23:42:27.176548 run osmo-msc_10.42.42.6(pid=31024): Launched 23:42:27.339355 run osmo-stp_10.42.42.5(pid=31021): ERR: Terminated: ERROR {rc=1} [trial-2366↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31021)] 23:42:27.462601 run osmo-stp_10.42.42.5(pid=31021): stdout: | (launched: 2022-12-09_23:42:26.039302) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:42:27.587541 run osmo-stp_10.42.42.5(pid=31021): stderr: | 20221209234226211 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234226211 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234226212 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234226212 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234226213 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234226213 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234226213 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:42:27.708490 run osmo-stp_10.42.42.5(pid=31021): stdout: | (launched: 2022-12-09_23:42:26.039302) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:42:27.824388 run osmo-stp_10.42.42.5(pid=31021): stderr: | 20221209234226211 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234226211 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234226212 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234226212 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234226213 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234226213 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234226213 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:42:27.962901 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=31021): Process ended prematurely: osmo-stp_10.42.42.5(pid=31021) [trial-2366↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31021)] [trial-2366↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32] 23:42:27.971333 tst emergency_preemptive_call.py:32: Test FAILED (6.2 sec) 23:42:27.997080 run osmo-hlr_10.42.42.2(pid=31018): ERR: Terminated: ERROR {rc=237} [trial-2366↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31018)] 23:42:28.044348 run osmo-hlr_10.42.42.2(pid=31018): stdout: | (launched: 2022-12-09_23:42:25.136579) 23:42:28.093337 run osmo-hlr_10.42.42.2(pid=31018): stderr: | 20221209234225314 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209234225314 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209234225314 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209234225314 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209234225314 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209234225314 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209234225329 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/emergency:trx-sysmocell5000/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209234225337 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209234225337 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209234225338 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:42:28.161810 run osmo-msc_10.42.42.6(pid=31024): ERR: Terminated: ERROR {rc=2} [trial-2366↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31024)] 23:42:28.209194 run osmo-msc_10.42.42.6(pid=31024): stdout: | (launched: 2022-12-09_23:42:27.123332) 23:42:28.257906 run osmo-msc_10.42.42.6(pid=31024): stderr: | 20221209234227394 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209234227395 DLGLOBAL DEBUG validating counter group 0x7f4e5661fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209234227395 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209234227395 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209234227395 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209234227395 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209234227397 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209234227398 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209234227398 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209234227398 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:42:28.306881 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31017): Terminating (SIGTERM) 23:42:28.345950 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31020): Terminating (SIGTERM) 23:42:28.385013 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31023): Terminating (SIGTERM) 23:42:28.424243 --- ParallelTerminationStrategy: PID 31017 died... 23:42:28.443438 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31017): Terminated: ok {rc=0} 23:42:28.487009 --- ParallelTerminationStrategy: PID 31020 died... 23:42:28.505339 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31020): Terminated: ok {rc=0} 23:42:28.548498 --- ParallelTerminationStrategy: PID 31023 died... 23:42:28.566867 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31023): Terminated: ok {rc=0} 23:42:28.651609 bus /sierra_9: Setting Powered False 23:42:29.752685 bus /sierra_9: Setting Powered False 23:42:30.869031 bus /sierra_8: Setting Powered False 23:42:31.977315 bus /sierra_8: Setting Powered False 23:42:33.089726 bus /sierra_3: Setting Powered False 23:42:34.187306 bus /sierra_3: Setting Powered False 23:42:35.304311 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 emergency:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 gprs:trx-sysmocell5000 --------------------------------------------------------------------- 23:42:36.587221 tst gprs:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:42:36.591920 tst gprs:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 23:42:36.626635 tst gprs:trx-sysmocell5000: Verifying 9 x ip_address (candidates: 9) 23:42:36.665894 tst gprs:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 23:42:36.757743 tst gprs:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 23:42:36.791357 tst gprs:trx-sysmocell5000: Reserving 9 x ip_address (candidates: 9) 23:42:36.829748 tst gprs:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 23:42:37.416644 tst gprs:trx-sysmocell5000: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2366 gprs:trx-sysmocell5000 cs_paging_gprs_active.py ---------------------------------------------- 23:42:37.465663 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:42:37.476257 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 23:42:37.523598 tst cs_paging_gprs_active.py: using LAC 24485 23:42:37.638644 tst cs_paging_gprs_active.py: using RAC 5 23:42:37.754392 tst cs_paging_gprs_active.py: using CellId 24485 23:42:37.871174 tst cs_paging_gprs_active.py: using BVCI 24486 23:42:37.978693 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:42:37.989456 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:42:37.999942 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:42:38.010539 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:42:38.021005 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:42:38.031387 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:42:38.042042 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:42:38.052374 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:42:38.063027 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 23:42:38.179756 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 23:42:38.296500 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:42:38.496846 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:42:38.795149 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31029): Launched 23:42:39.053829 run iperf3-srv_10.42.42.10(pid=31030): Launched 23:42:39.165547 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:42:39.365357 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:42:39.665328 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31031): Launched 23:42:39.924497 run iperf3-srv_10.42.42.10(pid=31032): Launched 23:42:40.035822 tst cs_paging_gprs_active.py:38: start network... 23:42:40.235283 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:42:40.696761 run create_hlr_db(pid=31033): Launched 23:42:40.819608 bus /sierra_2: Setting Powered False 23:42:41.878491 run create_hlr_db(pid=31033): Terminated: ok {rc=0} 23:42:42.293337 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31035): Launched 23:42:42.591536 run osmo-hlr_10.42.42.2(pid=31036): Launched 23:42:42.704875 run osmo-stp_10.42.42.5: Starting osmo-stp 23:42:43.232115 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31038): Launched 23:42:43.529665 run osmo-stp_10.42.42.5(pid=31039): Launched 23:42:43.643340 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:42:44.157152 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31041): Launched 23:42:44.270989 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:42:44.522185 run patchelf(pid=31042): Launched 23:42:44.687955 run osmo-stp_10.42.42.5(pid=31039): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31039)] 23:42:44.813855 run osmo-stp_10.42.42.5(pid=31039): stdout: | (launched: 2022-12-09_23:42:43.474922) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:42:44.941405 run osmo-stp_10.42.42.5(pid=31039): stderr: | 20221209234243645 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234243645 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234243645 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234243646 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234243646 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234243646 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234243646 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:42:45.068885 run osmo-stp_10.42.42.5(pid=31039): stdout: | (launched: 2022-12-09_23:42:43.474922) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:42:45.190748 run osmo-stp_10.42.42.5(pid=31039): stderr: | 20221209234243645 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234243645 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234243645 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234243646 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234243646 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234243646 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234243646 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:42:45.334487 run patchelf(pid=31042): Terminating (SIGINT) 23:42:45.501639 run patchelf(pid=31042): Terminated: ok {rc=0} 23:42:45.622361 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=31039): Process ended prematurely: osmo-stp_10.42.42.5(pid=31039) [trial-2366↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31039)] [trial-2366↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38] 23:42:45.631687 tst cs_paging_gprs_active.py:38: Test FAILED (8.2 sec) 23:42:45.658241 run osmo-hlr_10.42.42.2(pid=31036): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31036)] 23:42:45.705098 run osmo-hlr_10.42.42.2(pid=31036): stdout: | (launched: 2022-12-09_23:42:42.536534) 23:42:45.753593 run osmo-hlr_10.42.42.2(pid=31036): stderr: | 20221209234242714 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209234242714 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209234242714 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209234242714 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209234242714 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209234242714 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209234242728 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-sysmocell5000/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209234242737 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209234242738 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209234242738 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:42:45.802762 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31029): Terminating (SIGTERM) 23:42:45.848831 run iperf3-srv_10.42.42.10(pid=31030): Terminating (SIGTERM) 23:42:45.908169 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31031): Terminating (SIGTERM) 23:42:45.955029 run iperf3-srv_10.42.42.10(pid=31032): Terminating (SIGTERM) 23:42:46.001812 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31035): Terminating (SIGTERM) 23:42:46.045532 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31038): Terminating (SIGTERM) 23:42:46.085678 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31041): Terminating (SIGTERM) 23:42:46.125801 --- ParallelTerminationStrategy: PID 31029 died... 23:42:46.144652 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31029): Terminated: ok {rc=0} 23:42:46.189330 --- ParallelTerminationStrategy: PID 31030 died... 23:42:46.208219 run iperf3-srv_10.42.42.10(pid=31030): Terminated {rc=256} 23:42:46.252447 --- ParallelTerminationStrategy: PID 31031 died... 23:42:46.271605 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31031): Terminated: ok {rc=0} 23:42:46.315930 --- ParallelTerminationStrategy: PID 31032 died... 23:42:46.334726 run iperf3-srv_10.42.42.10(pid=31032): Terminated {rc=256} 23:42:46.379143 --- ParallelTerminationStrategy: PID 31035 died... 23:42:46.398084 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31035): Terminated: ok {rc=0} 23:42:46.442439 --- ParallelTerminationStrategy: PID 31038 died... 23:42:46.461398 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31038): Terminated: ok {rc=0} 23:42:46.506207 --- ParallelTerminationStrategy: PID 31041 died... 23:42:46.525395 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31041): Terminated: ok {rc=0} 23:42:46.613686 bus /gobi_0: Setting Powered False 23:42:47.709450 bus /gobi_0: Setting Powered False 23:42:48.820774 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-sysmocell5000 iperf3.py ---------------------------------------------- 23:42:49.967656 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:42:49.979297 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 23:42:50.033090 tst iperf3.py: using LAC 24486 23:42:50.159868 tst iperf3.py: using RAC 6 23:42:50.284422 tst iperf3.py: using CellId 24486 23:42:50.409390 tst iperf3.py: using BVCI 24487 23:42:50.524834 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:42:50.536122 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:42:50.547108 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:42:50.558403 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:42:50.569601 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:42:50.580688 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:42:50.592056 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:42:50.603188 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:42:50.614562 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 23:42:50.735024 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:42:50.951553 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:42:51.271013 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31043): Launched 23:42:51.548891 run iperf3-srv_10.42.42.10(pid=31044): Launched 23:42:51.668799 tst iperf3.py:8: start network... 23:42:51.896004 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:42:52.372543 run create_hlr_db(pid=31045): Launched 23:42:52.496115 bus /gobi_6: Setting Powered False 23:42:53.559915 run create_hlr_db(pid=31045): Terminated: ok {rc=0} 23:42:53.986695 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31047): Launched 23:42:54.283559 run osmo-hlr_10.42.42.2(pid=31048): Launched 23:42:54.397291 run osmo-stp_10.42.42.5: Starting osmo-stp 23:42:54.913229 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31050): Launched 23:42:55.233144 run osmo-stp_10.42.42.5(pid=31051): Launched 23:42:55.355548 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:42:55.908342 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31053): Launched 23:42:56.030996 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:42:56.300894 run patchelf(pid=31054): Launched 23:42:56.478521 run osmo-stp_10.42.42.5(pid=31051): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31051)] 23:42:56.613762 run osmo-stp_10.42.42.5(pid=31051): stdout: | (launched: 2022-12-09_23:42:55.175391) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:42:56.751243 run osmo-stp_10.42.42.5(pid=31051): stderr: | 20221209234255368 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234255368 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234255368 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234255369 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234255369 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234255369 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234255369 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:42:56.889479 run osmo-stp_10.42.42.5(pid=31051): stdout: | (launched: 2022-12-09_23:42:55.175391) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:42:57.020766 run osmo-stp_10.42.42.5(pid=31051): stderr: | 20221209234255368 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234255368 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234255368 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234255369 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234255369 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234255369 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234255369 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:42:57.176163 run patchelf(pid=31054): Terminating (SIGINT) 23:42:57.355802 run patchelf(pid=31054): Terminated: ok {rc=0} 23:42:57.485385 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31051): Process ended prematurely: osmo-stp_10.42.42.5(pid=31051) [trial-2366↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31051)] [trial-2366↪gprs:trx-sysmocell5000↪iperf3.py:8] 23:42:57.495670 tst iperf3.py:8: Test FAILED (7.6 sec) 23:42:57.524903 run osmo-hlr_10.42.42.2(pid=31048): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-sysmocell5000↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31048)] 23:42:57.575308 run osmo-hlr_10.42.42.2(pid=31048): stdout: | (launched: 2022-12-09_23:42:54.229595) 23:42:57.627768 run osmo-hlr_10.42.42.2(pid=31048): stderr: | 20221209234254406 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209234254406 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209234254406 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209234254407 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209234254407 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209234254407 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209234254419 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-sysmocell5000/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209234254430 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209234254430 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209234254430 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:42:57.680647 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31043): Terminating (SIGTERM) 23:42:57.723075 run iperf3-srv_10.42.42.10(pid=31044): Terminating (SIGTERM) 23:42:57.765401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31047): Terminating (SIGTERM) 23:42:57.808264 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31050): Terminating (SIGTERM) 23:42:57.850882 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31053): Terminating (SIGTERM) 23:42:57.893571 --- ParallelTerminationStrategy: PID 31043 died... 23:42:57.913599 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31043): Terminated: ok {rc=0} 23:42:57.960724 --- ParallelTerminationStrategy: PID 31044 died... 23:42:57.980331 run iperf3-srv_10.42.42.10(pid=31044): Terminated {rc=256} 23:42:58.026948 --- ParallelTerminationStrategy: PID 31047 died... 23:42:58.046442 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31047): Terminated: ok {rc=0} 23:42:58.092747 --- ParallelTerminationStrategy: PID 31050 died... 23:42:58.112144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31050): Terminated: ok {rc=0} 23:42:58.158312 --- ParallelTerminationStrategy: PID 31053 died... 23:42:58.177710 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31053): Terminated: ok {rc=0} 23:42:58.265159 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-sysmocell5000 iperf3m4.py ---------------------------------------------- 23:42:59.413548 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:42:59.428055 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 23:42:59.478149 tst iperf3m4.py: using LAC 24487 23:42:59.602541 tst iperf3m4.py: using RAC 7 23:42:59.728289 tst iperf3m4.py: using CellId 24487 23:42:59.852894 tst iperf3m4.py: using BVCI 24488 23:42:59.968140 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:42:59.979547 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:42:59.990667 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:00.001839 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:00.013002 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:00.024154 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:00.035465 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:00.046649 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:00.057958 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 23:43:00.175832 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 23:43:00.297952 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 23:43:00.413444 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 23:43:00.533417 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:43:00.749967 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:43:01.114028 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31055): Launched 23:43:01.408642 run iperf3-srv_10.42.42.10(pid=31056): Launched 23:43:01.543254 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:43:01.763050 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:43:02.091583 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31057): Launched 23:43:02.373419 run iperf3-srv_10.42.42.10(pid=31058): Launched 23:43:02.484895 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:43:02.685369 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:43:02.985637 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31059): Launched 23:43:03.244488 run iperf3-srv_10.42.42.10(pid=31060): Launched 23:43:03.355379 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:43:03.554584 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:43:03.852694 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31061): Launched 23:43:04.110625 run iperf3-srv_10.42.42.10(pid=31062): Launched 23:43:04.221445 tst iperf3m4.py:8: start network... 23:43:04.420679 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:43:04.881306 run create_hlr_db(pid=31063): Launched 23:43:05.003367 bus /gobi_6: Setting Powered False 23:43:06.063274 run create_hlr_db(pid=31063): Terminated: ok {rc=0} 23:43:06.477590 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31065): Launched 23:43:06.776304 run osmo-hlr_10.42.42.2(pid=31066): Launched 23:43:06.889146 run osmo-stp_10.42.42.5: Starting osmo-stp 23:43:07.415288 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31068): Launched 23:43:07.714079 run osmo-stp_10.42.42.5(pid=31069): Launched 23:43:07.827340 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:43:08.339831 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31071): Launched 23:43:08.452671 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:43:08.703560 run patchelf(pid=31072): Launched 23:43:08.869682 run osmo-stp_10.42.42.5(pid=31069): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31069)] 23:43:08.995536 run osmo-stp_10.42.42.5(pid=31069): stdout: | (launched: 2022-12-09_23:43:07.658287) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:43:09.123781 run osmo-stp_10.42.42.5(pid=31069): stderr: | 20221209234307829 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234307829 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234307829 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234307830 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234307832 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234307832 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234307832 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:43:09.252099 run osmo-stp_10.42.42.5(pid=31069): stdout: | (launched: 2022-12-09_23:43:07.658287) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:43:09.374187 run osmo-stp_10.42.42.5(pid=31069): stderr: | 20221209234307829 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234307829 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234307829 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234307830 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234307832 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234307832 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234307832 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:43:09.518311 run patchelf(pid=31072): Terminating (SIGINT) 23:43:09.685740 run patchelf(pid=31072): Terminated: ok {rc=0} 23:43:09.806506 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31069): Process ended prematurely: osmo-stp_10.42.42.5(pid=31069) [trial-2366↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31069)] [trial-2366↪gprs:trx-sysmocell5000↪iperf3m4.py:8] 23:43:09.815887 tst iperf3m4.py:8: Test FAILED (10.4 sec) 23:43:09.842956 run osmo-hlr_10.42.42.2(pid=31066): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-sysmocell5000↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31066)] 23:43:09.889901 run osmo-hlr_10.42.42.2(pid=31066): stdout: | (launched: 2022-12-09_23:43:06.720859) 23:43:09.938286 run osmo-hlr_10.42.42.2(pid=31066): stderr: | 20221209234306895 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209234306895 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209234306895 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209234306895 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209234306895 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209234306895 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209234306907 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-sysmocell5000/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209234306917 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209234306917 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209234306917 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:43:09.987441 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31055): Terminating (SIGTERM) 23:43:10.026219 run iperf3-srv_10.42.42.10(pid=31056): Terminating (SIGTERM) 23:43:10.065027 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31057): Terminating (SIGTERM) 23:43:10.104822 run iperf3-srv_10.42.42.10(pid=31058): Terminating (SIGTERM) 23:43:10.143816 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31059): Terminating (SIGTERM) 23:43:10.182792 run iperf3-srv_10.42.42.10(pid=31060): Terminating (SIGTERM) 23:43:10.221860 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31061): Terminating (SIGTERM) 23:43:10.260798 run iperf3-srv_10.42.42.10(pid=31062): Terminating (SIGTERM) 23:43:10.299555 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31065): Terminating (SIGTERM) 23:43:10.338420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31068): Terminating (SIGTERM) 23:43:10.377612 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31071): Terminating (SIGTERM) 23:43:10.416691 --- ParallelTerminationStrategy: PID 31055 died... 23:43:10.435492 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31055): Terminated: ok {rc=0} 23:43:10.479044 --- ParallelTerminationStrategy: PID 31056 died... 23:43:10.497370 run iperf3-srv_10.42.42.10(pid=31056): Terminated {rc=256} 23:43:10.540392 --- ParallelTerminationStrategy: PID 31057 died... 23:43:10.558668 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31057): Terminated: ok {rc=0} 23:43:10.602318 --- ParallelTerminationStrategy: PID 31058 died... 23:43:10.620601 run iperf3-srv_10.42.42.10(pid=31058): Terminated {rc=256} 23:43:10.663790 --- ParallelTerminationStrategy: PID 31059 died... 23:43:10.682237 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31059): Terminated: ok {rc=0} 23:43:10.725506 --- ParallelTerminationStrategy: PID 31060 died... 23:43:10.743715 run iperf3-srv_10.42.42.10(pid=31060): Terminated {rc=256} 23:43:10.787620 --- ParallelTerminationStrategy: PID 31061 died... 23:43:10.806095 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31061): Terminated: ok {rc=0} 23:43:10.849894 --- ParallelTerminationStrategy: PID 31062 died... 23:43:10.868450 run iperf3-srv_10.42.42.10(pid=31062): Terminated {rc=256} 23:43:10.911607 --- ParallelTerminationStrategy: PID 31065 died... 23:43:10.929927 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31065): Terminated: ok {rc=0} 23:43:10.973168 --- ParallelTerminationStrategy: PID 31068 died... 23:43:10.991505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31068): Terminated: ok {rc=0} 23:43:11.034773 --- ParallelTerminationStrategy: PID 31071 died... 23:43:11.053222 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31071): Terminated: ok {rc=0} 23:43:11.136336 bus /gobi_4: Setting Powered False 23:43:12.233859 bus /gobi_4: Setting Powered False 23:43:13.351888 bus /gobi_1: Setting Powered False 23:43:14.449761 bus /gobi_1: Setting Powered False 23:43:15.564233 bus /gobi_0: Setting Powered False 23:43:16.661057 bus /gobi_0: Setting Powered False 23:43:17.778763 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-sysmocell5000 ping.py ---------------------------------------------- 23:43:18.883146 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:18.894988 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 23:43:18.945075 tst ping.py: using LAC 24488 23:43:19.066628 tst ping.py: using RAC 8 23:43:19.180676 tst ping.py: using CellId 24488 23:43:19.294488 tst ping.py: using BVCI 24489 23:43:19.401622 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:19.412189 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:19.422890 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:19.433422 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:19.443789 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:19.454224 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:19.464705 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:19.475306 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 23:43:19.587363 tst ping.py:19: start network... 23:43:19.783067 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:43:20.233647 run create_hlr_db(pid=31074): Launched 23:43:20.351254 bus /gobi_6: Setting Powered False 23:43:21.409523 run create_hlr_db(pid=31074): Terminated: ok {rc=0} 23:43:21.836060 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31076): Launched 23:43:22.149272 run osmo-hlr_10.42.42.2(pid=31077): Launched 23:43:22.269959 run osmo-stp_10.42.42.5: Starting osmo-stp 23:43:22.813856 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31079): Launched 23:43:23.106226 run osmo-stp_10.42.42.5(pid=31080): Launched 23:43:23.217141 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:43:23.719685 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31082): Launched 23:43:23.830900 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:43:24.076546 run patchelf(pid=31083): Launched 23:43:24.237954 run osmo-stp_10.42.42.5(pid=31080): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31080)] 23:43:24.360906 run osmo-stp_10.42.42.5(pid=31080): stdout: | (launched: 2022-12-09_23:43:23.053261) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:43:24.485990 run osmo-stp_10.42.42.5(pid=31080): stderr: | 20221209234323221 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234323221 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234323222 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234323222 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234323223 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234323223 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234323223 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:43:24.611635 run osmo-stp_10.42.42.5(pid=31080): stdout: | (launched: 2022-12-09_23:43:23.053261) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:43:24.731088 run osmo-stp_10.42.42.5(pid=31080): stderr: | 20221209234323221 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234323221 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234323222 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234323222 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234323223 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234323223 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234323223 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:43:24.872801 run patchelf(pid=31083): Terminating (SIGINT) 23:43:25.036674 run patchelf(pid=31083): Terminated: ok {rc=0} 23:43:25.154242 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=31080): Process ended prematurely: osmo-stp_10.42.42.5(pid=31080) [trial-2366↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31080)] [trial-2366↪gprs:trx-sysmocell5000↪ping.py:22] 23:43:25.162918 tst ping.py:22: Test FAILED (6.3 sec) 23:43:25.189147 run osmo-hlr_10.42.42.2(pid=31077): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-sysmocell5000↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31077)] 23:43:25.236246 run osmo-hlr_10.42.42.2(pid=31077): stdout: | (launched: 2022-12-09_23:43:22.092691) 23:43:25.285116 run osmo-hlr_10.42.42.2(pid=31077): stderr: | 20221209234322286 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209234322286 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209234322286 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209234322286 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209234322286 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209234322286 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209234322298 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-sysmocell5000/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209234322306 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209234322307 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209234322307 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:43:25.333991 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31076): Terminating (SIGTERM) 23:43:25.373043 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31079): Terminating (SIGTERM) 23:43:25.411963 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31082): Terminating (SIGTERM) 23:43:25.451077 --- ParallelTerminationStrategy: PID 31076 died... 23:43:25.469897 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31076): Terminated: ok {rc=0} 23:43:25.513237 --- ParallelTerminationStrategy: PID 31079 died... 23:43:25.531511 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31079): Terminated: ok {rc=0} 23:43:25.574859 --- ParallelTerminationStrategy: PID 31082 died... 23:43:25.593231 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31082): Terminated: ok {rc=0} 23:43:25.675836 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-sysmocell5000 ping_idle_ping.py ---------------------------------------------- 23:43:26.761432 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:26.773799 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 23:43:26.829219 tst ping_idle_ping.py: using LAC 24489 23:43:26.954742 tst ping_idle_ping.py: using RAC 9 23:43:27.078462 tst ping_idle_ping.py: using CellId 24489 23:43:27.202364 tst ping_idle_ping.py: using BVCI 24490 23:43:27.318858 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:27.330365 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:27.341607 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:27.353629 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:27.365569 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:27.377682 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:27.389500 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 23:43:27.401152 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 23:43:27.519377 tst ping_idle_ping.py:24: start network... 23:43:27.732358 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:43:28.222533 run create_hlr_db(pid=31084): Launched 23:43:28.342012 bus /gobi_6: Setting Powered False 23:43:29.404489 run create_hlr_db(pid=31084): Terminated: ok {rc=0} 23:43:29.844036 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31086): Launched 23:43:30.163656 run osmo-hlr_10.42.42.2(pid=31087): Launched 23:43:30.283990 run osmo-stp_10.42.42.5: Starting osmo-stp 23:43:30.824603 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31089): Launched 23:43:31.177699 run osmo-stp_10.42.42.5(pid=31090): Launched 23:43:31.396461 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:43:32.049078 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31092): Launched 23:43:32.179335 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:43:32.449286 run patchelf(pid=31093): Launched 23:43:32.623384 run osmo-stp_10.42.42.5(pid=31090): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31090)] 23:43:32.756689 run osmo-stp_10.42.42.5(pid=31090): stdout: | (launched: 2022-12-09_23:43:31.107779) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:43:32.892711 run osmo-stp_10.42.42.5(pid=31090): stderr: | 20221209234331406 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234331407 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234331407 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234331407 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234331416 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234331416 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234331416 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:43:33.028215 run osmo-stp_10.42.42.5(pid=31090): stdout: | (launched: 2022-12-09_23:43:31.107779) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:43:33.157452 run osmo-stp_10.42.42.5(pid=31090): stderr: | 20221209234331406 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234331407 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234331407 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234331407 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234331416 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234331416 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234331416 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:43:33.310025 run patchelf(pid=31093): Terminating (SIGINT) 23:43:33.486587 run patchelf(pid=31093): Terminated: ok {rc=0} 23:43:33.613735 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=31090): Process ended prematurely: osmo-stp_10.42.42.5(pid=31090) [trial-2366↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31090)] [trial-2366↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27] 23:43:33.623520 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 23:43:33.652336 run osmo-hlr_10.42.42.2(pid=31087): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-sysmocell5000↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31087)] 23:43:33.702099 run osmo-hlr_10.42.42.2(pid=31087): stdout: | (launched: 2022-12-09_23:43:30.106877) 23:43:33.753576 run osmo-hlr_10.42.42.2(pid=31087): stderr: | 20221209234330301 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209234330301 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209234330301 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209234330301 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209234330301 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209234330301 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209234330314 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-sysmocell5000/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209234330322 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209234330322 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209234330322 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:43:33.806283 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31086): Terminating (SIGTERM) 23:43:33.847989 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31089): Terminating (SIGTERM) 23:43:33.889595 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31092): Terminating (SIGTERM) 23:43:33.931557 --- ParallelTerminationStrategy: PID 31086 died... 23:43:33.951315 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31086): Terminated: ok {rc=0} 23:43:33.997835 --- ParallelTerminationStrategy: PID 31089 died... 23:43:34.017207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31089): Terminated: ok {rc=0} 23:43:34.063509 --- ParallelTerminationStrategy: PID 31092 died... 23:43:34.083068 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31092): Terminated: ok {rc=0} 23:43:34.169566 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2366 gprs:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 gprs:trx-sysmocell5000+mod-bts0-egprs --------------------------------------------------------------------- 23:43:35.475564 tst gprs:trx-sysmocell5000+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:43:35.481245 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 23:43:35.515218 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 23:43:35.553446 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 23:43:35.638420 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 23:43:35.671240 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 23:43:35.708807 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 23:43:36.306886 tst gprs:trx-sysmocell5000+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2366 gprs:trx-sysmocell5000+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 23:43:36.354930 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:43:36.366083 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:43:36.416462 tst cs_paging_gprs_active.py: using LAC 24490 23:43:36.535487 tst cs_paging_gprs_active.py: using RAC 10 23:43:36.655614 tst cs_paging_gprs_active.py: using CellId 24490 23:43:36.774255 tst cs_paging_gprs_active.py: using BVCI 24491 23:43:36.883314 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:43:36.894319 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:43:36.905213 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:43:36.915877 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:43:36.926526 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:43:36.937202 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:43:36.947964 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:43:36.958580 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:43:36.969838 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:43:37.088659 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:43:37.207458 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:43:37.408890 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:43:37.707008 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31097): Launched 23:43:37.966833 run iperf3-srv_10.42.42.10(pid=31098): Launched 23:43:38.078151 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:43:38.277604 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:43:38.575625 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31099): Launched 23:43:38.833653 run iperf3-srv_10.42.42.10(pid=31100): Launched 23:43:38.945119 tst cs_paging_gprs_active.py:38: start network... 23:43:39.145771 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:43:39.606783 run create_hlr_db(pid=31101): Launched 23:43:39.726947 bus /gobi_6: Setting Powered False 23:43:40.786188 run create_hlr_db(pid=31101): Terminated: ok {rc=0} 23:43:41.222256 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31103): Launched 23:43:41.541027 run osmo-hlr_10.42.42.2(pid=31104): Launched 23:43:41.664656 run osmo-stp_10.42.42.5: Starting osmo-stp 23:43:42.213610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31106): Launched 23:43:42.532922 run osmo-stp_10.42.42.5(pid=31107): Launched 23:43:42.655824 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:43:43.207416 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31109): Launched 23:43:43.330177 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:43:43.599406 run patchelf(pid=31110): Launched 23:43:43.776623 run osmo-stp_10.42.42.5(pid=31107): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31107)] 23:43:43.912421 run osmo-stp_10.42.42.5(pid=31107): stdout: | (launched: 2022-12-09_23:43:42.475147) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:43:44.049555 run osmo-stp_10.42.42.5(pid=31107): stderr: | 20221209234342666 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234342666 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234342666 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234342666 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234342667 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234342667 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234342667 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:43:44.186642 run osmo-stp_10.42.42.5(pid=31107): stdout: | (launched: 2022-12-09_23:43:42.475147) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:43:44.317691 run osmo-stp_10.42.42.5(pid=31107): stderr: | 20221209234342666 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234342666 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234342666 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234342666 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234342667 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234342667 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234342667 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:43:44.473265 run patchelf(pid=31110): Terminating (SIGINT) 23:43:44.652213 run patchelf(pid=31110): Terminated: ok {rc=0} 23:43:44.781755 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=31107): Process ended prematurely: osmo-stp_10.42.42.5(pid=31107) [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31107)] [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 23:43:44.791854 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 23:43:44.820995 run osmo-hlr_10.42.42.2(pid=31104): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31104)] 23:43:44.870829 run osmo-hlr_10.42.42.2(pid=31104): stdout: | (launched: 2022-12-09_23:43:41.483390) 23:43:44.922525 run osmo-hlr_10.42.42.2(pid=31104): stderr: | 20221209234341682 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209234341682 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209234341682 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209234341682 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209234341682 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209234341682 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209234341694 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-sysmocell5000+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209234341702 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209234341703 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209234341703 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:43:44.974367 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31097): Terminating (SIGTERM) 23:43:45.016220 run iperf3-srv_10.42.42.10(pid=31098): Terminating (SIGTERM) 23:43:45.058315 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31099): Terminating (SIGTERM) 23:43:45.100378 run iperf3-srv_10.42.42.10(pid=31100): Terminating (SIGTERM) 23:43:45.142126 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31103): Terminating (SIGTERM) 23:43:45.183978 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31106): Terminating (SIGTERM) 23:43:45.225726 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31109): Terminating (SIGTERM) 23:43:45.267624 --- ParallelTerminationStrategy: PID 31097 died... 23:43:45.287488 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31097): Terminated: ok {rc=0} 23:43:45.334749 --- ParallelTerminationStrategy: PID 31098 died... 23:43:45.354212 run iperf3-srv_10.42.42.10(pid=31098): Terminated {rc=256} 23:43:45.400423 --- ParallelTerminationStrategy: PID 31099 died... 23:43:45.419891 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31099): Terminated: ok {rc=0} 23:43:45.466140 --- ParallelTerminationStrategy: PID 31100 died... 23:43:45.485690 run iperf3-srv_10.42.42.10(pid=31100): Terminated {rc=256} 23:43:45.531935 --- ParallelTerminationStrategy: PID 31103 died... 23:43:45.551499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31103): Terminated: ok {rc=0} 23:43:45.597871 --- ParallelTerminationStrategy: PID 31106 died... 23:43:45.617383 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31106): Terminated: ok {rc=0} 23:43:45.663612 --- ParallelTerminationStrategy: PID 31109 died... 23:43:45.683198 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31109): Terminated: ok {rc=0} 23:43:45.770138 bus /gobi_0: Setting Powered False 23:43:46.865886 bus /gobi_0: Setting Powered False 23:43:47.978160 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3.py ---------------------------------------------- 23:43:49.126627 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:43:49.138679 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:43:49.193628 tst iperf3.py: using LAC 24491 23:43:49.311741 tst iperf3.py: using RAC 11 23:43:49.437513 tst iperf3.py: using CellId 24491 23:43:49.554729 tst iperf3.py: using BVCI 24492 23:43:49.664492 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:43:49.675590 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:43:49.686476 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:43:49.697279 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:43:49.707997 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:43:49.718833 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:43:49.729536 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:43:49.740226 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:43:49.751186 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:43:49.869421 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:43:50.083712 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:43:50.401672 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31111): Launched 23:43:50.677694 run iperf3-srv_10.42.42.10(pid=31112): Launched 23:43:50.796686 tst iperf3.py:8: start network... 23:43:51.012303 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:43:51.505374 run create_hlr_db(pid=31113): Launched 23:43:51.627335 bus /gobi_6: Setting Powered False 23:43:52.685764 run create_hlr_db(pid=31113): Terminated: ok {rc=0} 23:43:53.131619 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31115): Launched 23:43:53.450218 run osmo-hlr_10.42.42.2(pid=31116): Launched 23:43:53.571780 run osmo-stp_10.42.42.5: Starting osmo-stp 23:43:54.121888 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31118): Launched 23:43:54.437925 run osmo-stp_10.42.42.5(pid=31119): Launched 23:43:54.559445 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:43:55.108205 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31121): Launched 23:43:55.230116 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:43:55.499511 run patchelf(pid=31122): Launched 23:43:55.676415 run osmo-stp_10.42.42.5(pid=31119): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31119)] 23:43:55.811551 run osmo-stp_10.42.42.5(pid=31119): stdout: | (launched: 2022-12-09_23:43:54.380659) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:43:55.948750 run osmo-stp_10.42.42.5(pid=31119): stderr: | 20221209234354573 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234354573 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234354573 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234354574 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234354574 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234354574 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234354574 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:43:56.086105 run osmo-stp_10.42.42.5(pid=31119): stdout: | (launched: 2022-12-09_23:43:54.380659) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:43:56.216898 run osmo-stp_10.42.42.5(pid=31119): stderr: | 20221209234354573 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234354573 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234354573 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234354574 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234354574 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234354574 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234354574 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:43:56.371539 run patchelf(pid=31122): Terminating (SIGINT) 23:43:56.550571 run patchelf(pid=31122): Terminated: ok {rc=0} 23:43:56.679930 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31119): Process ended prematurely: osmo-stp_10.42.42.5(pid=31119) [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31119)] [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8] 23:43:56.690283 tst iperf3.py:8: Test FAILED (7.6 sec) 23:43:56.719249 run osmo-hlr_10.42.42.2(pid=31116): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31116)] 23:43:56.769117 run osmo-hlr_10.42.42.2(pid=31116): stdout: | (launched: 2022-12-09_23:43:53.392803) 23:43:56.821107 run osmo-hlr_10.42.42.2(pid=31116): stderr: | 20221209234353592 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209234353592 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209234353592 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209234353592 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209234353592 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209234353592 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209234353605 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209234353613 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209234353613 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209234353614 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:43:56.873076 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31111): Terminating (SIGTERM) 23:43:56.914653 run iperf3-srv_10.42.42.10(pid=31112): Terminating (SIGTERM) 23:43:56.956229 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31115): Terminating (SIGTERM) 23:43:56.997730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31118): Terminating (SIGTERM) 23:43:57.039574 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31121): Terminating (SIGTERM) 23:43:57.081534 --- ParallelTerminationStrategy: PID 31111 died... 23:43:57.101388 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31111): Terminated: ok {rc=0} 23:43:57.147991 --- ParallelTerminationStrategy: PID 31112 died... 23:43:57.167533 run iperf3-srv_10.42.42.10(pid=31112): Terminated {rc=256} 23:43:57.213672 --- ParallelTerminationStrategy: PID 31115 died... 23:43:57.232810 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31115): Terminated: ok {rc=0} 23:43:57.279063 --- ParallelTerminationStrategy: PID 31118 died... 23:43:57.298589 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31118): Terminated: ok {rc=0} 23:43:57.344818 --- ParallelTerminationStrategy: PID 31121 died... 23:43:57.364564 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31121): Terminated: ok {rc=0} 23:43:57.452066 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 23:43:58.593320 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:43:58.607933 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:43:58.656676 tst iperf3m4.py: using LAC 24492 23:43:58.773637 tst iperf3m4.py: using RAC 12 23:43:58.890697 tst iperf3m4.py: using CellId 24492 23:43:59.008339 tst iperf3m4.py: using BVCI 24493 23:43:59.115891 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:43:59.126898 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:43:59.137643 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:43:59.148637 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:43:59.159441 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:43:59.170364 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:43:59.181263 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:43:59.191973 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:43:59.202823 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:43:59.320154 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:43:59.442248 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:43:59.560696 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:43:59.675313 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:43:59.875755 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:44:00.174246 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31123): Launched 23:44:00.432390 run iperf3-srv_10.42.42.10(pid=31124): Launched 23:44:00.543716 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:44:00.742976 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:44:01.069140 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31125): Launched 23:44:01.344181 run iperf3-srv_10.42.42.10(pid=31126): Launched 23:44:01.475006 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:44:01.699044 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:44:02.033719 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31127): Launched 23:44:02.323415 run iperf3-srv_10.42.42.10(pid=31128): Launched 23:44:02.443708 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:44:02.659733 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:44:02.980759 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31129): Launched 23:44:03.257715 run iperf3-srv_10.42.42.10(pid=31130): Launched 23:44:03.377504 tst iperf3m4.py:8: start network... 23:44:03.593421 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:44:04.087768 run create_hlr_db(pid=31131): Launched 23:44:04.208839 bus /gobi_6: Setting Powered False 23:44:05.271847 run create_hlr_db(pid=31131): Terminated: ok {rc=0} 23:44:05.716408 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31133): Launched 23:44:06.034567 run osmo-hlr_10.42.42.2(pid=31134): Launched 23:44:06.155812 run osmo-stp_10.42.42.5: Starting osmo-stp 23:44:06.710055 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31136): Launched 23:44:07.029187 run osmo-stp_10.42.42.5(pid=31137): Launched 23:44:07.151153 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:44:07.701662 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31139): Launched 23:44:07.823991 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:44:08.094730 run patchelf(pid=31140): Launched 23:44:08.271564 run osmo-stp_10.42.42.5(pid=31137): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31137)] 23:44:08.406713 run osmo-stp_10.42.42.5(pid=31137): stdout: | (launched: 2022-12-09_23:44:06.971432) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:44:08.543700 run osmo-stp_10.42.42.5(pid=31137): stderr: | 20221209234407163 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234407163 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234407164 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234407164 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234407166 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234407166 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234407167 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:44:08.681177 run osmo-stp_10.42.42.5(pid=31137): stdout: | (launched: 2022-12-09_23:44:06.971432) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:44:08.812215 run osmo-stp_10.42.42.5(pid=31137): stderr: | 20221209234407163 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234407163 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234407164 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234407164 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234407166 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234407166 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234407167 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:44:08.967416 run patchelf(pid=31140): Terminating (SIGINT) 23:44:09.146509 run patchelf(pid=31140): Terminated: ok {rc=0} 23:44:09.276092 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31137): Process ended prematurely: osmo-stp_10.42.42.5(pid=31137) [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31137)] [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8] 23:44:09.286372 tst iperf3m4.py:8: Test FAILED (10.7 sec) 23:44:09.315528 run osmo-hlr_10.42.42.2(pid=31134): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31134)] 23:44:09.365582 run osmo-hlr_10.42.42.2(pid=31134): stdout: | (launched: 2022-12-09_23:44:05.977220) 23:44:09.417436 run osmo-hlr_10.42.42.2(pid=31134): stderr: | 20221209234406176 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209234406176 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209234406176 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209234406176 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209234406176 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209234406176 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209234406189 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209234406197 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209234406197 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209234406197 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:44:09.469686 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31123): Terminating (SIGTERM) 23:44:09.511407 run iperf3-srv_10.42.42.10(pid=31124): Terminating (SIGTERM) 23:44:09.553274 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31125): Terminating (SIGTERM) 23:44:09.595122 run iperf3-srv_10.42.42.10(pid=31126): Terminating (SIGTERM) 23:44:09.636619 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31127): Terminating (SIGTERM) 23:44:09.678461 run iperf3-srv_10.42.42.10(pid=31128): Terminating (SIGTERM) 23:44:09.719956 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31129): Terminating (SIGTERM) 23:44:09.761510 run iperf3-srv_10.42.42.10(pid=31130): Terminating (SIGTERM) 23:44:09.802976 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31133): Terminating (SIGTERM) 23:44:09.844889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31136): Terminating (SIGTERM) 23:44:09.886822 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31139): Terminating (SIGTERM) 23:44:09.928636 --- ParallelTerminationStrategy: PID 31123 died... 23:44:09.948433 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31123): Terminated: ok {rc=0} 23:44:09.994742 --- ParallelTerminationStrategy: PID 31124 died... 23:44:10.013934 run iperf3-srv_10.42.42.10(pid=31124): Terminated {rc=256} 23:44:10.059738 --- ParallelTerminationStrategy: PID 31125 died... 23:44:10.079078 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31125): Terminated: ok {rc=0} 23:44:10.124938 --- ParallelTerminationStrategy: PID 31126 died... 23:44:10.144254 run iperf3-srv_10.42.42.10(pid=31126): Terminated {rc=256} 23:44:10.190187 --- ParallelTerminationStrategy: PID 31127 died... 23:44:10.209592 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31127): Terminated: ok {rc=0} 23:44:10.255804 --- ParallelTerminationStrategy: PID 31128 died... 23:44:10.275229 run iperf3-srv_10.42.42.10(pid=31128): Terminated {rc=256} 23:44:10.321449 --- ParallelTerminationStrategy: PID 31129 died... 23:44:10.340888 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31129): Terminated: ok {rc=0} 23:44:10.387069 --- ParallelTerminationStrategy: PID 31130 died... 23:44:10.406589 run iperf3-srv_10.42.42.10(pid=31130): Terminated {rc=256} 23:44:10.452454 --- ParallelTerminationStrategy: PID 31133 died... 23:44:10.471704 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31133): Terminated: ok {rc=0} 23:44:10.517772 --- ParallelTerminationStrategy: PID 31136 died... 23:44:10.537203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31136): Terminated: ok {rc=0} 23:44:10.583005 --- ParallelTerminationStrategy: PID 31139 died... 23:44:10.602448 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31139): Terminated: ok {rc=0} 23:44:10.689460 bus /gobi_4: Setting Powered False 23:44:11.788168 bus /gobi_4: Setting Powered False 23:44:12.903380 bus /gobi_1: Setting Powered False 23:44:14.001838 bus /gobi_1: Setting Powered False 23:44:15.116903 bus /gobi_0: Setting Powered False 23:44:16.229290 bus /gobi_0: Setting Powered False 23:44:17.347194 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-sysmocell5000+mod-bts0-egprs ping.py ---------------------------------------------- 23:44:18.448691 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:18.461165 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:44:18.514640 tst ping.py: using LAC 24493 23:44:18.639240 tst ping.py: using RAC 13 23:44:18.763910 tst ping.py: using CellId 24493 23:44:18.887594 tst ping.py: using BVCI 24494 23:44:19.001827 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:19.013313 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:19.024547 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:19.036032 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:19.047329 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:19.058742 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:19.070467 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:19.082064 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:44:19.196618 tst ping.py:19: start network... 23:44:19.394375 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:44:19.846209 run create_hlr_db(pid=31141): Launched 23:44:19.965917 bus /gobi_6: Setting Powered False 23:44:21.024579 run create_hlr_db(pid=31141): Terminated: ok {rc=0} 23:44:21.433885 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31143): Launched 23:44:21.725233 run osmo-hlr_10.42.42.2(pid=31144): Launched 23:44:21.836155 run osmo-stp_10.42.42.5: Starting osmo-stp 23:44:22.340526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31146): Launched 23:44:22.630379 run osmo-stp_10.42.42.5(pid=31147): Launched 23:44:22.740784 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:44:23.243863 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31149): Launched 23:44:23.356371 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:44:23.603247 run patchelf(pid=31150): Launched 23:44:23.765239 run osmo-stp_10.42.42.5(pid=31147): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31147)] 23:44:23.889374 run osmo-stp_10.42.42.5(pid=31147): stdout: | (launched: 2022-12-09_23:44:22.577509) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:44:24.014618 run osmo-stp_10.42.42.5(pid=31147): stderr: | 20221209234422746 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234422747 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234422747 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234422747 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234422748 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234422748 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234422748 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:44:24.139914 run osmo-stp_10.42.42.5(pid=31147): stdout: | (launched: 2022-12-09_23:44:22.577509) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:44:24.259706 run osmo-stp_10.42.42.5(pid=31147): stderr: | 20221209234422746 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234422747 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234422747 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234422747 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234422748 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234422748 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234422748 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:44:24.401554 run patchelf(pid=31150): Terminating (SIGINT) 23:44:24.565594 run patchelf(pid=31150): Terminated: ok {rc=0} 23:44:24.683382 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=31147): Process ended prematurely: osmo-stp_10.42.42.5(pid=31147) [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31147)] [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22] 23:44:24.692201 tst ping.py:22: Test FAILED (6.2 sec) 23:44:24.718523 run osmo-hlr_10.42.42.2(pid=31144): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31144)] 23:44:24.765169 run osmo-hlr_10.42.42.2(pid=31144): stdout: | (launched: 2022-12-09_23:44:21.672026) 23:44:24.813954 run osmo-hlr_10.42.42.2(pid=31144): stderr: | 20221209234421849 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209234421849 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209234421849 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209234421849 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209234421849 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209234421849 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209234421861 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-sysmocell5000+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209234421870 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209234421870 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209234421870 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:44:24.863075 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31143): Terminating (SIGTERM) 23:44:24.902209 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31146): Terminating (SIGTERM) 23:44:24.941373 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31149): Terminating (SIGTERM) 23:44:24.981446 --- ParallelTerminationStrategy: PID 31143 died... 23:44:25.000166 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31143): Terminated: ok {rc=0} 23:44:25.044385 --- ParallelTerminationStrategy: PID 31146 died... 23:44:25.063007 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31146): Terminated: ok {rc=0} 23:44:25.106839 --- ParallelTerminationStrategy: PID 31149 died... 23:44:25.125247 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31149): Terminated: ok {rc=0} 23:44:25.210420 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-sysmocell5000+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 23:44:26.298704 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:26.310943 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:44:26.363178 tst ping_idle_ping.py: using LAC 24494 23:44:26.480549 tst ping_idle_ping.py: using RAC 14 23:44:26.595730 tst ping_idle_ping.py: using CellId 24494 23:44:26.716341 tst ping_idle_ping.py: using BVCI 24495 23:44:26.823893 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:26.835098 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:26.845977 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:26.856717 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:26.867414 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:26.878130 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:26.889091 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:44:26.899823 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:44:27.011872 tst ping_idle_ping.py:24: start network... 23:44:27.207898 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:44:27.665475 run create_hlr_db(pid=31151): Launched 23:44:27.786253 bus /gobi_6: Setting Powered False 23:44:28.846330 run create_hlr_db(pid=31151): Terminated: ok {rc=0} 23:44:29.278145 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31153): Launched 23:44:29.596183 run osmo-hlr_10.42.42.2(pid=31154): Launched 23:44:29.722268 run osmo-stp_10.42.42.5: Starting osmo-stp 23:44:30.264838 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31156): Launched 23:44:30.577850 run osmo-stp_10.42.42.5(pid=31157): Launched 23:44:30.697931 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:44:31.291276 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31159): Launched 23:44:31.462095 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:44:31.770278 run patchelf(pid=31160): Launched 23:44:31.953327 run osmo-stp_10.42.42.5(pid=31157): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31157)] 23:44:32.082374 run osmo-stp_10.42.42.5(pid=31157): stdout: | (launched: 2022-12-09_23:44:30.521065) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:44:32.212078 run osmo-stp_10.42.42.5(pid=31157): stderr: | 20221209234430711 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234430712 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234430712 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234430713 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234430713 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234430713 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234430713 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:44:32.338774 run osmo-stp_10.42.42.5(pid=31157): stdout: | (launched: 2022-12-09_23:44:30.521065) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:44:32.459623 run osmo-stp_10.42.42.5(pid=31157): stderr: | 20221209234430711 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234430712 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234430712 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234430713 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234430713 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234430713 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234430713 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:44:32.602582 run patchelf(pid=31160): Terminating (SIGINT) 23:44:32.767993 run patchelf(pid=31160): Terminated: ok {rc=0} 23:44:32.887117 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=31157): Process ended prematurely: osmo-stp_10.42.42.5(pid=31157) [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31157)] [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27] 23:44:32.896239 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 23:44:32.922801 run osmo-hlr_10.42.42.2(pid=31154): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31154)] 23:44:32.969982 run osmo-hlr_10.42.42.2(pid=31154): stdout: | (launched: 2022-12-09_23:44:29.536006) 23:44:33.019038 run osmo-hlr_10.42.42.2(pid=31154): stderr: | 20221209234429743 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209234429744 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209234429744 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209234429744 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209234429744 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209234429744 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209234429755 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-sysmocell5000+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209234429763 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209234429764 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209234429764 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:44:33.068158 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31153): Terminating (SIGTERM) 23:44:33.107985 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31156): Terminating (SIGTERM) 23:44:33.147787 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31159): Terminating (SIGTERM) 23:44:33.187665 --- ParallelTerminationStrategy: PID 31153 died... 23:44:33.206718 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31153): Terminated: ok {rc=0} 23:44:33.250897 --- ParallelTerminationStrategy: PID 31156 died... 23:44:33.269527 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31156): Terminated: ok {rc=0} 23:44:33.313767 --- ParallelTerminationStrategy: PID 31159 died... 23:44:33.332213 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31159): Terminated: ok {rc=0} 23:44:33.417261 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2366 gprs:trx-sysmocell5000+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa --------------------------------------------------------------------- 23:44:34.726340 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:44:34.733976 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 23:44:34.767797 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 23:44:34.805900 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 23:44:34.891834 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 23:44:34.924679 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 23:44:34.962320 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 23:44:35.561054 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2366 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 23:44:35.608653 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:44:35.619701 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:44:35.690806 tst cs_paging_gprs_active.py: using LAC 24495 23:44:35.808081 tst cs_paging_gprs_active.py: using RAC 15 23:44:35.926517 tst cs_paging_gprs_active.py: using CellId 24495 23:44:36.045184 tst cs_paging_gprs_active.py: using BVCI 24496 23:44:36.151973 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:44:36.163024 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:44:36.173890 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:44:36.184649 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:44:36.195550 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:44:36.206361 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:44:36.217271 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:44:36.227951 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:44:36.238920 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:44:36.356679 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:44:36.475420 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:44:36.675776 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:44:36.973723 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31166): Launched 23:44:37.233282 run iperf3-srv_10.42.42.10(pid=31167): Launched 23:44:37.344655 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:44:37.545265 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:44:37.843166 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31168): Launched 23:44:38.101565 run iperf3-srv_10.42.42.10(pid=31169): Launched 23:44:38.212928 tst cs_paging_gprs_active.py:38: start network... 23:44:38.412998 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:44:38.875277 run create_hlr_db(pid=31170): Launched 23:44:38.996539 bus /gobi_6: Setting Powered False 23:44:40.056230 run create_hlr_db(pid=31170): Terminated: ok {rc=0} 23:44:40.470332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31172): Launched 23:44:40.767289 run osmo-hlr_10.42.42.2(pid=31173): Launched 23:44:40.880497 run osmo-stp_10.42.42.5: Starting osmo-stp 23:44:41.390318 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31175): Launched 23:44:41.687223 run osmo-stp_10.42.42.5(pid=31176): Launched 23:44:41.800600 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:44:42.313132 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31178): Launched 23:44:42.426614 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:44:42.677335 run patchelf(pid=31179): Launched 23:44:42.842698 run osmo-stp_10.42.42.5(pid=31176): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31176)] 23:44:42.968538 run osmo-stp_10.42.42.5(pid=31176): stdout: | (launched: 2022-12-09_23:44:41.633067) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:44:43.096207 run osmo-stp_10.42.42.5(pid=31176): stderr: | 20221209234441803 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234441804 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234441804 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234441804 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234441805 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234441805 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234441805 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:44:43.224192 run osmo-stp_10.42.42.5(pid=31176): stdout: | (launched: 2022-12-09_23:44:41.633067) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:44:43.345984 run osmo-stp_10.42.42.5(pid=31176): stderr: | 20221209234441803 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234441804 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234441804 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234441804 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234441805 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234441805 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234441805 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:44:43.490378 run patchelf(pid=31179): Terminating (SIGINT) 23:44:43.658313 run patchelf(pid=31179): Terminated: ok {rc=0} 23:44:43.778627 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=31176): Process ended prematurely: osmo-stp_10.42.42.5(pid=31176) [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31176)] [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 23:44:43.787967 tst cs_paging_gprs_active.py:38: Test FAILED (8.2 sec) 23:44:43.814519 run osmo-hlr_10.42.42.2(pid=31173): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31173)] 23:44:43.862213 run osmo-hlr_10.42.42.2(pid=31173): stdout: | (launched: 2022-12-09_23:44:40.713148) 23:44:43.910899 run osmo-hlr_10.42.42.2(pid=31173): stderr: | 20221209234440890 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209234440890 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209234440890 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209234440890 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209234440890 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209234440890 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209234440902 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209234440913 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209234440914 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209234440914 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:44:43.960157 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31166): Terminating (SIGTERM) 23:44:43.999470 run iperf3-srv_10.42.42.10(pid=31167): Terminating (SIGTERM) 23:44:44.038604 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31168): Terminating (SIGTERM) 23:44:44.077978 run iperf3-srv_10.42.42.10(pid=31169): Terminating (SIGTERM) 23:44:44.117393 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31172): Terminating (SIGTERM) 23:44:44.156865 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31175): Terminating (SIGTERM) 23:44:44.196452 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31178): Terminating (SIGTERM) 23:44:44.236171 --- ParallelTerminationStrategy: PID 31166 died... 23:44:44.254819 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31166): Terminated: ok {rc=0} 23:44:44.298322 --- ParallelTerminationStrategy: PID 31167 died... 23:44:44.316494 run iperf3-srv_10.42.42.10(pid=31167): Terminated {rc=256} 23:44:44.361383 --- ParallelTerminationStrategy: PID 31168 died... 23:44:44.379893 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31168): Terminated: ok {rc=0} 23:44:44.423182 --- ParallelTerminationStrategy: PID 31169 died... 23:44:44.441588 run iperf3-srv_10.42.42.10(pid=31169): Terminated {rc=256} 23:44:44.484842 --- ParallelTerminationStrategy: PID 31172 died... 23:44:44.503358 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31172): Terminated: ok {rc=0} 23:44:44.546645 --- ParallelTerminationStrategy: PID 31175 died... 23:44:44.565255 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31175): Terminated: ok {rc=0} 23:44:44.608692 --- ParallelTerminationStrategy: PID 31178 died... 23:44:44.627305 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31178): Terminated: ok {rc=0} 23:44:44.711905 bus /gobi_0: Setting Powered False 23:44:45.810981 bus /gobi_0: Setting Powered False 23:44:46.927036 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 23:44:48.093456 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:44:48.105766 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:44:48.181079 tst iperf3.py: using LAC 24496 23:44:48.305922 tst iperf3.py: using RAC 16 23:44:48.432283 tst iperf3.py: using CellId 24496 23:44:48.556915 tst iperf3.py: using BVCI 24497 23:44:48.674778 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:44:48.686418 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:44:48.697828 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:44:48.709492 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:44:48.721134 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:44:48.732605 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:44:48.744442 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:44:48.755996 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:44:48.767821 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:44:48.885698 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:44:49.085596 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:44:49.382541 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31180): Launched 23:44:49.641130 run iperf3-srv_10.42.42.10(pid=31181): Launched 23:44:49.751797 tst iperf3.py:8: start network... 23:44:49.950247 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:44:50.409656 run create_hlr_db(pid=31182): Launched 23:44:50.532831 bus /gobi_6: Setting Powered False 23:44:51.592847 run create_hlr_db(pid=31182): Terminated: ok {rc=0} 23:44:52.008482 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31184): Launched 23:44:52.305696 run osmo-hlr_10.42.42.2(pid=31185): Launched 23:44:52.419088 run osmo-stp_10.42.42.5: Starting osmo-stp 23:44:52.930742 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31187): Launched 23:44:53.226596 run osmo-stp_10.42.42.5(pid=31188): Launched 23:44:53.339763 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:44:53.851639 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31190): Launched 23:44:53.964772 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:44:54.215946 run patchelf(pid=31191): Launched 23:44:54.380885 run osmo-stp_10.42.42.5(pid=31188): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31188)] 23:44:54.506774 run osmo-stp_10.42.42.5(pid=31188): stdout: | (launched: 2022-12-09_23:44:53.172394) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:44:54.635436 run osmo-stp_10.42.42.5(pid=31188): stderr: | 20221209234453341 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234453341 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234453341 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234453342 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234453342 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234453342 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234453342 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:44:54.763597 run osmo-stp_10.42.42.5(pid=31188): stdout: | (launched: 2022-12-09_23:44:53.172394) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:44:54.885738 run osmo-stp_10.42.42.5(pid=31188): stderr: | 20221209234453341 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234453341 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234453341 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234453342 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234453342 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234453342 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234453342 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:44:55.030240 run patchelf(pid=31191): Terminating (SIGINT) 23:44:55.198113 run patchelf(pid=31191): Terminated: ok {rc=0} 23:44:55.319072 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31188): Process ended prematurely: osmo-stp_10.42.42.5(pid=31188) [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31188)] [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8] 23:44:55.328396 tst iperf3.py:8: Test FAILED (7.3 sec) 23:44:55.355154 run osmo-hlr_10.42.42.2(pid=31185): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31185)] 23:44:55.402251 run osmo-hlr_10.42.42.2(pid=31185): stdout: | (launched: 2022-12-09_23:44:52.251637) 23:44:55.450977 run osmo-hlr_10.42.42.2(pid=31185): stderr: | 20221209234452427 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209234452428 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209234452428 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209234452428 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209234452428 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209234452428 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209234452440 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209234452449 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209234452449 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209234452449 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:44:55.500330 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31180): Terminating (SIGTERM) 23:44:55.539747 run iperf3-srv_10.42.42.10(pid=31181): Terminating (SIGTERM) 23:44:55.578893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31184): Terminating (SIGTERM) 23:44:55.618468 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31187): Terminating (SIGTERM) 23:44:55.657737 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31190): Terminating (SIGTERM) 23:44:55.697139 --- ParallelTerminationStrategy: PID 31180 died... 23:44:55.715490 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31180): Terminated: ok {rc=0} 23:44:55.758961 --- ParallelTerminationStrategy: PID 31181 died... 23:44:55.777379 run iperf3-srv_10.42.42.10(pid=31181): Terminated {rc=256} 23:44:55.820497 --- ParallelTerminationStrategy: PID 31184 died... 23:44:55.838871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31184): Terminated: ok {rc=0} 23:44:55.881967 --- ParallelTerminationStrategy: PID 31187 died... 23:44:55.900494 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31187): Terminated: ok {rc=0} 23:44:55.943461 --- ParallelTerminationStrategy: PID 31190 died... 23:44:55.961842 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31190): Terminated: ok {rc=0} 23:44:56.046590 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 23:44:57.193742 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:44:57.205484 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:44:57.276558 tst iperf3m4.py: using LAC 24497 23:44:57.395445 tst iperf3m4.py: using RAC 17 23:44:57.514286 tst iperf3m4.py: using CellId 24497 23:44:57.642341 tst iperf3m4.py: using BVCI 24498 23:44:57.750672 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:44:57.762030 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:44:57.773060 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:44:57.783868 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:44:57.794858 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:44:57.806019 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:44:57.817246 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:44:57.827954 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:44:57.838974 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:44:57.958199 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:44:58.081408 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:44:58.199393 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:44:58.315900 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:44:58.515987 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:44:58.814392 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31192): Launched 23:44:59.072732 run iperf3-srv_10.42.42.10(pid=31193): Launched 23:44:59.184041 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:44:59.383234 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:44:59.681844 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31194): Launched 23:44:59.940300 run iperf3-srv_10.42.42.10(pid=31195): Launched 23:45:00.051781 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:45:00.251393 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:45:00.549878 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31196): Launched 23:45:00.807867 run iperf3-srv_10.42.42.10(pid=31197): Launched 23:45:00.952791 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:45:01.198454 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:45:01.508234 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31198): Launched 23:45:01.811177 run iperf3-srv_10.42.42.10(pid=31202): Launched 23:45:01.967856 tst iperf3m4.py:8: start network... 23:45:02.172191 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:45:02.636080 run create_hlr_db(pid=31203): Launched 23:45:02.758306 bus /gobi_6: Setting Powered False 23:45:03.817683 run create_hlr_db(pid=31203): Terminated: ok {rc=0} 23:45:04.233358 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31205): Launched 23:45:04.531078 run osmo-hlr_10.42.42.2(pid=31206): Launched 23:45:04.644058 run osmo-stp_10.42.42.5: Starting osmo-stp 23:45:05.172869 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31208): Launched 23:45:05.469229 run osmo-stp_10.42.42.5(pid=31209): Launched 23:45:05.582735 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:45:06.095846 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31211): Launched 23:45:06.209504 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:45:06.461568 run patchelf(pid=31212): Launched 23:45:06.627358 run osmo-stp_10.42.42.5(pid=31209): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31209)] 23:45:06.753500 run osmo-stp_10.42.42.5(pid=31209): stdout: | (launched: 2022-12-09_23:45:05.415006) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:45:06.882077 run osmo-stp_10.42.42.5(pid=31209): stderr: | 20221209234505585 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234505585 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234505585 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234505586 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234505586 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234505586 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234505586 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:45:07.010427 run osmo-stp_10.42.42.5(pid=31209): stdout: | (launched: 2022-12-09_23:45:05.415006) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:45:07.132863 run osmo-stp_10.42.42.5(pid=31209): stderr: | 20221209234505585 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234505585 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234505585 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234505586 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234505586 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234505586 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234505586 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:45:07.277696 run patchelf(pid=31212): Terminating (SIGINT) 23:45:07.445542 run patchelf(pid=31212): Terminated: ok {rc=0} 23:45:07.566495 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31209): Process ended prematurely: osmo-stp_10.42.42.5(pid=31209) [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31209)] [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8] 23:45:07.575994 tst iperf3m4.py:8: Test FAILED (10.4 sec) 23:45:07.603108 run osmo-hlr_10.42.42.2(pid=31206): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31206)] 23:45:07.650739 run osmo-hlr_10.42.42.2(pid=31206): stdout: | (launched: 2022-12-09_23:45:04.476842) 23:45:07.699836 run osmo-hlr_10.42.42.2(pid=31206): stderr: | 20221209234504654 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209234504654 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209234504654 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209234504654 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209234504654 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209234504654 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209234504667 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209234504676 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209234504676 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209234504676 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:45:07.749271 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31192): Terminating (SIGTERM) 23:45:07.788295 run iperf3-srv_10.42.42.10(pid=31193): Terminating (SIGTERM) 23:45:07.827365 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31194): Terminating (SIGTERM) 23:45:07.866535 run iperf3-srv_10.42.42.10(pid=31195): Terminating (SIGTERM) 23:45:07.905511 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31196): Terminating (SIGTERM) 23:45:07.944585 run iperf3-srv_10.42.42.10(pid=31197): Terminating (SIGTERM) 23:45:07.983502 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31198): Terminating (SIGTERM) 23:45:08.022593 run iperf3-srv_10.42.42.10(pid=31202): Terminating (SIGTERM) 23:45:08.061634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31205): Terminating (SIGTERM) 23:45:08.100664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31208): Terminating (SIGTERM) 23:45:08.139699 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31211): Terminating (SIGTERM) 23:45:08.178852 --- ParallelTerminationStrategy: PID 31192 died... 23:45:08.197598 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31192): Terminated: ok {rc=0} 23:45:08.241091 --- ParallelTerminationStrategy: PID 31193 died... 23:45:08.259553 run iperf3-srv_10.42.42.10(pid=31193): Terminated {rc=256} 23:45:08.302729 --- ParallelTerminationStrategy: PID 31194 died... 23:45:08.321140 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31194): Terminated: ok {rc=0} 23:45:08.364312 --- ParallelTerminationStrategy: PID 31195 died... 23:45:08.382668 run iperf3-srv_10.42.42.10(pid=31195): Terminated {rc=256} 23:45:08.425637 --- ParallelTerminationStrategy: PID 31196 died... 23:45:08.443998 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31196): Terminated: ok {rc=0} 23:45:08.486980 --- ParallelTerminationStrategy: PID 31197 died... 23:45:08.505302 run iperf3-srv_10.42.42.10(pid=31197): Terminated {rc=256} 23:45:08.548218 --- ParallelTerminationStrategy: PID 31198 died... 23:45:08.566693 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31198): Terminated: ok {rc=0} 23:45:08.610356 --- ParallelTerminationStrategy: PID 31202 died... 23:45:08.628636 run iperf3-srv_10.42.42.10(pid=31202): Terminated {rc=256} 23:45:08.671686 --- ParallelTerminationStrategy: PID 31205 died... 23:45:08.690049 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31205): Terminated: ok {rc=0} 23:45:08.733292 --- ParallelTerminationStrategy: PID 31208 died... 23:45:08.751736 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31208): Terminated: ok {rc=0} 23:45:08.794905 --- ParallelTerminationStrategy: PID 31211 died... 23:45:08.813322 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31211): Terminated: ok {rc=0} 23:45:08.897507 bus /gobi_4: Setting Powered False 23:45:09.996609 bus /gobi_4: Setting Powered False 23:45:11.111794 bus /gobi_1: Setting Powered False 23:45:12.210628 bus /gobi_1: Setting Powered False 23:45:13.323657 bus /gobi_0: Setting Powered False 23:45:14.420691 bus /gobi_0: Setting Powered False 23:45:15.537375 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 23:45:16.641272 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:16.654604 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:45:16.731274 tst ping.py: using LAC 24498 23:45:16.847330 tst ping.py: using RAC 18 23:45:16.966260 tst ping.py: using CellId 24498 23:45:17.082207 tst ping.py: using BVCI 24499 23:45:17.192590 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:17.204197 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:17.215633 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:17.227064 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:17.238251 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:17.249594 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:17.261561 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:17.273256 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:45:17.390957 tst ping.py:19: start network... 23:45:17.602970 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:45:18.089159 run create_hlr_db(pid=31213): Launched 23:45:18.207972 bus /gobi_6: Setting Powered False 23:45:19.270899 run create_hlr_db(pid=31213): Terminated: ok {rc=0} 23:45:19.707673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31215): Launched 23:45:20.021035 run osmo-hlr_10.42.42.2(pid=31216): Launched 23:45:20.141789 run osmo-stp_10.42.42.5: Starting osmo-stp 23:45:20.656048 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31218): Launched 23:45:20.947477 run osmo-stp_10.42.42.5(pid=31219): Launched 23:45:21.058708 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:45:21.561973 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31221): Launched 23:45:21.673182 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:45:21.920300 run patchelf(pid=31222): Launched 23:45:22.082587 run osmo-stp_10.42.42.5(pid=31219): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31219)] 23:45:22.206334 run osmo-stp_10.42.42.5(pid=31219): stdout: | (launched: 2022-12-09_23:45:20.894152) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:45:22.332120 run osmo-stp_10.42.42.5(pid=31219): stderr: | 20221209234521063 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234521063 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234521063 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234521064 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234521064 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234521064 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234521064 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:45:22.457664 run osmo-stp_10.42.42.5(pid=31219): stdout: | (launched: 2022-12-09_23:45:20.894152) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:45:22.577581 run osmo-stp_10.42.42.5(pid=31219): stderr: | 20221209234521063 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234521063 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234521063 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234521064 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234521064 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234521064 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234521064 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:45:22.719317 run patchelf(pid=31222): Terminating (SIGINT) 23:45:22.883315 run patchelf(pid=31222): Terminated: ok {rc=0} 23:45:23.001910 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=31219): Process ended prematurely: osmo-stp_10.42.42.5(pid=31219) [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31219)] [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22] 23:45:23.010673 tst ping.py:22: Test FAILED (6.4 sec) 23:45:23.037033 run osmo-hlr_10.42.42.2(pid=31216): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31216)] 23:45:23.084424 run osmo-hlr_10.42.42.2(pid=31216): stdout: | (launched: 2022-12-09_23:45:19.964190) 23:45:23.133376 run osmo-hlr_10.42.42.2(pid=31216): stderr: | 20221209234520161 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209234520161 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209234520161 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209234520161 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209234520161 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209234520161 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209234520177 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209234520186 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209234520186 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209234520187 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:45:23.182492 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31215): Terminating (SIGTERM) 23:45:23.221761 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31218): Terminating (SIGTERM) 23:45:23.261295 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31221): Terminating (SIGTERM) 23:45:23.301254 --- ParallelTerminationStrategy: PID 31215 died... 23:45:23.319997 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31215): Terminated: ok {rc=0} 23:45:23.363202 --- ParallelTerminationStrategy: PID 31218 died... 23:45:23.381630 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31218): Terminated: ok {rc=0} 23:45:23.424709 --- ParallelTerminationStrategy: PID 31221 died... 23:45:23.443085 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31221): Terminated: ok {rc=0} 23:45:23.528097 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 23:45:24.616052 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:24.628207 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:45:24.703762 tst ping_idle_ping.py: using LAC 24499 23:45:24.819332 tst ping_idle_ping.py: using RAC 19 23:45:24.932563 tst ping_idle_ping.py: using CellId 24499 23:45:25.046242 tst ping_idle_ping.py: using BVCI 24500 23:45:25.152392 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:25.163441 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:25.174278 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:25.185022 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:25.195706 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:25.206580 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:25.217461 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:45:25.228179 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:45:25.345340 tst ping_idle_ping.py:24: start network... 23:45:25.559135 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:45:26.054770 run create_hlr_db(pid=31223): Launched 23:45:26.175189 bus /gobi_6: Setting Powered False 23:45:27.237820 run create_hlr_db(pid=31223): Terminated: ok {rc=0} 23:45:27.675954 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31225): Launched 23:45:27.990081 run osmo-hlr_10.42.42.2(pid=31226): Launched 23:45:28.110383 run osmo-stp_10.42.42.5: Starting osmo-stp 23:45:28.650353 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31228): Launched 23:45:28.961569 run osmo-stp_10.42.42.5(pid=31229): Launched 23:45:29.082160 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:45:29.624284 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31231): Launched 23:45:29.740406 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:45:29.988900 run patchelf(pid=31232): Launched 23:45:30.151319 run osmo-stp_10.42.42.5(pid=31229): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31229)] 23:45:30.275048 run osmo-stp_10.42.42.5(pid=31229): stdout: | (launched: 2022-12-09_23:45:28.905131) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:45:30.401223 run osmo-stp_10.42.42.5(pid=31229): stderr: | 20221209234529095 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234529095 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234529096 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234529096 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234529097 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234529097 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234529097 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:45:30.527269 run osmo-stp_10.42.42.5(pid=31229): stdout: | (launched: 2022-12-09_23:45:28.905131) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:45:30.647476 run osmo-stp_10.42.42.5(pid=31229): stderr: | 20221209234529095 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234529095 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234529096 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234529096 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234529097 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234529097 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234529097 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:45:30.789857 run patchelf(pid=31232): Terminating (SIGINT) 23:45:30.963246 run patchelf(pid=31232): Terminated: ok {rc=0} 23:45:31.083466 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=31229): Process ended prematurely: osmo-stp_10.42.42.5(pid=31229) [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31229)] [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 23:45:31.093075 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 23:45:31.120895 run osmo-hlr_10.42.42.2(pid=31226): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31226)] 23:45:31.169331 run osmo-hlr_10.42.42.2(pid=31226): stdout: | (launched: 2022-12-09_23:45:27.933614) 23:45:31.219688 run osmo-hlr_10.42.42.2(pid=31226): stderr: | 20221209234528130 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209234528130 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209234528130 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209234528130 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209234528130 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209234528130 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209234528143 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209234528151 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209234528151 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209234528151 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:45:31.270312 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31225): Terminating (SIGTERM) 23:45:31.311362 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31228): Terminating (SIGTERM) 23:45:31.354028 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31231): Terminating (SIGTERM) 23:45:31.397134 --- ParallelTerminationStrategy: PID 31225 died... 23:45:31.416554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31225): Terminated: ok {rc=0} 23:45:31.462361 --- ParallelTerminationStrategy: PID 31228 died... 23:45:31.481275 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31228): Terminated: ok {rc=0} 23:45:31.525571 --- ParallelTerminationStrategy: PID 31231 died... 23:45:31.544385 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31231): Terminated: ok {rc=0} 23:45:31.629175 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2366 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 23:45:32.932421 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:45:32.938654 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 23:45:32.971732 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 23:45:33.010025 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 23:45:33.095530 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 23:45:33.128620 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 23:45:33.166625 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 23:45:33.765961 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2366 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 23:45:33.814529 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:45:33.825657 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:45:33.895722 tst cs_paging_gprs_active.py: using LAC 24500 23:45:34.016725 tst cs_paging_gprs_active.py: using RAC 20 23:45:34.134551 tst cs_paging_gprs_active.py: using CellId 24500 23:45:34.250542 tst cs_paging_gprs_active.py: using BVCI 24501 23:45:34.358223 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:45:34.369186 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:45:34.380065 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:45:34.391038 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:45:34.402102 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:45:34.413019 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:45:34.424041 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:45:34.435080 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:45:34.446394 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:45:34.560647 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:45:34.677933 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:45:34.879625 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:45:35.179517 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31236): Launched 23:45:35.438118 run iperf3-srv_10.42.42.10(pid=31237): Launched 23:45:35.550411 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:45:35.750580 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:45:36.050497 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31238): Launched 23:45:36.309470 run iperf3-srv_10.42.42.10(pid=31239): Launched 23:45:36.421749 tst cs_paging_gprs_active.py:38: start network... 23:45:36.622566 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:45:37.084618 run create_hlr_db(pid=31240): Launched 23:45:37.206030 bus /gobi_6: Setting Powered False 23:45:38.265442 run create_hlr_db(pid=31240): Terminated: ok {rc=0} 23:45:38.701701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31242): Launched 23:45:39.020462 run osmo-hlr_10.42.42.2(pid=31243): Launched 23:45:39.142497 run osmo-stp_10.42.42.5: Starting osmo-stp 23:45:39.694344 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31245): Launched 23:45:40.015090 run osmo-stp_10.42.42.5(pid=31246): Launched 23:45:40.137052 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:45:40.686749 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31248): Launched 23:45:40.809510 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:45:41.078773 run patchelf(pid=31249): Launched 23:45:41.255791 run osmo-stp_10.42.42.5(pid=31246): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31246)] 23:45:41.390731 run osmo-stp_10.42.42.5(pid=31246): stdout: | (launched: 2022-12-09_23:45:39.957123) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:45:41.527959 run osmo-stp_10.42.42.5(pid=31246): stderr: | 20221209234540147 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234540148 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234540148 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234540148 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234540150 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234540151 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234540151 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:45:41.665284 run osmo-stp_10.42.42.5(pid=31246): stdout: | (launched: 2022-12-09_23:45:39.957123) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:45:41.796158 run osmo-stp_10.42.42.5(pid=31246): stderr: | 20221209234540147 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234540148 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234540148 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234540148 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234540150 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234540151 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234540151 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:45:41.952017 run patchelf(pid=31249): Terminating (SIGINT) 23:45:42.131762 run patchelf(pid=31249): Terminated: ok {rc=0} 23:45:42.261095 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=31246): Process ended prematurely: osmo-stp_10.42.42.5(pid=31246) [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31246)] [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 23:45:42.271243 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 23:45:42.300164 run osmo-hlr_10.42.42.2(pid=31243): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31243)] 23:45:42.350035 run osmo-hlr_10.42.42.2(pid=31243): stdout: | (launched: 2022-12-09_23:45:38.962763) 23:45:42.401839 run osmo-hlr_10.42.42.2(pid=31243): stderr: | 20221209234539158 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209234539158 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209234539158 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209234539158 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209234539158 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209234539158 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209234539169 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209234539178 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209234539178 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209234539178 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:45:42.453770 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31236): Terminating (SIGTERM) 23:45:42.495558 run iperf3-srv_10.42.42.10(pid=31237): Terminating (SIGTERM) 23:45:42.538457 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31238): Terminating (SIGTERM) 23:45:42.580404 run iperf3-srv_10.42.42.10(pid=31239): Terminating (SIGTERM) 23:45:42.621935 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31242): Terminating (SIGTERM) 23:45:42.663438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31245): Terminating (SIGTERM) 23:45:42.704872 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31248): Terminating (SIGTERM) 23:45:42.746824 --- ParallelTerminationStrategy: PID 31236 died... 23:45:42.766646 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31236): Terminated: ok {rc=0} 23:45:42.812880 --- ParallelTerminationStrategy: PID 31237 died... 23:45:42.832167 run iperf3-srv_10.42.42.10(pid=31237): Terminated {rc=256} 23:45:42.878689 --- ParallelTerminationStrategy: PID 31238 died... 23:45:42.898162 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31238): Terminated: ok {rc=0} 23:45:42.944189 --- ParallelTerminationStrategy: PID 31239 died... 23:45:42.963528 run iperf3-srv_10.42.42.10(pid=31239): Terminated {rc=256} 23:45:43.009314 --- ParallelTerminationStrategy: PID 31242 died... 23:45:43.028666 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31242): Terminated: ok {rc=0} 23:45:43.074742 --- ParallelTerminationStrategy: PID 31245 died... 23:45:43.094028 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31245): Terminated: ok {rc=0} 23:45:43.139959 --- ParallelTerminationStrategy: PID 31248 died... 23:45:43.159393 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31248): Terminated: ok {rc=0} 23:45:43.245790 bus /gobi_0: Setting Powered False 23:45:44.343863 bus /gobi_0: Setting Powered False 23:45:45.457604 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 23:45:46.606490 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:45:46.619041 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:45:46.696394 tst iperf3.py: using LAC 24501 23:45:46.817815 tst iperf3.py: using RAC 21 23:45:46.947603 tst iperf3.py: using CellId 24501 23:45:47.064601 tst iperf3.py: using BVCI 24502 23:45:47.209598 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:45:47.223585 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:45:47.235637 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:45:47.246896 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:45:47.258862 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:45:47.271796 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:45:47.284513 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:45:47.296553 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:45:47.308112 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:45:47.427597 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:45:47.644242 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:45:47.963865 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31251): Launched 23:45:48.241309 run iperf3-srv_10.42.42.10(pid=31252): Launched 23:45:48.361015 tst iperf3.py:8: start network... 23:45:48.576625 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:45:49.070499 run create_hlr_db(pid=31253): Launched 23:45:49.191588 bus /gobi_6: Setting Powered False 23:45:50.255381 run create_hlr_db(pid=31253): Terminated: ok {rc=0} 23:45:50.682128 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31255): Launched 23:45:50.979249 run osmo-hlr_10.42.42.2(pid=31256): Launched 23:45:51.092060 run osmo-stp_10.42.42.5: Starting osmo-stp 23:45:51.622243 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31258): Launched 23:45:51.942994 run osmo-stp_10.42.42.5(pid=31259): Launched 23:45:52.066230 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:45:52.615655 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31261): Launched 23:45:52.738323 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:45:53.007724 run patchelf(pid=31262): Launched 23:45:53.184422 run osmo-stp_10.42.42.5(pid=31259): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31259)] 23:45:53.319246 run osmo-stp_10.42.42.5(pid=31259): stdout: | (launched: 2022-12-09_23:45:51.885608) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:45:53.456180 run osmo-stp_10.42.42.5(pid=31259): stderr: | 20221209234552077 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234552077 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234552077 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234552078 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234552078 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234552078 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234552078 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:45:53.593205 run osmo-stp_10.42.42.5(pid=31259): stdout: | (launched: 2022-12-09_23:45:51.885608) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:45:53.723884 run osmo-stp_10.42.42.5(pid=31259): stderr: | 20221209234552077 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234552077 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234552077 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234552078 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234552078 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234552078 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234552078 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:45:53.879180 run patchelf(pid=31262): Terminating (SIGINT) 23:45:54.058715 run patchelf(pid=31262): Terminated: ok {rc=0} 23:45:54.188106 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31259): Process ended prematurely: osmo-stp_10.42.42.5(pid=31259) [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31259)] [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8] 23:45:54.198195 tst iperf3.py:8: Test FAILED (7.6 sec) 23:45:54.227214 run osmo-hlr_10.42.42.2(pid=31256): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31256)] 23:45:54.276874 run osmo-hlr_10.42.42.2(pid=31256): stdout: | (launched: 2022-12-09_23:45:50.925802) 23:45:54.328548 run osmo-hlr_10.42.42.2(pid=31256): stderr: | 20221209234551101 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209234551101 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209234551101 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209234551101 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209234551101 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209234551101 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209234551114 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209234551123 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209234551123 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209234551123 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:45:54.380470 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31251): Terminating (SIGTERM) 23:45:54.422332 run iperf3-srv_10.42.42.10(pid=31252): Terminating (SIGTERM) 23:45:54.463756 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31255): Terminating (SIGTERM) 23:45:54.505391 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31258): Terminating (SIGTERM) 23:45:54.546755 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31261): Terminating (SIGTERM) 23:45:54.588527 --- ParallelTerminationStrategy: PID 31251 died... 23:45:54.608343 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31251): Terminated: ok {rc=0} 23:45:54.654529 --- ParallelTerminationStrategy: PID 31252 died... 23:45:54.674047 run iperf3-srv_10.42.42.10(pid=31252): Terminated {rc=256} 23:45:54.720101 --- ParallelTerminationStrategy: PID 31255 died... 23:45:54.739388 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31255): Terminated: ok {rc=0} 23:45:54.785684 --- ParallelTerminationStrategy: PID 31258 died... 23:45:54.805184 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31258): Terminated: ok {rc=0} 23:45:54.851243 --- ParallelTerminationStrategy: PID 31261 died... 23:45:54.870846 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31261): Terminated: ok {rc=0} 23:45:54.958719 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 23:45:56.113232 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:45:56.125121 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:45:56.198621 tst iperf3m4.py: using LAC 24502 23:45:56.323972 tst iperf3m4.py: using RAC 22 23:45:56.451510 tst iperf3m4.py: using CellId 24502 23:45:56.575673 tst iperf3m4.py: using BVCI 24503 23:45:56.692612 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:45:56.704089 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:45:56.715333 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:45:56.726857 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:45:56.738400 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:45:56.749885 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:45:56.761429 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:45:56.772711 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:45:56.784382 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:45:56.902308 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:45:57.025337 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:45:57.147944 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:45:57.266046 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:45:57.467124 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:45:57.767431 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31263): Launched 23:45:58.026932 run iperf3-srv_10.42.42.10(pid=31264): Launched 23:45:58.139196 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:45:58.339050 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:45:58.638364 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31265): Launched 23:45:58.897069 run iperf3-srv_10.42.42.10(pid=31266): Launched 23:45:59.008571 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:45:59.207424 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:45:59.506996 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31267): Launched 23:45:59.766309 run iperf3-srv_10.42.42.10(pid=31268): Launched 23:45:59.877603 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:46:00.077479 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:46:00.377435 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31269): Launched 23:46:00.638272 run iperf3-srv_10.42.42.10(pid=31270): Launched 23:46:00.750214 tst iperf3m4.py:8: start network... 23:46:00.968674 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:46:01.490736 run create_hlr_db(pid=31271): Launched 23:46:01.649860 bus /gobi_6: Setting Powered False 23:46:02.709348 run create_hlr_db(pid=31271): Terminated: ok {rc=0} 23:46:03.162958 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31273): Launched 23:46:03.483050 run osmo-hlr_10.42.42.2(pid=31274): Launched 23:46:03.606107 run osmo-stp_10.42.42.5: Starting osmo-stp 23:46:04.163067 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31276): Launched 23:46:04.482742 run osmo-stp_10.42.42.5(pid=31277): Launched 23:46:04.605205 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:46:05.156645 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31279): Launched 23:46:05.278929 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:46:05.549273 run patchelf(pid=31280): Launched 23:46:05.727025 run osmo-stp_10.42.42.5(pid=31277): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31277)] 23:46:05.862711 run osmo-stp_10.42.42.5(pid=31277): stdout: | (launched: 2022-12-09_23:46:04.424771) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:46:06.000444 run osmo-stp_10.42.42.5(pid=31277): stderr: | 20221209234604616 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234604616 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234604616 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234604617 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234604619 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234604619 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234604619 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:46:06.137781 run osmo-stp_10.42.42.5(pid=31277): stdout: | (launched: 2022-12-09_23:46:04.424771) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:46:06.269540 run osmo-stp_10.42.42.5(pid=31277): stderr: | 20221209234604616 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234604616 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234604616 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234604617 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234604619 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234604619 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234604619 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:46:06.425181 run patchelf(pid=31280): Terminating (SIGINT) 23:46:06.605068 run patchelf(pid=31280): Terminated: ok {rc=0} 23:46:06.734381 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31277): Process ended prematurely: osmo-stp_10.42.42.5(pid=31277) [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31277)] [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8] 23:46:06.744655 tst iperf3m4.py:8: Test FAILED (10.7 sec) 23:46:06.774356 run osmo-hlr_10.42.42.2(pid=31274): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31274)] 23:46:06.824791 run osmo-hlr_10.42.42.2(pid=31274): stdout: | (launched: 2022-12-09_23:46:03.425361) 23:46:06.877515 run osmo-hlr_10.42.42.2(pid=31274): stderr: | 20221209234603623 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209234603623 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209234603623 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209234603623 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209234603623 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209234603623 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209234603635 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209234603643 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209234603643 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209234603643 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:46:06.930233 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31263): Terminating (SIGTERM) 23:46:06.972756 run iperf3-srv_10.42.42.10(pid=31264): Terminating (SIGTERM) 23:46:07.015615 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31265): Terminating (SIGTERM) 23:46:07.057945 run iperf3-srv_10.42.42.10(pid=31266): Terminating (SIGTERM) 23:46:07.100331 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31267): Terminating (SIGTERM) 23:46:07.142582 run iperf3-srv_10.42.42.10(pid=31268): Terminating (SIGTERM) 23:46:07.184844 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31269): Terminating (SIGTERM) 23:46:07.227148 run iperf3-srv_10.42.42.10(pid=31270): Terminating (SIGTERM) 23:46:07.269420 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31273): Terminating (SIGTERM) 23:46:07.311673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31276): Terminating (SIGTERM) 23:46:07.354026 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31279): Terminating (SIGTERM) 23:46:07.396608 --- ParallelTerminationStrategy: PID 31263 died... 23:46:07.416756 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31263): Terminated: ok {rc=0} 23:46:07.463812 --- ParallelTerminationStrategy: PID 31264 died... 23:46:07.483462 run iperf3-srv_10.42.42.10(pid=31264): Terminated {rc=256} 23:46:07.529863 --- ParallelTerminationStrategy: PID 31265 died... 23:46:07.549501 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31265): Terminated: ok {rc=0} 23:46:07.596048 --- ParallelTerminationStrategy: PID 31266 died... 23:46:07.615680 run iperf3-srv_10.42.42.10(pid=31266): Terminated {rc=256} 23:46:07.662112 --- ParallelTerminationStrategy: PID 31267 died... 23:46:07.681728 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31267): Terminated: ok {rc=0} 23:46:07.728457 --- ParallelTerminationStrategy: PID 31268 died... 23:46:07.747747 run iperf3-srv_10.42.42.10(pid=31268): Terminated {rc=256} 23:46:07.794047 --- ParallelTerminationStrategy: PID 31269 died... 23:46:07.813834 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31269): Terminated: ok {rc=0} 23:46:07.860488 --- ParallelTerminationStrategy: PID 31270 died... 23:46:07.880305 run iperf3-srv_10.42.42.10(pid=31270): Terminated {rc=256} 23:46:07.926802 --- ParallelTerminationStrategy: PID 31273 died... 23:46:07.946352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31273): Terminated: ok {rc=0} 23:46:07.992748 --- ParallelTerminationStrategy: PID 31276 died... 23:46:08.012224 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31276): Terminated: ok {rc=0} 23:46:08.058551 --- ParallelTerminationStrategy: PID 31279 died... 23:46:08.078265 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31279): Terminated: ok {rc=0} 23:46:08.166452 bus /gobi_4: Setting Powered False 23:46:09.268014 bus /gobi_4: Setting Powered False 23:46:10.384060 bus /gobi_1: Setting Powered False 23:46:11.482056 bus /gobi_1: Setting Powered False 23:46:12.597121 bus /gobi_0: Setting Powered False 23:46:13.693727 bus /gobi_0: Setting Powered False 23:46:14.811014 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 23:46:15.930121 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:15.943211 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:46:16.027080 tst ping.py: using LAC 24503 23:46:16.151301 tst ping.py: using RAC 23 23:46:16.301670 tst ping.py: using CellId 24503 23:46:16.450243 tst ping.py: using BVCI 24504 23:46:16.561530 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:16.573108 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:16.585531 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:16.597808 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:16.609713 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:16.621775 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:16.633455 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:16.644901 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:46:16.762893 tst ping.py:19: start network... 23:46:16.965262 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:46:17.426159 run create_hlr_db(pid=31281): Launched 23:46:17.545937 bus /gobi_6: Setting Powered False 23:46:18.604693 run create_hlr_db(pid=31281): Terminated: ok {rc=0} 23:46:19.033362 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31283): Launched 23:46:19.346684 run osmo-hlr_10.42.42.2(pid=31284): Launched 23:46:19.466602 run osmo-stp_10.42.42.5: Starting osmo-stp 23:46:20.016850 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31286): Launched 23:46:20.328913 run osmo-stp_10.42.42.5(pid=31287): Launched 23:46:20.449075 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:46:20.989639 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31289): Launched 23:46:21.109512 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:46:21.374402 run patchelf(pid=31290): Launched 23:46:21.547861 run osmo-stp_10.42.42.5(pid=31287): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31287)] 23:46:21.680303 run osmo-stp_10.42.42.5(pid=31287): stdout: | (launched: 2022-12-09_23:46:20.272005) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:46:21.814934 run osmo-stp_10.42.42.5(pid=31287): stderr: | 20221209234620462 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234620462 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234620462 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234620462 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234620463 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234620463 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234620463 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:46:21.949994 run osmo-stp_10.42.42.5(pid=31287): stdout: | (launched: 2022-12-09_23:46:20.272005) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:46:22.078216 run osmo-stp_10.42.42.5(pid=31287): stderr: | 20221209234620462 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234620462 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234620462 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234620462 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234620463 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234620463 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234620463 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:46:22.230490 run patchelf(pid=31290): Terminating (SIGINT) 23:46:22.406208 run patchelf(pid=31290): Terminated: ok {rc=0} 23:46:22.533050 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=31287): Process ended prematurely: osmo-stp_10.42.42.5(pid=31287) [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31287)] [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22] 23:46:22.542541 tst ping.py:22: Test FAILED (6.6 sec) 23:46:22.570516 run osmo-hlr_10.42.42.2(pid=31284): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31284)] 23:46:22.620748 run osmo-hlr_10.42.42.2(pid=31284): stdout: | (launched: 2022-12-09_23:46:19.290077) 23:46:22.672283 run osmo-hlr_10.42.42.2(pid=31284): stderr: | 20221209234619485 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209234619486 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209234619486 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209234619486 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209234619486 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209234619486 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209234619499 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209234619509 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209234619510 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209234619510 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:46:22.724303 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31283): Terminating (SIGTERM) 23:46:22.766216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31286): Terminating (SIGTERM) 23:46:22.807989 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31289): Terminating (SIGTERM) 23:46:22.850055 --- ParallelTerminationStrategy: PID 31283 died... 23:46:22.869958 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31283): Terminated: ok {rc=0} 23:46:22.916888 --- ParallelTerminationStrategy: PID 31286 died... 23:46:22.936639 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31286): Terminated: ok {rc=0} 23:46:22.982749 --- ParallelTerminationStrategy: PID 31289 died... 23:46:23.002237 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31289): Terminated: ok {rc=0} 23:46:23.089704 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 23:46:24.177202 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:24.189389 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:46:24.265858 tst ping_idle_ping.py: using LAC 24504 23:46:24.383628 tst ping_idle_ping.py: using RAC 24 23:46:24.499684 tst ping_idle_ping.py: using CellId 24504 23:46:24.615022 tst ping_idle_ping.py: using BVCI 24505 23:46:24.722245 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:24.733380 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:24.744329 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:24.755874 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:24.767270 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:24.778864 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:24.790647 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:46:24.802084 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:46:24.920531 tst ping_idle_ping.py:24: start network... 23:46:25.117827 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:46:25.575458 run create_hlr_db(pid=31291): Launched 23:46:25.695171 bus /gobi_6: Setting Powered False 23:46:26.757953 run create_hlr_db(pid=31291): Terminated: ok {rc=0} 23:46:27.179423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31293): Launched 23:46:27.472258 run osmo-hlr_10.42.42.2(pid=31294): Launched 23:46:27.584045 run osmo-stp_10.42.42.5: Starting osmo-stp 23:46:28.094807 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31296): Launched 23:46:28.386741 run osmo-stp_10.42.42.5(pid=31297): Launched 23:46:28.499106 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:46:29.004420 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31299): Launched 23:46:29.116446 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:46:29.364404 run patchelf(pid=31300): Launched 23:46:29.527341 run osmo-stp_10.42.42.5(pid=31297): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31297)] 23:46:29.651226 run osmo-stp_10.42.42.5(pid=31297): stdout: | (launched: 2022-12-09_23:46:28.333262) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:46:29.777278 run osmo-stp_10.42.42.5(pid=31297): stderr: | 20221209234628501 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234628502 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234628502 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234628502 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234628503 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234628503 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234628503 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:46:29.903463 run osmo-stp_10.42.42.5(pid=31297): stdout: | (launched: 2022-12-09_23:46:28.333262) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:46:30.023461 run osmo-stp_10.42.42.5(pid=31297): stderr: | 20221209234628501 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234628502 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234628502 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234628502 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234628503 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234628503 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234628503 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:46:30.166176 run patchelf(pid=31300): Terminating (SIGINT) 23:46:30.330645 run patchelf(pid=31300): Terminated: ok {rc=0} 23:46:30.450239 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=31297): Process ended prematurely: osmo-stp_10.42.42.5(pid=31297) [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31297)] [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 23:46:30.458998 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 23:46:30.485279 run osmo-hlr_10.42.42.2(pid=31294): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31294)] 23:46:30.532148 run osmo-hlr_10.42.42.2(pid=31294): stdout: | (launched: 2022-12-09_23:46:27.418563) 23:46:30.580808 run osmo-hlr_10.42.42.2(pid=31294): stderr: | 20221209234627595 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209234627595 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209234627595 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209234627595 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209234627595 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209234627595 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209234627608 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209234627618 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209234627618 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209234627618 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:46:30.629969 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31293): Terminating (SIGTERM) 23:46:30.669604 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31296): Terminating (SIGTERM) 23:46:30.709083 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31299): Terminating (SIGTERM) 23:46:30.748575 --- ParallelTerminationStrategy: PID 31293 died... 23:46:30.767526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31293): Terminated: ok {rc=0} 23:46:30.811345 --- ParallelTerminationStrategy: PID 31296 died... 23:46:30.829883 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31296): Terminated: ok {rc=0} 23:46:30.873642 --- ParallelTerminationStrategy: PID 31299 died... 23:46:30.895681 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31299): Terminated: ok {rc=0} 23:46:30.998489 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2366 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 23:46:32.314534 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:46:32.321307 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 23:46:32.355536 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 23:46:32.391657 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 23:46:32.444343 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 23:46:32.477598 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 23:46:32.511982 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 23:46:33.072265 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2366 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 23:46:33.077533 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:46:33.088830 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 23:46:33.158579 tst switch_tch_pdch.py: using LAC 24505 23:46:33.274364 tst switch_tch_pdch.py: using RAC 25 23:46:33.390088 tst switch_tch_pdch.py: using CellId 24505 23:46:33.515509 tst switch_tch_pdch.py: using BVCI 24506 23:46:33.622357 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:46:33.633843 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:46:33.645212 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:46:33.656627 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:46:33.667952 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:46:33.679197 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:46:33.690510 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:46:33.701623 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:46:33.819169 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:46:33.935657 tst switch_tch_pdch.py:51: start network... 23:46:34.131404 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:46:34.585319 run create_hlr_db(pid=31304): Launched 23:46:34.703872 bus /gobi_6: Setting Powered False 23:46:35.762346 run create_hlr_db(pid=31304): Terminated: ok {rc=0} 23:46:36.191816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31306): Launched 23:46:36.506180 run osmo-hlr_10.42.42.2(pid=31307): Launched 23:46:36.626246 run osmo-stp_10.42.42.5: Starting osmo-stp 23:46:37.164178 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31309): Launched 23:46:37.476083 run osmo-stp_10.42.42.5(pid=31310): Launched 23:46:37.597466 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:46:38.139326 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31312): Launched 23:46:38.258713 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:46:38.522586 run patchelf(pid=31313): Launched 23:46:38.696495 run osmo-stp_10.42.42.5(pid=31310): ERR: Terminated: ERROR {rc=1} [trial-2366↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31310)] 23:46:38.829179 run osmo-stp_10.42.42.5(pid=31310): stdout: | (launched: 2022-12-09_23:46:37.419764) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:46:38.964380 run osmo-stp_10.42.42.5(pid=31310): stderr: | 20221209234637609 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234637610 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234637610 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234637610 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234637612 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234637613 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234637613 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:46:39.099254 run osmo-stp_10.42.42.5(pid=31310): stdout: | (launched: 2022-12-09_23:46:37.419764) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:46:39.228016 run osmo-stp_10.42.42.5(pid=31310): stderr: | 20221209234637609 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234637610 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234637610 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234637610 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234637612 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234637613 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234637613 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:46:39.380614 run patchelf(pid=31313): Terminating (SIGINT) 23:46:39.556199 run patchelf(pid=31313): Terminated: ok {rc=0} 23:46:39.682923 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=31310): Process ended prematurely: osmo-stp_10.42.42.5(pid=31310) [trial-2366↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31310)] [trial-2366↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 23:46:39.692338 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 23:46:39.720650 run osmo-hlr_10.42.42.2(pid=31307): ERR: Terminated: ERROR {rc=237} [trial-2366↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31307)] 23:46:39.770608 run osmo-hlr_10.42.42.2(pid=31307): stdout: | (launched: 2022-12-09_23:46:36.449614) 23:46:39.822113 run osmo-hlr_10.42.42.2(pid=31307): stderr: | 20221209234636643 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209234636643 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209234636643 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209234636643 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209234636643 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209234636644 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209234636655 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209234636664 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209234636664 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209234636664 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:46:39.874068 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31306): Terminating (SIGTERM) 23:46:39.916003 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31309): Terminating (SIGTERM) 23:46:39.957969 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31312): Terminating (SIGTERM) 23:46:39.999909 --- ParallelTerminationStrategy: PID 31306 died... 23:46:40.019712 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31306): Terminated: ok {rc=0} 23:46:40.066428 --- ParallelTerminationStrategy: PID 31309 died... 23:46:40.085989 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31309): Terminated: ok {rc=0} 23:46:40.132536 --- ParallelTerminationStrategy: PID 31312 died... 23:46:40.151955 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31312): Terminated: ok {rc=0} 23:46:40.239356 bus /gobi_0: Setting Powered False 23:46:41.337689 bus /gobi_0: Setting Powered False 23:46:42.453503 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2366 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 23:46:43.705898 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:46:43.711714 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 23:46:43.745965 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 23:46:43.780323 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 23:46:43.833786 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 23:46:43.867273 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 23:46:43.901058 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 23:46:44.457848 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2366 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 23:46:44.464409 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:46:44.477217 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 23:46:44.550776 tst switch_tch_pdch.py: using LAC 24506 23:46:44.666477 tst switch_tch_pdch.py: using RAC 26 23:46:44.784725 tst switch_tch_pdch.py: using CellId 24506 23:46:44.898602 tst switch_tch_pdch.py: using BVCI 24507 23:46:45.004676 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:46:45.015731 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:46:45.026499 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:46:45.037275 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:46:45.048000 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:46:45.058773 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:46:45.069629 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:46:45.080302 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 23:46:45.192589 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 23:46:45.310714 tst switch_tch_pdch.py:51: start network... 23:46:45.522817 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:46:46.010187 run create_hlr_db(pid=31317): Launched 23:46:46.176768 bus /gobi_6: Setting Powered False 23:46:47.250221 run create_hlr_db(pid=31317): Terminated: ok {rc=0} 23:46:47.649650 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31319): Launched 23:46:47.942389 run osmo-hlr_10.42.42.2(pid=31320): Launched 23:46:48.053658 run osmo-stp_10.42.42.5: Starting osmo-stp 23:46:48.545684 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31322): Launched 23:46:48.837454 run osmo-stp_10.42.42.5(pid=31323): Launched 23:46:48.949455 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:46:49.429190 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31325): Launched 23:46:49.540344 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:46:49.786972 run patchelf(pid=31326): Launched 23:46:49.949599 run osmo-stp_10.42.42.5(pid=31323): ERR: Terminated: ERROR {rc=1} [trial-2366↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31323)] 23:46:50.073258 run osmo-stp_10.42.42.5(pid=31323): stdout: | (launched: 2022-12-09_23:46:48.784200) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:46:50.199131 run osmo-stp_10.42.42.5(pid=31323): stderr: | 20221209234648954 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234648954 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234648955 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234648955 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234648955 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234648956 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234648956 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:46:50.324649 run osmo-stp_10.42.42.5(pid=31323): stdout: | (launched: 2022-12-09_23:46:48.784200) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:46:50.443963 run osmo-stp_10.42.42.5(pid=31323): stderr: | 20221209234648954 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234648954 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234648955 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234648955 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234648955 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234648956 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234648956 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:46:50.586680 run patchelf(pid=31326): Terminating (SIGINT) 23:46:50.751264 run patchelf(pid=31326): Terminated: ok {rc=0} 23:46:50.870463 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=31323): Process ended prematurely: osmo-stp_10.42.42.5(pid=31323) [trial-2366↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31323)] [trial-2366↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 23:46:50.879265 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 23:46:50.905630 run osmo-hlr_10.42.42.2(pid=31320): ERR: Terminated: ERROR {rc=237} [trial-2366↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31320)] 23:46:50.952720 run osmo-hlr_10.42.42.2(pid=31320): stdout: | (launched: 2022-12-09_23:46:47.888874) 23:46:51.001445 run osmo-hlr_10.42.42.2(pid=31320): stderr: | 20221209234648061 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209234648061 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209234648062 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209234648062 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209234648062 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209234648062 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209234648074 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209234648083 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209234648083 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209234648083 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:46:51.050775 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31319): Terminating (SIGTERM) 23:46:51.090061 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31322): Terminating (SIGTERM) 23:46:51.129533 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31325): Terminating (SIGTERM) 23:46:51.169436 --- ParallelTerminationStrategy: PID 31319 died... 23:46:51.188487 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31319): Terminated: ok {rc=0} 23:46:51.232541 --- ParallelTerminationStrategy: PID 31322 died... 23:46:51.251287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31322): Terminated: ok {rc=0} 23:46:51.295119 --- ParallelTerminationStrategy: PID 31325 died... 23:46:51.313811 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31325): Terminated: ok {rc=0} 23:46:51.399466 bus /gobi_0: Setting Powered False 23:46:52.498046 bus /gobi_0: Setting Powered False 23:46:53.611102 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2366 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 nitb_sms:trx-umtrx --------------------------------------------------------------------- 23:46:54.865940 tst nitb_sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:46:54.870204 tst nitb_sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 23:46:54.904169 tst nitb_sms:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 23:46:54.911173 tst nitb_sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 23:46:54.964135 tst nitb_sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 23:46:54.997383 tst nitb_sms:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 23:46:55.004264 tst nitb_sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 23:46:55.543229 tst nitb_sms:trx-umtrx: RESERVED RESOURCES for nitb_sms: bts UmTRX ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 nitb_sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 23:46:55.548298 tst nitb_sms:trx-umtrx: Using 1 x ip_address (candidates: 1) 23:46:55.559415 tst nitb_sms:trx-umtrx: Using 1 x bts (candidates: 1) 23:46:55.615115 tst mo_mt_sms.py: using LAC 24507 23:46:55.730789 tst mo_mt_sms.py: using RAC 27 23:46:55.844674 tst mo_mt_sms.py: using CellId 24507 23:46:55.958968 tst mo_mt_sms.py: using BVCI 24508 23:46:56.066159 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 23:46:56.181608 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 23:46:56.296895 tst mo_mt_sms.py:9: start nitb and bts... 23:46:56.510643 run osmo-nitb_10.42.42.2: Starting osmo-nitb 23:46:57.148933 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31330): Launched 23:46:57.461161 run osmo-nitb_10.42.42.2(pid=31331): Launched 23:46:57.635395 run osmo-nitb_10.42.42.2(pid=31331): ERR: Terminated: ERROR {rc=2} [trial-2366↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31331)] 23:46:57.776187 run osmo-nitb_10.42.42.2(pid=31331): stdout: | (launched: 2022-12-09_23:46:57.405038) 23:46:57.918640 run osmo-nitb_10.42.42.2(pid=31331): stderr: | (launched: 2022-12-09_23:46:57.451645) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:46:58.061169 run osmo-nitb_10.42.42.2(pid=31331): stdout: | (launched: 2022-12-09_23:46:57.405038) 23:46:58.197563 run osmo-nitb_10.42.42.2(pid=31331): stderr: | (launched: 2022-12-09_23:46:57.451645) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=31331): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31331) [trial-2366↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31331)] 23:46:58.579975 tst osmo-nitb_10.42.42.2(pid=31331): stdout: | (launched: 2022-12-09_23:46:57.405038) 23:46:58.707150 tst osmo-nitb_10.42.42.2(pid=31331): stderr: | (launched: 2022-12-09_23:46:57.451645) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:46:58.856605 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=31331): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31331) [trial-2366↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31331)] [trial-2366↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11] 23:46:58.865994 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 23:46:58.873281 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31330): Terminating (SIGTERM) 23:46:59.084428 --- ParallelTerminationStrategy: PID 31330 died... 23:46:59.107312 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31330): Terminated: ok {rc=0} 23:46:59.194903 bus /sierra_3: Setting Powered False 23:47:00.290564 bus /sierra_3: Setting Powered False 23:47:01.408501 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 nitb_sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 sms:trx-umtrx --------------------------------------------------------------------- 23:47:02.609353 tst sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:47:02.613311 tst sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 23:47:02.645698 tst sms:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 23:47:02.672168 tst sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 23:47:02.724916 tst sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 23:47:02.756890 tst sms:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 23:47:02.783212 tst sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 23:47:03.329960 tst sms:trx-umtrx: RESERVED RESOURCES for sms: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 23:47:03.334765 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 23:47:03.345200 tst sms:trx-umtrx: Using 1 x bts (candidates: 1) 23:47:03.396168 tst mo_mt_sms.py: using LAC 24508 23:47:03.511856 tst mo_mt_sms.py: using RAC 28 23:47:03.637056 tst mo_mt_sms.py: using CellId 24508 23:47:03.759640 tst mo_mt_sms.py: using BVCI 24509 23:47:03.874319 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 23:47:03.885571 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 23:47:03.896882 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 23:47:03.908426 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 23:47:03.919863 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 23:47:03.931215 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 23:47:04.046039 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 23:47:04.162964 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:47:04.649703 run create_hlr_db(pid=31335): Launched 23:47:04.769426 bus /sierra_2: Setting Powered False 23:47:05.831787 run create_hlr_db(pid=31335): Terminated: ok {rc=0} 23:47:06.252758 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31337): Launched 23:47:06.544209 run osmo-hlr_10.42.42.2(pid=31338): Launched 23:47:06.657493 run osmo-stp_10.42.42.5: Starting osmo-stp 23:47:07.161675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31340): Launched 23:47:07.454174 run osmo-stp_10.42.42.5(pid=31341): Launched 23:47:07.566138 run osmo-msc_10.42.42.6: Starting osmo-msc 23:47:08.094441 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31343): Launched 23:47:08.385298 run osmo-msc_10.42.42.6(pid=31344): Launched 23:47:08.548756 run osmo-stp_10.42.42.5(pid=31341): ERR: Terminated: ERROR {rc=1} [trial-2366↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31341)] 23:47:08.674036 run osmo-stp_10.42.42.5(pid=31341): stdout: | (launched: 2022-12-09_23:47:07.400421) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:47:08.799037 run osmo-stp_10.42.42.5(pid=31341): stderr: | 20221209234707568 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234707568 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234707568 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234707569 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234707571 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234707571 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234707571 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:47:08.921367 run osmo-stp_10.42.42.5(pid=31341): stdout: | (launched: 2022-12-09_23:47:07.400421) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:47:09.037207 run osmo-stp_10.42.42.5(pid=31341): stderr: | 20221209234707568 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234707568 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234707568 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234707569 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234707571 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234707571 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234707571 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:47:09.175934 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=31341): Process ended prematurely: osmo-stp_10.42.42.5(pid=31341) [trial-2366↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31341)] [trial-2366↪sms:trx-umtrx↪mo_mt_sms.py:16] 23:47:09.184129 tst mo_mt_sms.py:16: Test FAILED (5.8 sec) 23:47:09.209639 run osmo-hlr_10.42.42.2(pid=31338): ERR: Terminated: ERROR {rc=237} [trial-2366↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31338)] 23:47:09.256871 run osmo-hlr_10.42.42.2(pid=31338): stdout: | (launched: 2022-12-09_23:47:06.491056) 23:47:09.305464 run osmo-hlr_10.42.42.2(pid=31338): stderr: | 20221209234706665 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209234706665 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209234706665 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209234706665 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209234706665 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209234706665 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209234706682 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/sms:trx-umtrx/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209234706691 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209234706692 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209234706692 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:47:09.373723 run osmo-msc_10.42.42.6(pid=31344): ERR: Terminated: ERROR {rc=2} [trial-2366↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31344)] 23:47:09.420412 run osmo-msc_10.42.42.6(pid=31344): stdout: | (launched: 2022-12-09_23:47:08.331908) 23:47:09.468854 run osmo-msc_10.42.42.6(pid=31344): stderr: | 20221209234708603 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209234708604 DLGLOBAL DEBUG validating counter group 0x7f9537a9bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209234708604 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209234708604 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209234708604 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209234708604 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209234708606 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209234708606 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209234708606 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209234708607 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:47:09.517827 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31337): Terminating (SIGTERM) 23:47:09.556564 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31340): Terminating (SIGTERM) 23:47:09.595568 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31343): Terminating (SIGTERM) 23:47:09.634696 --- ParallelTerminationStrategy: PID 31337 died... 23:47:09.653474 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31337): Terminated: ok {rc=0} 23:47:09.697819 --- ParallelTerminationStrategy: PID 31340 died... 23:47:09.715930 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31340): Terminated: ok {rc=0} 23:47:09.759008 --- ParallelTerminationStrategy: PID 31343 died... 23:47:09.777294 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31343): Terminated: ok {rc=0} 23:47:09.861965 bus /sierra_3: Setting Powered False 23:47:10.961053 bus /sierra_3: Setting Powered False 23:47:12.076461 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 nitb_ussd:trx-umtrx --------------------------------------------------------------------- 23:47:13.302703 tst nitb_ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:47:13.306311 tst nitb_ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 23:47:13.338747 tst nitb_ussd:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 23:47:13.345484 tst nitb_ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 23:47:13.382187 tst nitb_ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 23:47:13.415400 tst nitb_ussd:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 23:47:13.422256 tst nitb_ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 23:47:13.944169 tst nitb_ussd:trx-umtrx: RESERVED RESOURCES for nitb_ussd: bts UmTRX ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2366 nitb_ussd:trx-umtrx assert_extension.py ---------------------------------------------- 23:47:13.950872 tst nitb_ussd:trx-umtrx: Using 1 x ip_address (candidates: 1) 23:47:13.962581 tst nitb_ussd:trx-umtrx: Using 1 x bts (candidates: 1) 23:47:14.010847 tst assert_extension.py: using LAC 24509 23:47:14.134388 tst assert_extension.py: using RAC 29 23:47:14.257661 tst assert_extension.py: using CellId 24509 23:47:14.381414 tst assert_extension.py: using BVCI 24510 23:47:14.489227 tst nitb_ussd:trx-umtrx: Using 1 x modem (candidates: 1) 23:47:14.601354 tst assert_extension.py:10: start nitb and bts... 23:47:14.798150 run osmo-nitb_10.42.42.2: Starting osmo-nitb 23:47:15.397732 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31350): Launched 23:47:15.690451 run osmo-nitb_10.42.42.2(pid=31351): Launched 23:47:15.856493 run osmo-nitb_10.42.42.2(pid=31351): ERR: Terminated: ERROR {rc=2} [trial-2366↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31351)] 23:47:15.996176 run osmo-nitb_10.42.42.2(pid=31351): stdout: | (launched: 2022-12-09_23:47:15.636787) 23:47:16.133132 run osmo-nitb_10.42.42.2(pid=31351): stderr: | (launched: 2022-12-09_23:47:15.680689) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:47:16.268857 run osmo-nitb_10.42.42.2(pid=31351): stdout: | (launched: 2022-12-09_23:47:15.636787) 23:47:16.399285 run osmo-nitb_10.42.42.2(pid=31351): stderr: | (launched: 2022-12-09_23:47:15.680689) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=31351): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31351) [trial-2366↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31351)] 23:47:16.799793 tst osmo-nitb_10.42.42.2(pid=31351): stdout: | (launched: 2022-12-09_23:47:15.636787) 23:47:16.966144 tst osmo-nitb_10.42.42.2(pid=31351): stderr: | (launched: 2022-12-09_23:47:15.680689) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:47:17.159590 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=31351): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31351) [trial-2366↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31351)] [trial-2366↪nitb_ussd:trx-umtrx↪assert_extension.py:12] 23:47:17.169057 tst assert_extension.py:12: Test FAILED (3.2 sec) 23:47:17.176683 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31350): Terminating (SIGTERM) 23:47:17.388532 --- ParallelTerminationStrategy: PID 31350 died... 23:47:17.409535 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31350): Terminated: ok {rc=0} 23:47:17.495760 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 nitb_ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 ussd:trx-umtrx --------------------------------------------------------------------- 23:47:18.674490 tst ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:47:18.679766 tst ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 23:47:18.714372 tst ussd:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 23:47:18.741940 tst ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 23:47:18.777785 tst ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 23:47:18.811166 tst ussd:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 23:47:18.838803 tst ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 23:47:19.367615 tst ussd:trx-umtrx: RESERVED RESOURCES for ussd: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2366 ussd:trx-umtrx assert_extension.py ---------------------------------------------- 23:47:19.373214 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 23:47:19.384272 tst ussd:trx-umtrx: Using 1 x bts (candidates: 1) 23:47:19.432193 tst assert_extension.py: using LAC 24510 23:47:19.557853 tst assert_extension.py: using RAC 30 23:47:19.675352 tst assert_extension.py: using CellId 24510 23:47:19.793356 tst assert_extension.py: using BVCI 24511 23:47:19.899250 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 23:47:19.910018 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 23:47:19.920558 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 23:47:19.930945 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 23:47:19.941319 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 23:47:19.951667 tst ussd:trx-umtrx: Using 1 x modem (candidates: 1) 23:47:20.067012 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:47:20.553323 run create_hlr_db(pid=31355): Launched 23:47:20.674247 bus /sierra_2: Setting Powered False 23:47:21.736647 run create_hlr_db(pid=31355): Terminated: ok {rc=0} 23:47:22.157351 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31357): Launched 23:47:22.450288 run osmo-hlr_10.42.42.2(pid=31358): Launched 23:47:22.562221 run osmo-stp_10.42.42.5: Starting osmo-stp 23:47:23.071217 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31360): Launched 23:47:23.361670 run osmo-stp_10.42.42.5(pid=31361): Launched 23:47:23.472277 run osmo-msc_10.42.42.6: Starting osmo-msc 23:47:23.998974 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31363): Launched 23:47:24.289242 run osmo-msc_10.42.42.6(pid=31364): Launched 23:47:24.453389 run osmo-stp_10.42.42.5(pid=31361): ERR: Terminated: ERROR {rc=1} [trial-2366↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31361)] 23:47:24.577801 run osmo-stp_10.42.42.5(pid=31361): stdout: | (launched: 2022-12-09_23:47:23.308360) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:47:24.701910 run osmo-stp_10.42.42.5(pid=31361): stderr: | 20221209234723475 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234723475 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234723475 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234723476 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234723478 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234723478 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234723478 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:47:24.824445 run osmo-stp_10.42.42.5(pid=31361): stdout: | (launched: 2022-12-09_23:47:23.308360) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:47:24.941257 run osmo-stp_10.42.42.5(pid=31361): stderr: | 20221209234723475 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234723475 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234723475 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234723476 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234723478 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234723478 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234723478 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:47:25.080653 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=31361): Process ended prematurely: osmo-stp_10.42.42.5(pid=31361) [trial-2366↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31361)] [trial-2366↪ussd:trx-umtrx↪assert_extension.py:17] 23:47:25.089088 tst assert_extension.py:17: Test FAILED (5.7 sec) 23:47:25.114852 run osmo-hlr_10.42.42.2(pid=31358): ERR: Terminated: ERROR {rc=237} [trial-2366↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31358)] 23:47:25.161998 run osmo-hlr_10.42.42.2(pid=31358): stdout: | (launched: 2022-12-09_23:47:22.396776) 23:47:25.210807 run osmo-hlr_10.42.42.2(pid=31358): stderr: | 20221209234722573 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209234722573 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209234722573 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209234722573 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209234722573 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209234722574 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209234722586 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/ussd:trx-umtrx/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209234722594 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209234722594 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209234722594 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:47:25.278640 run osmo-msc_10.42.42.6(pid=31364): ERR: Terminated: ERROR {rc=2} [trial-2366↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31364)] 23:47:25.325684 run osmo-msc_10.42.42.6(pid=31364): stdout: | (launched: 2022-12-09_23:47:24.235907) 23:47:25.374482 run osmo-msc_10.42.42.6(pid=31364): stderr: | 20221209234724507 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209234724507 DLGLOBAL DEBUG validating counter group 0x7fc726efbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209234724507 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209234724507 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209234724508 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209234724508 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209234724510 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209234724510 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209234724510 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209234724510 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:47:25.423815 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31357): Terminating (SIGTERM) 23:47:25.463346 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31360): Terminating (SIGTERM) 23:47:25.502776 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31363): Terminating (SIGTERM) 23:47:25.542791 --- ParallelTerminationStrategy: PID 31357 died... 23:47:25.561939 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31357): Terminated: ok {rc=0} 23:47:25.605859 --- ParallelTerminationStrategy: PID 31360 died... 23:47:25.624217 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31360): Terminated: ok {rc=0} 23:47:25.668162 --- ParallelTerminationStrategy: PID 31363 died... 23:47:25.686738 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31363): Terminated: ok {rc=0} 23:47:25.770154 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 23:47:26.981606 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:47:26.988833 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 23:47:27.022675 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 23:47:27.050283 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 23:47:27.103978 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 23:47:27.137646 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 23:47:27.165491 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 23:47:27.713885 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 23:47:27.767386 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:47:27.778984 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 23:47:27.850436 tst mo_mt_call.py: using LAC 24511 23:47:27.971350 tst mo_mt_call.py: using RAC 31 23:47:28.090683 tst mo_mt_call.py: using CellId 24511 23:47:28.207257 tst mo_mt_call.py: using BVCI 24512 23:47:28.325665 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:47:28.337684 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:47:28.349615 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:47:28.361689 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:47:28.373515 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:47:28.385262 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:47:28.503133 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:47:28.622302 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:47:29.118614 run create_hlr_db(pid=31369): Launched 23:47:29.239181 bus /sierra_2: Setting Powered False 23:47:30.302612 run create_hlr_db(pid=31369): Terminated: ok {rc=0} 23:47:30.730385 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31371): Launched 23:47:31.071795 run osmo-hlr_10.42.42.2(pid=31372): Launched 23:47:31.321829 run osmo-stp_10.42.42.5: Starting osmo-stp 23:47:31.984125 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31374): Launched 23:47:32.317920 run osmo-stp_10.42.42.5(pid=31375): Launched 23:47:32.440107 run osmo-msc_10.42.42.6: Starting osmo-msc 23:47:33.021360 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31377): Launched 23:47:33.340404 run osmo-msc_10.42.42.6(pid=31378): Launched 23:47:33.517914 run osmo-stp_10.42.42.5(pid=31375): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31375)] 23:47:33.652618 run osmo-stp_10.42.42.5(pid=31375): stdout: | (launched: 2022-12-09_23:47:32.260266) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:47:33.786951 run osmo-stp_10.42.42.5(pid=31375): stderr: | 20221209234732449 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234732449 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234732449 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234732450 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234732452 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234732452 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234732452 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:47:33.921318 run osmo-stp_10.42.42.5(pid=31375): stdout: | (launched: 2022-12-09_23:47:32.260266) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:47:34.048936 run osmo-stp_10.42.42.5(pid=31375): stderr: | 20221209234732449 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234732449 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234732449 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234732450 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234732452 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234732452 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234732452 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:47:34.201468 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31375): Process ended prematurely: osmo-stp_10.42.42.5(pid=31375) [trial-2366↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31375)] [trial-2366↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 23:47:34.211083 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 23:47:34.238999 run osmo-hlr_10.42.42.2(pid=31372): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31372)] 23:47:34.290580 run osmo-hlr_10.42.42.2(pid=31372): stdout: | (launched: 2022-12-09_23:47:31.006750) 23:47:34.342716 run osmo-hlr_10.42.42.2(pid=31372): stderr: | 20221209234731309 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209234731309 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209234731309 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209234731309 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209234731309 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209234731309 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209234731333 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209234731341 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209234731341 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209234731341 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:47:34.414848 run osmo-msc_10.42.42.6(pid=31378): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31378)] 23:47:34.464882 run osmo-msc_10.42.42.6(pid=31378): stdout: | (launched: 2022-12-09_23:47:33.282933) 23:47:34.516652 run osmo-msc_10.42.42.6(pid=31378): stderr: | 20221209234733602 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209234733602 DLGLOBAL DEBUG validating counter group 0x7fbfd25d5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209234733602 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209234733602 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209234733602 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209234733603 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209234733604 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209234733605 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209234733605 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209234733605 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:47:34.568750 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31371): Terminating (SIGTERM) 23:47:34.610788 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31374): Terminating (SIGTERM) 23:47:34.652873 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31377): Terminating (SIGTERM) 23:47:34.695608 --- ParallelTerminationStrategy: PID 31371 died... 23:47:34.715456 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31371): Terminated: ok {rc=0} 23:47:34.762232 --- ParallelTerminationStrategy: PID 31374 died... 23:47:34.781713 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31374): Terminated: ok {rc=0} 23:47:34.828244 --- ParallelTerminationStrategy: PID 31377 died... 23:47:34.847806 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31377): Terminated: ok {rc=0} 23:47:34.937043 bus /sierra_3: Setting Powered False 23:47:36.038565 bus /sierra_3: Setting Powered False 23:47:37.153911 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 23:47:38.301497 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:47:38.313806 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 23:47:38.385767 tst mo_mt_call_osmux.py: using LAC 24512 23:47:38.513099 tst mo_mt_call_osmux.py: using RAC 32 23:47:38.639402 tst mo_mt_call_osmux.py: using CellId 24512 23:47:38.764006 tst mo_mt_call_osmux.py: using BVCI 24513 23:47:38.880424 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:47:38.891988 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:47:38.903602 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:47:38.915883 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:47:38.927845 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:47:38.939631 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:47:39.060248 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:47:39.182462 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:47:39.674926 run create_hlr_db(pid=31380): Launched 23:47:39.796038 bus /sierra_2: Setting Powered False 23:47:40.859616 run create_hlr_db(pid=31380): Terminated: ok {rc=0} 23:47:41.304789 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31382): Launched 23:47:41.622614 run osmo-hlr_10.42.42.2(pid=31383): Launched 23:47:41.744817 run osmo-stp_10.42.42.5: Starting osmo-stp 23:47:42.275125 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31385): Launched 23:47:42.572491 run osmo-stp_10.42.42.5(pid=31386): Launched 23:47:42.686842 run osmo-msc_10.42.42.6: Starting osmo-msc 23:47:43.241271 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31388): Launched 23:47:43.538368 run osmo-msc_10.42.42.6(pid=31389): Launched 23:47:43.705617 run osmo-stp_10.42.42.5(pid=31386): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31386)] 23:47:43.833233 run osmo-stp_10.42.42.5(pid=31386): stdout: | (launched: 2022-12-09_23:47:42.518125) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:47:43.959043 run osmo-stp_10.42.42.5(pid=31386): stderr: | 20221209234742686 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234742686 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234742686 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234742687 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234742687 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234742687 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234742687 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:47:44.082827 run osmo-stp_10.42.42.5(pid=31386): stdout: | (launched: 2022-12-09_23:47:42.518125) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:47:44.200907 run osmo-stp_10.42.42.5(pid=31386): stderr: | 20221209234742686 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234742686 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234742686 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234742687 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234742687 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234742687 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234742687 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:47:44.342643 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31386): Process ended prematurely: osmo-stp_10.42.42.5(pid=31386) [trial-2366↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31386)] [trial-2366↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 23:47:44.351467 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 23:47:44.377514 run osmo-hlr_10.42.42.2(pid=31383): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31383)] 23:47:44.424311 run osmo-hlr_10.42.42.2(pid=31383): stdout: | (launched: 2022-12-09_23:47:41.565099) 23:47:44.473081 run osmo-hlr_10.42.42.2(pid=31383): stderr: | 20221209234741764 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209234741764 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209234741764 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209234741764 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209234741764 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209234741764 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209234741776 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209234741784 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209234741785 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209234741785 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:47:44.541061 run osmo-msc_10.42.42.6(pid=31389): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31389)] 23:47:44.588091 run osmo-msc_10.42.42.6(pid=31389): stdout: | (launched: 2022-12-09_23:47:43.483784) 23:47:44.636607 run osmo-msc_10.42.42.6(pid=31389): stderr: | 20221209234743755 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209234743755 DLGLOBAL DEBUG validating counter group 0x7fe6a4d7ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209234743755 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209234743756 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209234743756 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209234743756 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209234743758 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209234743758 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209234743758 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209234743758 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:47:44.685689 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31382): Terminating (SIGTERM) 23:47:44.724630 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31385): Terminating (SIGTERM) 23:47:44.763682 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31388): Terminating (SIGTERM) 23:47:44.803088 --- ParallelTerminationStrategy: PID 31382 died... 23:47:44.822033 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31382): Terminated: ok {rc=0} 23:47:44.865459 --- ParallelTerminationStrategy: PID 31385 died... 23:47:44.883870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31385): Terminated: ok {rc=0} 23:47:44.927208 --- ParallelTerminationStrategy: PID 31388 died... 23:47:44.945901 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31388): Terminated: ok {rc=0} 23:47:45.028488 bus /sierra_3: Setting Powered False 23:47:46.122841 bus /sierra_3: Setting Powered False 23:47:47.246298 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 23:47:48.497630 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:47:48.504761 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 23:47:48.539516 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 23:47:48.567337 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 23:47:48.621044 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 23:47:48.657830 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 23:47:48.685347 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 23:47:49.231089 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 23:47:49.278746 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:47:49.290065 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 23:47:49.358663 tst mo_mt_call.py: using LAC 24513 23:47:49.475687 tst mo_mt_call.py: using RAC 33 23:47:49.594041 tst mo_mt_call.py: using CellId 24513 23:47:49.711677 tst mo_mt_call.py: using BVCI 24514 23:47:49.828662 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:47:49.840246 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:47:49.851792 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:47:49.863531 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:47:49.875338 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:47:49.887160 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:47:50.002964 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:47:50.117901 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:47:50.577926 run create_hlr_db(pid=31394): Launched 23:47:50.700005 bus /sierra_2: Setting Powered False 23:47:51.760800 run create_hlr_db(pid=31394): Terminated: ok {rc=0} 23:47:52.198348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31396): Launched 23:47:52.516367 run osmo-hlr_10.42.42.2(pid=31397): Launched 23:47:52.638426 run osmo-stp_10.42.42.5: Starting osmo-stp 23:47:53.189989 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31399): Launched 23:47:53.508085 run osmo-stp_10.42.42.5(pid=31400): Launched 23:47:53.630413 run osmo-msc_10.42.42.6: Starting osmo-msc 23:47:54.209476 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31402): Launched 23:47:54.528640 run osmo-msc_10.42.42.6(pid=31403): Launched 23:47:54.706635 run osmo-stp_10.42.42.5(pid=31400): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31400)] 23:47:54.841225 run osmo-stp_10.42.42.5(pid=31400): stdout: | (launched: 2022-12-09_23:47:53.450432) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:47:54.977746 run osmo-stp_10.42.42.5(pid=31400): stderr: | 20221209234753643 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234753643 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234753643 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234753644 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234753644 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234753644 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234753644 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:47:55.112831 run osmo-stp_10.42.42.5(pid=31400): stdout: | (launched: 2022-12-09_23:47:53.450432) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:47:55.240898 run osmo-stp_10.42.42.5(pid=31400): stderr: | 20221209234753643 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234753643 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234753643 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234753644 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234753644 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234753644 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234753644 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:47:55.394161 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31400): Process ended prematurely: osmo-stp_10.42.42.5(pid=31400) [trial-2366↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31400)] [trial-2366↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 23:47:55.403539 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 23:47:55.432004 run osmo-hlr_10.42.42.2(pid=31397): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31397)] 23:47:55.482527 run osmo-hlr_10.42.42.2(pid=31397): stdout: | (launched: 2022-12-09_23:47:52.458998) 23:47:55.534739 run osmo-hlr_10.42.42.2(pid=31397): stderr: | 20221209234752655 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209234752655 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209234752655 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209234752656 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209234752656 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209234752656 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209234752667 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209234752675 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209234752676 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209234752676 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:47:55.607522 run osmo-msc_10.42.42.6(pid=31403): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31403)] 23:47:55.657881 run osmo-msc_10.42.42.6(pid=31403): stdout: | (launched: 2022-12-09_23:47:54.470832) 23:47:55.709808 run osmo-msc_10.42.42.6(pid=31403): stderr: | 20221209234754791 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209234754791 DLGLOBAL DEBUG validating counter group 0x7f542e40ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209234754791 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209234754792 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209234754792 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209234754792 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209234754794 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209234754794 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209234754794 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209234754794 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:47:55.762126 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31396): Terminating (SIGTERM) 23:47:55.804083 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31399): Terminating (SIGTERM) 23:47:55.846282 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31402): Terminating (SIGTERM) 23:47:55.888655 --- ParallelTerminationStrategy: PID 31396 died... 23:47:55.908719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31396): Terminated: ok {rc=0} 23:47:55.956269 --- ParallelTerminationStrategy: PID 31399 died... 23:47:55.976041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31399): Terminated: ok {rc=0} 23:47:56.023069 --- ParallelTerminationStrategy: PID 31402 died... 23:47:56.042959 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31402): Terminated: ok {rc=0} 23:47:56.130902 bus /sierra_3: Setting Powered False 23:47:57.231847 bus /sierra_3: Setting Powered False 23:47:58.348799 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 23:47:59.499788 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:47:59.512381 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 23:47:59.587710 tst mo_mt_call_osmux.py: using LAC 24514 23:47:59.716879 tst mo_mt_call_osmux.py: using RAC 34 23:47:59.841275 tst mo_mt_call_osmux.py: using CellId 24514 23:47:59.968174 tst mo_mt_call_osmux.py: using BVCI 24515 23:48:00.086480 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:48:00.098178 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:48:00.109553 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:48:00.121093 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:48:00.132695 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:48:00.144354 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:48:00.263121 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:48:00.382433 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:48:00.861613 run create_hlr_db(pid=31405): Launched 23:48:01.016756 bus /sierra_2: Setting Powered False 23:48:02.103722 run create_hlr_db(pid=31405): Terminated: ok {rc=0} 23:48:02.577490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31407): Launched 23:48:02.898870 run osmo-hlr_10.42.42.2(pid=31408): Launched 23:48:03.021648 run osmo-stp_10.42.42.5: Starting osmo-stp 23:48:03.572273 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31410): Launched 23:48:03.892453 run osmo-stp_10.42.42.5(pid=31411): Launched 23:48:04.016752 run osmo-msc_10.42.42.6: Starting osmo-msc 23:48:04.600316 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31413): Launched 23:48:04.921408 run osmo-msc_10.42.42.6(pid=31414): Launched 23:48:05.100537 run osmo-stp_10.42.42.5(pid=31411): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31411)] 23:48:05.236064 run osmo-stp_10.42.42.5(pid=31411): stdout: | (launched: 2022-12-09_23:48:03.834627) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:48:05.372686 run osmo-stp_10.42.42.5(pid=31411): stderr: | 20221209234804028 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234804028 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234804028 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234804029 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234804029 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234804029 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234804029 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:48:05.507774 run osmo-stp_10.42.42.5(pid=31411): stdout: | (launched: 2022-12-09_23:48:03.834627) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:48:05.635952 run osmo-stp_10.42.42.5(pid=31411): stderr: | 20221209234804028 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234804028 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234804028 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234804029 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234804029 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234804029 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234804029 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:48:05.789072 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31411): Process ended prematurely: osmo-stp_10.42.42.5(pid=31411) [trial-2366↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31411)] [trial-2366↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 23:48:05.798832 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 23:48:05.827029 run osmo-hlr_10.42.42.2(pid=31408): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31408)] 23:48:05.877045 run osmo-hlr_10.42.42.2(pid=31408): stdout: | (launched: 2022-12-09_23:48:02.841199) 23:48:05.929072 run osmo-hlr_10.42.42.2(pid=31408): stderr: | 20221209234803038 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209234803038 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209234803038 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209234803038 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209234803039 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209234803039 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209234803051 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209234803059 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209234803059 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209234803059 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:48:06.001375 run osmo-msc_10.42.42.6(pid=31414): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31414)] 23:48:06.051685 run osmo-msc_10.42.42.6(pid=31414): stdout: | (launched: 2022-12-09_23:48:04.863477) 23:48:06.103369 run osmo-msc_10.42.42.6(pid=31414): stderr: | 20221209234805182 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209234805182 DLGLOBAL DEBUG validating counter group 0x7f8582147c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209234805182 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209234805182 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209234805182 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209234805183 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209234805184 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209234805185 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209234805185 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209234805185 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:48:06.155193 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31407): Terminating (SIGTERM) 23:48:06.197245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31410): Terminating (SIGTERM) 23:48:06.238967 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31413): Terminating (SIGTERM) 23:48:06.281076 --- ParallelTerminationStrategy: PID 31407 died... 23:48:06.300910 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31407): Terminated: ok {rc=0} 23:48:06.347673 --- ParallelTerminationStrategy: PID 31410 died... 23:48:06.367074 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31410): Terminated: ok {rc=0} 23:48:06.413435 --- ParallelTerminationStrategy: PID 31413 died... 23:48:06.432809 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31413): Terminated: ok {rc=0} 23:48:06.520166 bus /sierra_3: Setting Powered False 23:48:07.618330 bus /sierra_3: Setting Powered False 23:48:08.735797 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 23:48:09.983785 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:48:09.990111 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 23:48:10.022303 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 23:48:10.048710 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 23:48:10.100764 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 23:48:10.135007 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 23:48:10.163000 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 23:48:10.709899 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 23:48:10.757668 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:48:10.768629 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 23:48:10.836687 tst mo_mt_call.py: using LAC 24515 23:48:10.954344 tst mo_mt_call.py: using RAC 35 23:48:11.071810 tst mo_mt_call.py: using CellId 24515 23:48:11.192485 tst mo_mt_call.py: using BVCI 24516 23:48:11.302454 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:48:11.313451 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:48:11.324082 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:48:11.334932 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:48:11.345822 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:48:11.356484 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:48:11.474194 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:48:11.594664 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:48:12.054418 run create_hlr_db(pid=31419): Launched 23:48:12.175380 bus /sierra_2: Setting Powered False 23:48:13.234392 run create_hlr_db(pid=31419): Terminated: ok {rc=0} 23:48:13.648171 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31421): Launched 23:48:13.945373 run osmo-hlr_10.42.42.2(pid=31422): Launched 23:48:14.057964 run osmo-stp_10.42.42.5: Starting osmo-stp 23:48:14.573430 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31424): Launched 23:48:14.872225 run osmo-stp_10.42.42.5(pid=31425): Launched 23:48:14.986343 run osmo-msc_10.42.42.6: Starting osmo-msc 23:48:15.526736 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31427): Launched 23:48:15.824345 run osmo-msc_10.42.42.6(pid=31428): Launched 23:48:16.136605 run osmo-stp_10.42.42.5(pid=31425): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31425)] 23:48:16.429233 run osmo-stp_10.42.42.5(pid=31425): stdout: | (launched: 2022-12-09_23:48:14.817660) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:48:16.569379 run osmo-stp_10.42.42.5(pid=31425): stderr: | 20221209234814989 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234814989 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234814989 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234814989 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234814990 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234814990 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234814990 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:48:16.708580 run osmo-stp_10.42.42.5(pid=31425): stdout: | (launched: 2022-12-09_23:48:14.817660) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:48:16.845365 run osmo-stp_10.42.42.5(pid=31425): stderr: | 20221209234814989 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234814989 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234814989 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234814989 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234814990 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234814990 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234814990 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:48:17.006673 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31425): Process ended prematurely: osmo-stp_10.42.42.5(pid=31425) [trial-2366↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31425)] [trial-2366↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 23:48:17.017669 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 23:48:17.049085 run osmo-hlr_10.42.42.2(pid=31422): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31422)] 23:48:17.102003 run osmo-hlr_10.42.42.2(pid=31422): stdout: | (launched: 2022-12-09_23:48:13.890817) 23:48:17.157170 run osmo-hlr_10.42.42.2(pid=31422): stderr: | 20221209234814065 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209234814065 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209234814065 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209234814065 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209234814065 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209234814065 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209234814077 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209234814086 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209234814086 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209234814087 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:48:17.232470 run osmo-msc_10.42.42.6(pid=31428): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31428)] 23:48:17.285575 run osmo-msc_10.42.42.6(pid=31428): stdout: | (launched: 2022-12-09_23:48:15.769675) 23:48:17.339649 run osmo-msc_10.42.42.6(pid=31428): stderr: | 20221209234816161 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209234816162 DLGLOBAL DEBUG validating counter group 0x7f9dcdc1cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209234816162 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209234816162 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209234816162 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209234816162 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209234816164 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209234816164 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209234816164 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209234816164 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:48:17.392934 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31421): Terminating (SIGTERM) 23:48:17.436060 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31424): Terminating (SIGTERM) 23:48:17.479297 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31427): Terminating (SIGTERM) 23:48:17.522582 --- ParallelTerminationStrategy: PID 31421 died... 23:48:17.542792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31421): Terminated: ok {rc=0} 23:48:17.591291 --- ParallelTerminationStrategy: PID 31424 died... 23:48:17.611090 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31424): Terminated: ok {rc=0} 23:48:17.659509 --- ParallelTerminationStrategy: PID 31427 died... 23:48:17.679402 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31427): Terminated: ok {rc=0} 23:48:17.769763 bus /sierra_3: Setting Powered False 23:48:18.870928 bus /sierra_3: Setting Powered False 23:48:19.988038 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 23:48:21.133785 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:48:21.145628 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 23:48:21.214390 tst mo_mt_call_osmux.py: using LAC 24516 23:48:21.334443 tst mo_mt_call_osmux.py: using RAC 36 23:48:21.454017 tst mo_mt_call_osmux.py: using CellId 24516 23:48:21.585297 tst mo_mt_call_osmux.py: using BVCI 24517 23:48:21.701742 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:48:21.713330 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:48:21.724525 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:48:21.736060 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:48:21.747975 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:48:21.759514 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:48:21.874028 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:48:21.995716 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:48:22.490741 run create_hlr_db(pid=31430): Launched 23:48:22.611903 bus /sierra_2: Setting Powered False 23:48:23.675400 run create_hlr_db(pid=31430): Terminated: ok {rc=0} 23:48:24.103195 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31433): Launched 23:48:24.400920 run osmo-hlr_10.42.42.2(pid=31434): Launched 23:48:24.515361 run osmo-stp_10.42.42.5: Starting osmo-stp 23:48:25.029289 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31436): Launched 23:48:25.327177 run osmo-stp_10.42.42.5(pid=31437): Launched 23:48:25.440427 run osmo-msc_10.42.42.6: Starting osmo-msc 23:48:25.978751 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31439): Launched 23:48:26.275359 run osmo-msc_10.42.42.6(pid=31440): Launched 23:48:26.440582 run osmo-stp_10.42.42.5(pid=31437): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31437)] 23:48:26.566349 run osmo-stp_10.42.42.5(pid=31437): stdout: | (launched: 2022-12-09_23:48:25.272634) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:48:26.692409 run osmo-stp_10.42.42.5(pid=31437): stderr: | 20221209234825441 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234825441 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234825441 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234825441 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234825442 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234825442 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234825442 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:48:26.816678 run osmo-stp_10.42.42.5(pid=31437): stdout: | (launched: 2022-12-09_23:48:25.272634) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:48:26.935333 run osmo-stp_10.42.42.5(pid=31437): stderr: | 20221209234825441 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234825441 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234825441 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234825441 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234825442 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234825442 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234825442 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:48:27.077802 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31437): Process ended prematurely: osmo-stp_10.42.42.5(pid=31437) [trial-2366↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31437)] [trial-2366↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 23:48:27.086765 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 23:48:27.113108 run osmo-hlr_10.42.42.2(pid=31434): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31434)] 23:48:27.160497 run osmo-hlr_10.42.42.2(pid=31434): stdout: | (launched: 2022-12-09_23:48:24.346696) 23:48:27.209463 run osmo-hlr_10.42.42.2(pid=31434): stderr: | 20221209234824522 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209234824522 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209234824523 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209234824523 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209234824523 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209234824523 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209234824535 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209234824546 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209234824546 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209234824546 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:48:27.278055 run osmo-msc_10.42.42.6(pid=31440): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31440)] 23:48:27.325544 run osmo-msc_10.42.42.6(pid=31440): stdout: | (launched: 2022-12-09_23:48:26.221529) 23:48:27.373823 run osmo-msc_10.42.42.6(pid=31440): stderr: | 20221209234826492 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209234826492 DLGLOBAL DEBUG validating counter group 0x7fa363598c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209234826493 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209234826493 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209234826493 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209234826493 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209234826495 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209234826495 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209234826495 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209234826495 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:48:27.422721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31433): Terminating (SIGTERM) 23:48:27.461583 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31436): Terminating (SIGTERM) 23:48:27.500714 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31439): Terminating (SIGTERM) 23:48:27.540238 --- ParallelTerminationStrategy: PID 31433 died... 23:48:27.559038 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31433): Terminated: ok {rc=0} 23:48:27.602382 --- ParallelTerminationStrategy: PID 31436 died... 23:48:27.620642 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31436): Terminated: ok {rc=0} 23:48:27.664030 --- ParallelTerminationStrategy: PID 31439 died... 23:48:27.682511 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31439): Terminated: ok {rc=0} 23:48:27.767226 bus /sierra_3: Setting Powered False 23:48:28.866004 bus /sierra_3: Setting Powered False 23:48:29.981999 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 23:48:31.265405 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:48:31.274230 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 23:48:31.314251 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 23:48:31.341847 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 23:48:31.394894 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 23:48:31.441966 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 23:48:31.482011 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 23:48:32.008403 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 23:48:32.066941 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:48:32.079462 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 23:48:32.152869 tst mo_mt_call.py: using LAC 24517 23:48:32.287577 tst mo_mt_call.py: using RAC 37 23:48:32.413403 tst mo_mt_call.py: using CellId 24517 23:48:32.537207 tst mo_mt_call.py: using BVCI 24518 23:48:32.654292 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:48:32.665862 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:48:32.677473 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:48:32.688906 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:48:32.700508 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:48:32.712171 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:48:32.832333 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:48:32.951297 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:48:33.414356 run create_hlr_db(pid=31446): Launched 23:48:33.536379 bus /sierra_2: Setting Powered False 23:48:34.596370 run create_hlr_db(pid=31446): Terminated: ok {rc=0} 23:48:35.012312 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31448): Launched 23:48:35.310060 run osmo-hlr_10.42.42.2(pid=31449): Launched 23:48:35.423350 run osmo-stp_10.42.42.5: Starting osmo-stp 23:48:35.948903 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31451): Launched 23:48:36.246734 run osmo-stp_10.42.42.5(pid=31452): Launched 23:48:36.359571 run osmo-msc_10.42.42.6: Starting osmo-msc 23:48:36.899646 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31454): Launched 23:48:37.197031 run osmo-msc_10.42.42.6(pid=31455): Launched 23:48:37.363580 run osmo-stp_10.42.42.5(pid=31452): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31452)] 23:48:37.489973 run osmo-stp_10.42.42.5(pid=31452): stdout: | (launched: 2022-12-09_23:48:36.192118) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:48:37.615635 run osmo-stp_10.42.42.5(pid=31452): stderr: | 20221209234836362 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234836362 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234836363 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234836363 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234836363 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234836363 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234836363 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:48:37.739534 run osmo-stp_10.42.42.5(pid=31452): stdout: | (launched: 2022-12-09_23:48:36.192118) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:48:37.858841 run osmo-stp_10.42.42.5(pid=31452): stderr: | 20221209234836362 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234836362 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234836363 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234836363 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234836363 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234836363 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234836363 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:48:38.000822 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31452): Process ended prematurely: osmo-stp_10.42.42.5(pid=31452) [trial-2366↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31452)] [trial-2366↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 23:48:38.009855 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 23:48:38.036022 run osmo-hlr_10.42.42.2(pid=31449): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31449)] 23:48:38.083636 run osmo-hlr_10.42.42.2(pid=31449): stdout: | (launched: 2022-12-09_23:48:35.255623) 23:48:38.132786 run osmo-hlr_10.42.42.2(pid=31449): stderr: | 20221209234835434 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209234835434 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209234835434 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209234835434 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209234835434 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209234835434 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209234835447 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209234835455 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209234835455 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209234835455 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:48:38.201178 run osmo-msc_10.42.42.6(pid=31455): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31455)] 23:48:38.248621 run osmo-msc_10.42.42.6(pid=31455): stdout: | (launched: 2022-12-09_23:48:37.142552) 23:48:38.298079 run osmo-msc_10.42.42.6(pid=31455): stderr: | 20221209234837411 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209234837412 DLGLOBAL DEBUG validating counter group 0x7fda0deacc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209234837412 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209234837412 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209234837412 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209234837412 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209234837416 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209234837417 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209234837417 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209234837417 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:48:38.347637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31448): Terminating (SIGTERM) 23:48:38.386864 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31451): Terminating (SIGTERM) 23:48:38.426205 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31454): Terminating (SIGTERM) 23:48:38.465863 --- ParallelTerminationStrategy: PID 31448 died... 23:48:38.484776 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31448): Terminated: ok {rc=0} 23:48:38.529143 --- ParallelTerminationStrategy: PID 31451 died... 23:48:38.547755 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31451): Terminated: ok {rc=0} 23:48:38.591471 --- ParallelTerminationStrategy: PID 31454 died... 23:48:38.610046 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31454): Terminated: ok {rc=0} 23:48:38.695302 bus /sierra_3: Setting Powered False 23:48:39.794810 bus /sierra_3: Setting Powered False 23:48:40.908828 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 23:48:42.053605 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:48:42.065331 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 23:48:42.134019 tst mo_mt_call_osmux.py: using LAC 24518 23:48:42.260267 tst mo_mt_call_osmux.py: using RAC 38 23:48:42.385350 tst mo_mt_call_osmux.py: using CellId 24518 23:48:42.510307 tst mo_mt_call_osmux.py: using BVCI 24519 23:48:42.628229 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:48:42.639942 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:48:42.651453 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:48:42.663014 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:48:42.674671 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:48:42.686109 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:48:42.801230 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:48:42.915089 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:48:43.412244 run create_hlr_db(pid=31457): Launched 23:48:43.534915 bus /sierra_2: Setting Powered False 23:48:44.598347 run create_hlr_db(pid=31457): Terminated: ok {rc=0} 23:48:45.044142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31459): Launched 23:48:45.363240 run osmo-hlr_10.42.42.2(pid=31460): Launched 23:48:45.485321 run osmo-stp_10.42.42.5: Starting osmo-stp 23:48:46.058914 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31462): Launched 23:48:46.383678 run osmo-stp_10.42.42.5(pid=31463): Launched 23:48:46.524060 run osmo-msc_10.42.42.6: Starting osmo-msc 23:48:47.282090 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31465): Launched 23:48:47.579171 run osmo-msc_10.42.42.6(pid=31466): Launched 23:48:47.745165 run osmo-stp_10.42.42.5(pid=31463): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31463)] 23:48:47.871917 run osmo-stp_10.42.42.5(pid=31463): stdout: | (launched: 2022-12-09_23:48:46.321604) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:48:47.997287 run osmo-stp_10.42.42.5(pid=31463): stderr: | 20221209234846677 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234846677 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234846677 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234846678 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234846678 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234846678 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234846678 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:48:48.120878 run osmo-stp_10.42.42.5(pid=31463): stdout: | (launched: 2022-12-09_23:48:46.321604) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:48:48.239116 run osmo-stp_10.42.42.5(pid=31463): stderr: | 20221209234846677 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234846677 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234846677 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234846678 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234846678 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234846678 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234846678 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:48:48.381501 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31463): Process ended prematurely: osmo-stp_10.42.42.5(pid=31463) [trial-2366↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31463)] [trial-2366↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 23:48:48.390368 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 23:48:48.416351 run osmo-hlr_10.42.42.2(pid=31460): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31460)] 23:48:48.463202 run osmo-hlr_10.42.42.2(pid=31460): stdout: | (launched: 2022-12-09_23:48:45.305450) 23:48:48.511865 run osmo-hlr_10.42.42.2(pid=31460): stderr: | 20221209234845501 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209234845501 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209234845501 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209234845501 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209234845501 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209234845501 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209234845514 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209234845524 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209234845525 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209234845525 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:48:48.580241 run osmo-msc_10.42.42.6(pid=31466): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31466)] 23:48:48.627437 run osmo-msc_10.42.42.6(pid=31466): stdout: | (launched: 2022-12-09_23:48:47.524920) 23:48:48.676246 run osmo-msc_10.42.42.6(pid=31466): stderr: | 20221209234847793 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209234847793 DLGLOBAL DEBUG validating counter group 0x7f03681d1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209234847793 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209234847794 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209234847794 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209234847794 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209234847796 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209234847797 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209234847797 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209234847797 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:48:48.725213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31459): Terminating (SIGTERM) 23:48:48.764139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31462): Terminating (SIGTERM) 23:48:48.803298 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31465): Terminating (SIGTERM) 23:48:48.842722 --- ParallelTerminationStrategy: PID 31459 died... 23:48:48.861567 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31459): Terminated: ok {rc=0} 23:48:48.904909 --- ParallelTerminationStrategy: PID 31462 died... 23:48:48.923779 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31462): Terminated: ok {rc=0} 23:48:48.967056 --- ParallelTerminationStrategy: PID 31465 died... 23:48:48.985546 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31465): Terminated: ok {rc=0} 23:48:49.068279 bus /sierra_3: Setting Powered False 23:48:50.161438 bus /sierra_3: Setting Powered False 23:48:51.275131 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 23:48:52.520901 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:48:52.527240 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 23:48:52.559424 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 23:48:52.585893 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 23:48:52.638199 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 23:48:52.670830 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 23:48:52.697246 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 23:48:53.247260 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 23:48:53.294799 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:48:53.305825 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 23:48:53.373725 tst mo_mt_call.py: using LAC 24519 23:48:53.489837 tst mo_mt_call.py: using RAC 39 23:48:53.609029 tst mo_mt_call.py: using CellId 24519 23:48:53.726784 tst mo_mt_call.py: using BVCI 24520 23:48:53.836308 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:48:53.847432 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:48:53.858288 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:48:53.869205 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:48:53.880014 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:48:53.890815 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:48:54.008467 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:48:54.124764 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:48:54.585777 run create_hlr_db(pid=31471): Launched 23:48:54.706870 bus /sierra_2: Setting Powered False 23:48:55.766380 run create_hlr_db(pid=31471): Terminated: ok {rc=0} 23:48:56.203316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31473): Launched 23:48:56.522969 run osmo-hlr_10.42.42.2(pid=31474): Launched 23:48:56.645419 run osmo-stp_10.42.42.5: Starting osmo-stp 23:48:57.199607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31476): Launched 23:48:57.518960 run osmo-stp_10.42.42.5(pid=31477): Launched 23:48:57.641789 run osmo-msc_10.42.42.6: Starting osmo-msc 23:48:58.221578 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31479): Launched 23:48:58.541198 run osmo-msc_10.42.42.6(pid=31480): Launched 23:48:58.720205 run osmo-stp_10.42.42.5(pid=31477): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31477)] 23:48:58.857090 run osmo-stp_10.42.42.5(pid=31477): stdout: | (launched: 2022-12-09_23:48:57.460543) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:48:58.993775 run osmo-stp_10.42.42.5(pid=31477): stderr: | 20221209234857652 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234857652 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234857652 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234857653 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234857653 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234857653 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234857653 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:48:59.128705 run osmo-stp_10.42.42.5(pid=31477): stdout: | (launched: 2022-12-09_23:48:57.460543) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:48:59.256262 run osmo-stp_10.42.42.5(pid=31477): stderr: | 20221209234857652 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234857652 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234857652 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234857653 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234857653 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234857653 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234857653 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:48:59.408840 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31477): Process ended prematurely: osmo-stp_10.42.42.5(pid=31477) [trial-2366↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31477)] [trial-2366↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 23:48:59.418660 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 23:48:59.446995 run osmo-hlr_10.42.42.2(pid=31474): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31474)] 23:48:59.497142 run osmo-hlr_10.42.42.2(pid=31474): stdout: | (launched: 2022-12-09_23:48:56.464618) 23:48:59.549104 run osmo-hlr_10.42.42.2(pid=31474): stderr: | 20221209234856662 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209234856662 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209234856662 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209234856662 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209234856662 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209234856662 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209234856674 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209234856683 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209234856683 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209234856683 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:48:59.621324 run osmo-msc_10.42.42.6(pid=31480): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31480)] 23:48:59.671462 run osmo-msc_10.42.42.6(pid=31480): stdout: | (launched: 2022-12-09_23:48:58.483020) 23:48:59.723064 run osmo-msc_10.42.42.6(pid=31480): stderr: | 20221209234858802 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209234858802 DLGLOBAL DEBUG validating counter group 0x7fe661c79c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209234858802 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209234858802 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209234858802 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209234858803 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209234858806 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209234858807 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209234858807 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209234858807 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:48:59.774905 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31473): Terminating (SIGTERM) 23:48:59.816677 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31476): Terminating (SIGTERM) 23:48:59.858479 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31479): Terminating (SIGTERM) 23:48:59.900456 --- ParallelTerminationStrategy: PID 31473 died... 23:48:59.920343 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31473): Terminated: ok {rc=0} 23:48:59.967497 --- ParallelTerminationStrategy: PID 31476 died... 23:48:59.987297 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31476): Terminated: ok {rc=0} 23:49:00.033753 --- ParallelTerminationStrategy: PID 31479 died... 23:49:00.053367 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31479): Terminated: ok {rc=0} 23:49:00.141411 bus /sierra_3: Setting Powered False 23:49:01.235933 bus /sierra_3: Setting Powered False 23:49:02.353708 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 23:49:03.498462 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:49:03.510002 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 23:49:03.579063 tst mo_mt_call_osmux.py: using LAC 24520 23:49:03.705248 tst mo_mt_call_osmux.py: using RAC 40 23:49:03.830742 tst mo_mt_call_osmux.py: using CellId 24520 23:49:03.955537 tst mo_mt_call_osmux.py: using BVCI 24521 23:49:04.073714 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:49:04.085326 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:49:04.096643 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:49:04.108100 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:49:04.119721 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:49:04.131261 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:49:04.247003 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:49:04.367822 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:49:04.863509 run create_hlr_db(pid=31482): Launched 23:49:04.985284 bus /sierra_2: Setting Powered False 23:49:06.048560 run create_hlr_db(pid=31482): Terminated: ok {rc=0} 23:49:06.493751 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31484): Launched 23:49:06.813694 run osmo-hlr_10.42.42.2(pid=31485): Launched 23:49:06.935929 run osmo-stp_10.42.42.5: Starting osmo-stp 23:49:07.488567 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31487): Launched 23:49:07.806986 run osmo-stp_10.42.42.5(pid=31488): Launched 23:49:07.928599 run osmo-msc_10.42.42.6: Starting osmo-msc 23:49:08.508752 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31490): Launched 23:49:08.828626 run osmo-msc_10.42.42.6(pid=31491): Launched 23:49:09.007237 run osmo-stp_10.42.42.5(pid=31488): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31488)] 23:49:09.142420 run osmo-stp_10.42.42.5(pid=31488): stdout: | (launched: 2022-12-09_23:49:07.749284) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:49:09.277921 run osmo-stp_10.42.42.5(pid=31488): stderr: | 20221209234907941 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234907941 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234907941 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234907942 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234907944 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234907944 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234907944 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:49:09.412333 run osmo-stp_10.42.42.5(pid=31488): stdout: | (launched: 2022-12-09_23:49:07.749284) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:49:09.539862 run osmo-stp_10.42.42.5(pid=31488): stderr: | 20221209234907941 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234907941 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234907941 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234907942 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234907944 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234907944 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234907944 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:49:09.693126 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31488): Process ended prematurely: osmo-stp_10.42.42.5(pid=31488) [trial-2366↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31488)] [trial-2366↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 23:49:09.702836 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 23:49:09.731174 run osmo-hlr_10.42.42.2(pid=31485): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31485)] 23:49:09.781446 run osmo-hlr_10.42.42.2(pid=31485): stdout: | (launched: 2022-12-09_23:49:06.755307) 23:49:09.833638 run osmo-hlr_10.42.42.2(pid=31485): stderr: | 20221209234906953 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209234906953 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209234906953 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209234906953 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209234906953 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209234906953 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209234906965 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209234906973 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209234906973 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209234906974 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:49:09.906519 run osmo-msc_10.42.42.6(pid=31491): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31491)] 23:49:09.956769 run osmo-msc_10.42.42.6(pid=31491): stdout: | (launched: 2022-12-09_23:49:08.770471) 23:49:10.009214 run osmo-msc_10.42.42.6(pid=31491): stderr: | 20221209234909093 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209234909093 DLGLOBAL DEBUG validating counter group 0x7ff413eeec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209234909093 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209234909094 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209234909094 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209234909094 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209234909095 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209234909096 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209234909096 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209234909096 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:49:10.061498 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31484): Terminating (SIGTERM) 23:49:10.103385 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31487): Terminating (SIGTERM) 23:49:10.145460 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31490): Terminating (SIGTERM) 23:49:10.187867 --- ParallelTerminationStrategy: PID 31484 died... 23:49:10.207900 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31484): Terminated: ok {rc=0} 23:49:10.254574 --- ParallelTerminationStrategy: PID 31487 died... 23:49:10.274279 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31487): Terminated: ok {rc=0} 23:49:10.321417 --- ParallelTerminationStrategy: PID 31490 died... 23:49:10.340993 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31490): Terminated: ok {rc=0} 23:49:10.430053 bus /sierra_3: Setting Powered False 23:49:11.529206 bus /sierra_3: Setting Powered False 23:49:12.646484 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 23:49:13.900249 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:49:13.906601 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 23:49:13.938552 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 23:49:13.964896 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 23:49:14.015717 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 23:49:14.047360 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 23:49:14.073523 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 23:49:14.629446 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 23:49:14.684228 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:49:14.696130 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 23:49:14.765882 tst mo_mt_call.py: using LAC 24521 23:49:14.891839 tst mo_mt_call.py: using RAC 41 23:49:15.018043 tst mo_mt_call.py: using CellId 24521 23:49:15.142595 tst mo_mt_call.py: using BVCI 24522 23:49:15.259215 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:49:15.271032 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:49:15.282766 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:49:15.294849 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:49:15.307587 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:49:15.319580 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:49:15.436564 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:49:15.557033 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:49:16.078491 run create_hlr_db(pid=31496): Launched 23:49:16.234556 bus /sierra_2: Setting Powered False 23:49:17.294229 run create_hlr_db(pid=31496): Terminated: ok {rc=0} 23:49:17.730050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31498): Launched 23:49:18.050077 run osmo-hlr_10.42.42.2(pid=31499): Launched 23:49:18.172694 run osmo-stp_10.42.42.5: Starting osmo-stp 23:49:18.721310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31501): Launched 23:49:19.019073 run osmo-stp_10.42.42.5(pid=31502): Launched 23:49:19.132281 run osmo-msc_10.42.42.6: Starting osmo-msc 23:49:19.670280 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31504): Launched 23:49:19.969158 run osmo-msc_10.42.42.6(pid=31505): Launched 23:49:20.135817 run osmo-stp_10.42.42.5(pid=31502): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31502)] 23:49:20.261909 run osmo-stp_10.42.42.5(pid=31502): stdout: | (launched: 2022-12-09_23:49:18.965118) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:49:20.388554 run osmo-stp_10.42.42.5(pid=31502): stderr: | 20221209234919135 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234919135 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234919135 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234919136 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234919136 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234919136 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234919136 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:49:20.512876 run osmo-stp_10.42.42.5(pid=31502): stdout: | (launched: 2022-12-09_23:49:18.965118) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:49:20.631605 run osmo-stp_10.42.42.5(pid=31502): stderr: | 20221209234919135 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234919135 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234919135 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234919136 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234919136 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234919136 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234919136 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:49:20.774090 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31502): Process ended prematurely: osmo-stp_10.42.42.5(pid=31502) [trial-2366↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31502)] [trial-2366↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 23:49:20.782980 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 23:49:20.809262 run osmo-hlr_10.42.42.2(pid=31499): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31499)] 23:49:20.856471 run osmo-hlr_10.42.42.2(pid=31499): stdout: | (launched: 2022-12-09_23:49:17.992141) 23:49:20.905218 run osmo-hlr_10.42.42.2(pid=31499): stderr: | 20221209234918188 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209234918189 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209234918189 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209234918189 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209234918189 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209234918189 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209234918230 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209234918239 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209234918240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209234918240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:49:20.973368 run osmo-msc_10.42.42.6(pid=31505): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31505)] 23:49:21.020494 run osmo-msc_10.42.42.6(pid=31505): stdout: | (launched: 2022-12-09_23:49:19.914380) 23:49:21.069136 run osmo-msc_10.42.42.6(pid=31505): stderr: | 20221209234920184 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209234920184 DLGLOBAL DEBUG validating counter group 0x7f6d3abd4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209234920184 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209234920184 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209234920184 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209234920184 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209234920186 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209234920187 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209234920188 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209234920188 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:49:21.118097 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31498): Terminating (SIGTERM) 23:49:21.157121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31501): Terminating (SIGTERM) 23:49:21.196146 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31504): Terminating (SIGTERM) 23:49:21.235866 --- ParallelTerminationStrategy: PID 31498 died... 23:49:21.254877 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31498): Terminated: ok {rc=0} 23:49:21.298687 --- ParallelTerminationStrategy: PID 31501 died... 23:49:21.317223 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31501): Terminated: ok {rc=0} 23:49:21.360688 --- ParallelTerminationStrategy: PID 31504 died... 23:49:21.379457 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31504): Terminated: ok {rc=0} 23:49:21.465531 bus /sierra_3: Setting Powered False 23:49:22.563006 bus /sierra_3: Setting Powered False 23:49:23.678363 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 23:49:24.823893 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:49:24.835786 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 23:49:24.906097 tst mo_mt_call_osmux.py: using LAC 24522 23:49:25.024678 tst mo_mt_call_osmux.py: using RAC 42 23:49:25.142844 tst mo_mt_call_osmux.py: using CellId 24522 23:49:25.262900 tst mo_mt_call_osmux.py: using BVCI 24523 23:49:25.373348 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:49:25.384617 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:49:25.395562 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:49:25.406957 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:49:25.418593 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:49:25.430094 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:49:25.545395 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:49:25.664926 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:49:26.162798 run create_hlr_db(pid=31507): Launched 23:49:26.286054 bus /sierra_2: Setting Powered False 23:49:27.350487 run create_hlr_db(pid=31507): Terminated: ok {rc=0} 23:49:27.779381 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31509): Launched 23:49:28.078638 run osmo-hlr_10.42.42.2(pid=31510): Launched 23:49:28.192294 run osmo-stp_10.42.42.5: Starting osmo-stp 23:49:28.705275 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31512): Launched 23:49:29.003109 run osmo-stp_10.42.42.5(pid=31513): Launched 23:49:29.116857 run osmo-msc_10.42.42.6: Starting osmo-msc 23:49:29.655498 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31515): Launched 23:49:29.953672 run osmo-msc_10.42.42.6(pid=31516): Launched 23:49:30.120926 run osmo-stp_10.42.42.5(pid=31513): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31513)] 23:49:30.247898 run osmo-stp_10.42.42.5(pid=31513): stdout: | (launched: 2022-12-09_23:49:28.948719) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:49:30.374475 run osmo-stp_10.42.42.5(pid=31513): stderr: | 20221209234929120 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234929120 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234929120 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234929121 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234929121 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234929121 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234929121 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:49:30.499036 run osmo-stp_10.42.42.5(pid=31513): stdout: | (launched: 2022-12-09_23:49:28.948719) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:49:30.618608 run osmo-stp_10.42.42.5(pid=31513): stderr: | 20221209234929120 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234929120 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234929120 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234929121 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234929121 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234929121 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234929121 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:49:30.761538 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31513): Process ended prematurely: osmo-stp_10.42.42.5(pid=31513) [trial-2366↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31513)] [trial-2366↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 23:49:30.770628 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 23:49:30.796716 run osmo-hlr_10.42.42.2(pid=31510): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31510)] 23:49:30.843952 run osmo-hlr_10.42.42.2(pid=31510): stdout: | (launched: 2022-12-09_23:49:28.024146) 23:49:30.894066 run osmo-hlr_10.42.42.2(pid=31510): stderr: | 20221209234928201 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209234928201 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209234928201 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209234928201 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209234928201 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209234928201 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209234928213 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209234928222 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209234928222 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209234928222 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:49:30.980239 run osmo-msc_10.42.42.6(pid=31516): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31516)] 23:49:31.029262 run osmo-msc_10.42.42.6(pid=31516): stdout: | (launched: 2022-12-09_23:49:29.899462) 23:49:31.081838 run osmo-msc_10.42.42.6(pid=31516): stderr: | 20221209234930172 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209234930172 DLGLOBAL DEBUG validating counter group 0x7f900754dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209234930172 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209234930172 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209234930172 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209234930173 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209234930174 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209234930175 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209234930175 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209234930175 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:49:31.132455 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31509): Terminating (SIGTERM) 23:49:31.172900 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31512): Terminating (SIGTERM) 23:49:31.213859 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31515): Terminating (SIGTERM) 23:49:31.254428 --- ParallelTerminationStrategy: PID 31509 died... 23:49:31.273585 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31509): Terminated: ok {rc=0} 23:49:31.318233 --- ParallelTerminationStrategy: PID 31512 died... 23:49:31.337172 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31512): Terminated: ok {rc=0} 23:49:31.381932 --- ParallelTerminationStrategy: PID 31515 died... 23:49:31.400715 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31515): Terminated: ok {rc=0} 23:49:31.487761 bus /sierra_3: Setting Powered False 23:49:32.591435 bus /sierra_3: Setting Powered False 23:49:33.706500 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 voice:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 23:49:34.956403 tst voice:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:49:34.962527 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 23:49:34.996665 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 23:49:35.024422 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 23:49:35.078167 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 23:49:35.112298 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 23:49:35.140245 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 23:49:35.688602 tst voice:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 23:49:35.740875 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:49:35.752322 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:49:35.822589 tst mo_mt_call.py: using LAC 24523 23:49:35.950241 tst mo_mt_call.py: using RAC 43 23:49:36.077354 tst mo_mt_call.py: using CellId 24523 23:49:36.201099 tst mo_mt_call.py: using BVCI 24524 23:49:36.317475 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:49:36.328687 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:49:36.339895 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:49:36.351279 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:49:36.362967 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:49:36.374573 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:49:36.490004 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:49:36.609176 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:49:37.073215 run create_hlr_db(pid=31521): Launched 23:49:37.196301 bus /sierra_2: Setting Powered False 23:49:38.256936 run create_hlr_db(pid=31521): Terminated: ok {rc=0} 23:49:38.674485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31523): Launched 23:49:38.972549 run osmo-hlr_10.42.42.2(pid=31524): Launched 23:49:39.085778 run osmo-stp_10.42.42.5: Starting osmo-stp 23:49:39.601601 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31526): Launched 23:49:39.900428 run osmo-stp_10.42.42.5(pid=31527): Launched 23:49:40.014576 run osmo-msc_10.42.42.6: Starting osmo-msc 23:49:40.553202 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31529): Launched 23:49:40.850702 run osmo-msc_10.42.42.6(pid=31530): Launched 23:49:41.015764 run osmo-stp_10.42.42.5(pid=31527): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31527)] 23:49:41.140935 run osmo-stp_10.42.42.5(pid=31527): stdout: | (launched: 2022-12-09_23:49:39.845334) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:49:41.266417 run osmo-stp_10.42.42.5(pid=31527): stderr: | 20221209234940016 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234940017 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234940017 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234940017 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234940018 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234940018 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234940018 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:49:41.390298 run osmo-stp_10.42.42.5(pid=31527): stdout: | (launched: 2022-12-09_23:49:39.845334) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:49:41.508638 run osmo-stp_10.42.42.5(pid=31527): stderr: | 20221209234940016 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234940017 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234940017 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234940017 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234940018 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234940018 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234940018 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:49:41.650659 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31527): Process ended prematurely: osmo-stp_10.42.42.5(pid=31527) [trial-2366↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31527)] [trial-2366↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 23:49:41.659566 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 23:49:41.685730 run osmo-hlr_10.42.42.2(pid=31524): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31524)] 23:49:41.732891 run osmo-hlr_10.42.42.2(pid=31524): stdout: | (launched: 2022-12-09_23:49:38.918001) 23:49:41.781707 run osmo-hlr_10.42.42.2(pid=31524): stderr: | 20221209234939096 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209234939096 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209234939096 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209234939096 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209234939096 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209234939096 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209234939108 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209234939117 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209234939117 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209234939117 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:49:41.850095 run osmo-msc_10.42.42.6(pid=31530): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31530)] 23:49:41.898114 run osmo-msc_10.42.42.6(pid=31530): stdout: | (launched: 2022-12-09_23:49:40.796335) 23:49:41.947134 run osmo-msc_10.42.42.6(pid=31530): stderr: | 20221209234941069 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209234941069 DLGLOBAL DEBUG validating counter group 0x7fc764ed3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209234941069 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209234941069 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209234941069 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209234941070 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209234941071 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209234941072 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209234941072 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209234941072 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:49:41.996416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31523): Terminating (SIGTERM) 23:49:42.035281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31526): Terminating (SIGTERM) 23:49:42.074413 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31529): Terminating (SIGTERM) 23:49:42.114197 --- ParallelTerminationStrategy: PID 31523 died... 23:49:42.133299 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31523): Terminated: ok {rc=0} 23:49:42.177208 --- ParallelTerminationStrategy: PID 31526 died... 23:49:42.195646 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31526): Terminated: ok {rc=0} 23:49:42.239210 --- ParallelTerminationStrategy: PID 31529 died... 23:49:42.258113 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31529): Terminated: ok {rc=0} 23:49:42.342547 bus /sierra_3: Setting Powered False 23:49:43.441501 bus /sierra_3: Setting Powered False 23:49:44.555002 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 23:49:45.703852 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:49:45.716100 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:49:45.788166 tst mo_mt_call_osmux.py: using LAC 24524 23:49:45.915586 tst mo_mt_call_osmux.py: using RAC 44 23:49:46.040212 tst mo_mt_call_osmux.py: using CellId 24524 23:49:46.172802 tst mo_mt_call_osmux.py: using BVCI 24525 23:49:46.331942 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:49:46.344671 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:49:46.358304 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:49:46.370189 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:49:46.382031 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:49:46.393716 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:49:46.511930 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:49:46.644054 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:49:47.168465 run create_hlr_db(pid=31532): Launched 23:49:47.316094 bus /sierra_2: Setting Powered False 23:49:48.376683 run create_hlr_db(pid=31532): Terminated: ok {rc=0} 23:49:48.793703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31534): Launched 23:49:49.092583 run osmo-hlr_10.42.42.2(pid=31535): Launched 23:49:49.205421 run osmo-stp_10.42.42.5: Starting osmo-stp 23:49:49.716915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31537): Launched 23:49:50.015442 run osmo-stp_10.42.42.5(pid=31538): Launched 23:49:50.128310 run osmo-msc_10.42.42.6: Starting osmo-msc 23:49:50.671003 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31540): Launched 23:49:50.968916 run osmo-msc_10.42.42.6(pid=31541): Launched 23:49:51.135980 run osmo-stp_10.42.42.5(pid=31538): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31538)] 23:49:51.262280 run osmo-stp_10.42.42.5(pid=31538): stdout: | (launched: 2022-12-09_23:49:49.960738) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:49:51.388510 run osmo-stp_10.42.42.5(pid=31538): stderr: | 20221209234950133 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234950133 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234950134 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234950134 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234950134 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234950134 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234950135 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:49:51.512541 run osmo-stp_10.42.42.5(pid=31538): stdout: | (launched: 2022-12-09_23:49:49.960738) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:49:51.632115 run osmo-stp_10.42.42.5(pid=31538): stderr: | 20221209234950133 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209234950133 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209234950134 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209234950134 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209234950134 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209234950134 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209234950135 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:49:51.774424 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31538): Process ended prematurely: osmo-stp_10.42.42.5(pid=31538) [trial-2366↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31538)] [trial-2366↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 23:49:51.783142 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 23:49:51.809648 run osmo-hlr_10.42.42.2(pid=31535): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31535)] 23:49:51.857357 run osmo-hlr_10.42.42.2(pid=31535): stdout: | (launched: 2022-12-09_23:49:49.037935) 23:49:51.906637 run osmo-hlr_10.42.42.2(pid=31535): stderr: | 20221209234949213 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209234949213 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209234949213 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209234949213 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209234949213 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209234949213 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209234949225 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209234949235 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209234949235 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209234949235 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:49:51.976186 run osmo-msc_10.42.42.6(pid=31541): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31541)] 23:49:52.024007 run osmo-msc_10.42.42.6(pid=31541): stdout: | (launched: 2022-12-09_23:49:50.914469) 23:49:52.073841 run osmo-msc_10.42.42.6(pid=31541): stderr: | 20221209234951188 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209234951188 DLGLOBAL DEBUG validating counter group 0x7f8fa5f56c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209234951188 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209234951188 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209234951188 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209234951189 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209234951190 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209234951191 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209234951191 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209234951191 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:49:52.123726 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31534): Terminating (SIGTERM) 23:49:52.163288 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31537): Terminating (SIGTERM) 23:49:52.202728 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31540): Terminating (SIGTERM) 23:49:52.242478 --- ParallelTerminationStrategy: PID 31534 died... 23:49:52.261606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31534): Terminated: ok {rc=0} 23:49:52.305770 --- ParallelTerminationStrategy: PID 31537 died... 23:49:52.324279 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31537): Terminated: ok {rc=0} 23:49:52.368456 --- ParallelTerminationStrategy: PID 31540 died... 23:49:52.387082 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31540): Terminated: ok {rc=0} 23:49:52.470903 bus /sierra_3: Setting Powered False 23:49:53.566770 bus /sierra_3: Setting Powered False 23:49:54.681628 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 voice:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 23:49:55.926820 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:49:55.932941 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 23:49:55.964915 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 23:49:55.991762 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 23:49:56.043598 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 23:49:56.075729 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 23:49:56.102013 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 23:49:56.658178 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 23:49:56.712611 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:49:56.724591 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 23:49:56.778329 tst mo_mt_call.py: using LAC 24525 23:49:56.905732 tst mo_mt_call.py: using RAC 45 23:49:57.024668 tst mo_mt_call.py: using CellId 24525 23:49:57.142613 tst mo_mt_call.py: using BVCI 24526 23:49:57.253537 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:49:57.264902 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:49:57.276236 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:49:57.287367 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:49:57.298466 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:49:57.309560 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 23:49:57.425235 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 23:49:57.544528 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:49:58.041495 run create_hlr_db(pid=31546): Launched 23:49:58.164453 bus /sierra_2: Setting Powered False 23:49:59.228730 run create_hlr_db(pid=31546): Terminated: ok {rc=0} 23:49:59.655834 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31548): Launched 23:49:59.956136 run osmo-hlr_10.42.42.2(pid=31549): Launched 23:50:00.071025 run osmo-stp_10.42.42.5: Starting osmo-stp 23:50:00.598696 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31551): Launched 23:50:00.909634 run osmo-stp_10.42.42.5(pid=31552): Launched 23:50:01.130414 run osmo-msc_10.42.42.6: Starting osmo-msc 23:50:01.779680 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31557): Launched 23:50:02.150488 run osmo-msc_10.42.42.6(pid=31558): Launched 23:50:02.454791 run osmo-stp_10.42.42.5(pid=31552): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31552)] 23:50:02.594547 run osmo-stp_10.42.42.5(pid=31552): stdout: | (launched: 2022-12-09_23:50:00.845184) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:50:02.736127 run osmo-stp_10.42.42.5(pid=31552): stderr: | 20221209235001116 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235001116 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235001116 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235001120 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235001122 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235001122 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235001122 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:50:02.871288 run osmo-stp_10.42.42.5(pid=31552): stdout: | (launched: 2022-12-09_23:50:00.845184) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:50:02.999562 run osmo-stp_10.42.42.5(pid=31552): stderr: | 20221209235001116 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235001116 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235001116 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235001120 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235001122 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235001122 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235001122 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:50:03.153112 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31552): Process ended prematurely: osmo-stp_10.42.42.5(pid=31552) [trial-2366↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31552)] [trial-2366↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 23:50:03.162867 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 23:50:03.191394 run osmo-hlr_10.42.42.2(pid=31549): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31549)] 23:50:03.241789 run osmo-hlr_10.42.42.2(pid=31549): stdout: | (launched: 2022-12-09_23:49:59.901676) 23:50:03.294161 run osmo-hlr_10.42.42.2(pid=31549): stderr: | 20221209235000080 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209235000080 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209235000080 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209235000080 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209235000080 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209235000080 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209235000095 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209235000105 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209235000105 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209235000105 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:50:03.366839 run osmo-msc_10.42.42.6(pid=31558): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31558)] 23:50:03.417072 run osmo-msc_10.42.42.6(pid=31558): stdout: | (launched: 2022-12-09_23:50:02.086613) 23:50:03.468920 run osmo-msc_10.42.42.6(pid=31558): stderr: | 20221209235002498 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209235002498 DLGLOBAL DEBUG validating counter group 0x7fbddf718c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209235002498 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209235002498 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209235002499 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209235002499 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209235002500 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209235002501 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209235002501 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209235002501 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:50:03.521300 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31548): Terminating (SIGTERM) 23:50:03.563553 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31551): Terminating (SIGTERM) 23:50:03.605944 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31557): Terminating (SIGTERM) 23:50:03.648205 --- ParallelTerminationStrategy: PID 31548 died... 23:50:03.668298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31548): Terminated: ok {rc=0} 23:50:03.715382 --- ParallelTerminationStrategy: PID 31551 died... 23:50:03.735017 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31551): Terminated: ok {rc=0} 23:50:03.781426 --- ParallelTerminationStrategy: PID 31557 died... 23:50:03.801075 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31557): Terminated: ok {rc=0} 23:50:03.888891 bus /sierra_3: Setting Powered False 23:50:04.987358 bus /sierra_3: Setting Powered False 23:50:06.102958 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 23:50:07.253835 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:50:07.266358 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 23:50:07.319817 tst mo_mt_call_osmux.py: using LAC 24526 23:50:07.445558 tst mo_mt_call_osmux.py: using RAC 46 23:50:07.564083 tst mo_mt_call_osmux.py: using CellId 24526 23:50:07.681021 tst mo_mt_call_osmux.py: using BVCI 24527 23:50:07.789118 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:50:07.800225 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:50:07.811235 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:50:07.822359 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:50:07.833829 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 23:50:07.844808 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 23:50:07.965433 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 23:50:08.084701 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:50:08.581656 run create_hlr_db(pid=31560): Launched 23:50:08.704039 bus /sierra_2: Setting Powered False 23:50:09.767185 run create_hlr_db(pid=31560): Terminated: ok {rc=0} 23:50:10.213864 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31562): Launched 23:50:10.533438 run osmo-hlr_10.42.42.2(pid=31563): Launched 23:50:10.656452 run osmo-stp_10.42.42.5: Starting osmo-stp 23:50:11.212129 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31565): Launched 23:50:11.532244 run osmo-stp_10.42.42.5(pid=31566): Launched 23:50:11.654607 run osmo-msc_10.42.42.6: Starting osmo-msc 23:50:12.234107 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31568): Launched 23:50:12.553788 run osmo-msc_10.42.42.6(pid=31569): Launched 23:50:12.732657 run osmo-stp_10.42.42.5(pid=31566): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31566)] 23:50:12.868276 run osmo-stp_10.42.42.5(pid=31566): stdout: | (launched: 2022-12-09_23:50:11.474282) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:50:13.004433 run osmo-stp_10.42.42.5(pid=31566): stderr: | 20221209235011665 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235011666 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235011666 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235011666 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235011668 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235011669 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235011669 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:50:13.139828 run osmo-stp_10.42.42.5(pid=31566): stdout: | (launched: 2022-12-09_23:50:11.474282) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:50:13.267884 run osmo-stp_10.42.42.5(pid=31566): stderr: | 20221209235011665 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235011666 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235011666 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235011666 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235011668 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235011669 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235011669 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:50:13.421077 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31566): Process ended prematurely: osmo-stp_10.42.42.5(pid=31566) [trial-2366↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31566)] [trial-2366↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 23:50:13.430794 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 23:50:13.458740 run osmo-hlr_10.42.42.2(pid=31563): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31563)] 23:50:13.508487 run osmo-hlr_10.42.42.2(pid=31563): stdout: | (launched: 2022-12-09_23:50:10.475360) 23:50:13.560340 run osmo-hlr_10.42.42.2(pid=31563): stderr: | 20221209235010673 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209235010673 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209235010673 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209235010673 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209235010673 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209235010673 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209235010693 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209235010703 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209235010703 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209235010703 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:50:13.631972 run osmo-msc_10.42.42.6(pid=31569): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31569)] 23:50:13.681628 run osmo-msc_10.42.42.6(pid=31569): stdout: | (launched: 2022-12-09_23:50:12.495847) 23:50:13.733228 run osmo-msc_10.42.42.6(pid=31569): stderr: | 20221209235012816 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209235012816 DLGLOBAL DEBUG validating counter group 0x7faa76030c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209235012816 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209235012816 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209235012816 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209235012817 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209235012818 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209235012819 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209235012819 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209235012819 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:50:13.785050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31562): Terminating (SIGTERM) 23:50:13.826582 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31565): Terminating (SIGTERM) 23:50:13.867977 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31568): Terminating (SIGTERM) 23:50:13.909917 --- ParallelTerminationStrategy: PID 31562 died... 23:50:13.929783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31562): Terminated: ok {rc=0} 23:50:13.976156 --- ParallelTerminationStrategy: PID 31565 died... 23:50:13.996033 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31565): Terminated: ok {rc=0} 23:50:14.042230 --- ParallelTerminationStrategy: PID 31568 died... 23:50:14.061637 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31568): Terminated: ok {rc=0} 23:50:14.149590 bus /sierra_3: Setting Powered False 23:50:15.245503 bus /sierra_3: Setting Powered False 23:50:16.362507 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 emergency:trx-umtrx --------------------------------------------------------------------- 23:50:17.608425 tst emergency:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:50:17.612756 tst emergency:trx-umtrx: Verifying 1 x bts (candidates: 11) 23:50:17.644718 tst emergency:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 23:50:17.671329 tst emergency:trx-umtrx: Verifying 4 x modem (candidates: 12) 23:50:17.754562 tst emergency:trx-umtrx: Reserving 1 x bts (candidates: 11) 23:50:17.786443 tst emergency:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 23:50:17.812796 tst emergency:trx-umtrx: Reserving 4 x modem (candidates: 12) 23:50:18.396066 tst emergency:trx-umtrx: RESERVED RESOURCES for emergency: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2366 emergency:trx-umtrx emergency_mo_mt_call.py ---------------------------------------------- 23:50:18.401083 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 23:50:18.411674 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 23:50:18.459835 tst emergency_mo_mt_call.py: using LAC 24527 23:50:18.581449 tst emergency_mo_mt_call.py: using RAC 47 23:50:18.696917 tst emergency_mo_mt_call.py: using CellId 24527 23:50:18.811317 tst emergency_mo_mt_call.py: using BVCI 24528 23:50:18.917141 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 23:50:18.927756 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 23:50:18.938221 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 23:50:18.948554 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 23:50:18.958983 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 23:50:18.969376 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 23:50:19.085712 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 23:50:19.204918 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:50:19.661117 run create_hlr_db(pid=31574): Launched 23:50:19.781430 bus /sierra_2: Setting Powered False 23:50:20.840661 run create_hlr_db(pid=31574): Terminated: ok {rc=0} 23:50:21.249686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31576): Launched 23:50:21.543735 run osmo-hlr_10.42.42.2(pid=31577): Launched 23:50:21.655818 run osmo-stp_10.42.42.5: Starting osmo-stp 23:50:22.159340 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31579): Launched 23:50:22.454007 run osmo-stp_10.42.42.5(pid=31580): Launched 23:50:22.576726 tst emergency_mo_mt_call.py: using MSISDN 7440 23:50:22.728107 run osmo-msc_10.42.42.6: Starting osmo-msc 23:50:23.255580 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31582): Launched 23:50:23.549175 run osmo-msc_10.42.42.6(pid=31583): Launched 23:50:23.713546 run osmo-stp_10.42.42.5(pid=31580): ERR: Terminated: ERROR {rc=1} [trial-2366↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31580)] 23:50:23.837846 run osmo-stp_10.42.42.5(pid=31580): stdout: | (launched: 2022-12-09_23:50:22.400275) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:50:23.962349 run osmo-stp_10.42.42.5(pid=31580): stderr: | 20221209235022569 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235022569 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235022569 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235022570 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235022572 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235022572 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235022572 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:50:24.084868 run osmo-stp_10.42.42.5(pid=31580): stdout: | (launched: 2022-12-09_23:50:22.400275) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:50:24.202492 run osmo-stp_10.42.42.5(pid=31580): stderr: | 20221209235022569 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235022569 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235022569 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235022570 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235022572 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235022572 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235022572 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:50:24.343251 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=31580): Process ended prematurely: osmo-stp_10.42.42.5(pid=31580) [trial-2366↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31580)] [trial-2366↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19] 23:50:24.351473 tst emergency_mo_mt_call.py:19: Test FAILED (5.9 sec) 23:50:24.377043 run osmo-hlr_10.42.42.2(pid=31577): ERR: Terminated: ERROR {rc=237} [trial-2366↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31577)] 23:50:24.423832 run osmo-hlr_10.42.42.2(pid=31577): stdout: | (launched: 2022-12-09_23:50:21.489549) 23:50:24.472390 run osmo-hlr_10.42.42.2(pid=31577): stderr: | 20221209235021667 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209235021667 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209235021667 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209235021667 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209235021667 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209235021667 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209235021679 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/emergency:trx-umtrx/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209235021688 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209235021688 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209235021688 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:50:24.540338 run osmo-msc_10.42.42.6(pid=31583): ERR: Terminated: ERROR {rc=2} [trial-2366↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31583)] 23:50:24.587412 run osmo-msc_10.42.42.6(pid=31583): stdout: | (launched: 2022-12-09_23:50:23.495199) 23:50:24.636121 run osmo-msc_10.42.42.6(pid=31583): stderr: | 20221209235023767 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209235023768 DLGLOBAL DEBUG validating counter group 0x7fdc0cafcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209235023768 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209235023768 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209235023768 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209235023768 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209235023770 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209235023771 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209235023771 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209235023771 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:50:24.684990 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31576): Terminating (SIGTERM) 23:50:24.723779 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31579): Terminating (SIGTERM) 23:50:24.762721 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31582): Terminating (SIGTERM) 23:50:24.802212 --- ParallelTerminationStrategy: PID 31576 died... 23:50:24.820939 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31576): Terminated: ok {rc=0} 23:50:24.864896 --- ParallelTerminationStrategy: PID 31579 died... 23:50:24.883836 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31579): Terminated: ok {rc=0} 23:50:24.927000 --- ParallelTerminationStrategy: PID 31582 died... 23:50:24.945443 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31582): Terminated: ok {rc=0} 23:50:25.030042 bus /sierra_3: Setting Powered False 23:50:26.128181 bus /sierra_3: Setting Powered False 23:50:27.242733 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 emergency:trx-umtrx emergency_preemptive_call.py ---------------------------------------------- 23:50:28.329700 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 23:50:28.341183 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 23:50:28.391798 tst emergency_preemptive_call.py: using LAC 24528 23:50:28.508019 tst emergency_preemptive_call.py: using RAC 48 23:50:28.622780 tst emergency_preemptive_call.py: using CellId 24528 23:50:28.739358 tst emergency_preemptive_call.py: using BVCI 24529 23:50:28.845659 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 23:50:28.856352 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 23:50:28.866962 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 23:50:28.877487 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 23:50:28.887902 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 23:50:28.898394 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 23:50:29.012575 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 23:50:29.131718 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 23:50:29.245575 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 23:50:29.363268 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:50:29.855620 run create_hlr_db(pid=31585): Launched 23:50:29.976818 bus /sierra_2: Setting Powered False 23:50:31.039507 run create_hlr_db(pid=31585): Terminated: ok {rc=0} 23:50:31.529113 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31587): Launched 23:50:31.865402 run osmo-hlr_10.42.42.2(pid=31588): Launched 23:50:32.022099 run osmo-stp_10.42.42.5: Starting osmo-stp 23:50:32.599924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31590): Launched 23:50:32.894253 run osmo-stp_10.42.42.5(pid=31591): Launched 23:50:33.016798 tst emergency_preemptive_call.py: using MSISDN 7441 23:50:33.167643 run osmo-msc_10.42.42.6: Starting osmo-msc 23:50:33.694339 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31593): Launched 23:50:33.986737 run osmo-msc_10.42.42.6(pid=31594): Launched 23:50:34.150791 run osmo-stp_10.42.42.5(pid=31591): ERR: Terminated: ERROR {rc=1} [trial-2366↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31591)] 23:50:34.275036 run osmo-stp_10.42.42.5(pid=31591): stdout: | (launched: 2022-12-09_23:50:32.840420) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:50:34.400621 run osmo-stp_10.42.42.5(pid=31591): stderr: | 20221209235033011 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235033011 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235033011 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235033012 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235033012 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235033012 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235033012 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:50:34.522914 run osmo-stp_10.42.42.5(pid=31591): stdout: | (launched: 2022-12-09_23:50:32.840420) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:50:34.639755 run osmo-stp_10.42.42.5(pid=31591): stderr: | 20221209235033011 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235033011 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235033011 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235033012 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235033012 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235033012 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235033012 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:50:34.780006 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=31591): Process ended prematurely: osmo-stp_10.42.42.5(pid=31591) [trial-2366↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31591)] [trial-2366↪emergency:trx-umtrx↪emergency_preemptive_call.py:32] 23:50:34.788589 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 23:50:34.814495 run osmo-hlr_10.42.42.2(pid=31588): ERR: Terminated: ERROR {rc=237} [trial-2366↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31588)] 23:50:34.862551 run osmo-hlr_10.42.42.2(pid=31588): stdout: | (launched: 2022-12-09_23:50:31.802173) 23:50:34.911732 run osmo-hlr_10.42.42.2(pid=31588): stderr: | 20221209235032207 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209235032207 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209235032207 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209235032207 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209235032207 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209235032207 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209235032225 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/emergency:trx-umtrx/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209235032234 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209235032234 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209235032234 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:50:34.980741 run osmo-msc_10.42.42.6(pid=31594): ERR: Terminated: ERROR {rc=2} [trial-2366↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31594)] 23:50:35.028270 run osmo-msc_10.42.42.6(pid=31594): stdout: | (launched: 2022-12-09_23:50:33.933296) 23:50:35.077368 run osmo-msc_10.42.42.6(pid=31594): stderr: | 20221209235034205 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209235034205 DLGLOBAL DEBUG validating counter group 0x7f77bb212c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209235034205 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209235034205 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209235034205 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209235034206 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209235034207 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209235034208 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209235034208 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209235034208 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:50:35.126566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31587): Terminating (SIGTERM) 23:50:35.165849 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31590): Terminating (SIGTERM) 23:50:35.205937 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31593): Terminating (SIGTERM) 23:50:35.245690 --- ParallelTerminationStrategy: PID 31587 died... 23:50:35.264521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31587): Terminated: ok {rc=0} 23:50:35.309270 --- ParallelTerminationStrategy: PID 31590 died... 23:50:35.328090 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31590): Terminated: ok {rc=0} 23:50:35.371933 --- ParallelTerminationStrategy: PID 31593 died... 23:50:35.390600 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31593): Terminated: ok {rc=0} 23:50:35.475754 bus /sierra_9: Setting Powered False 23:50:36.574167 bus /sierra_9: Setting Powered False 23:50:37.689764 bus /sierra_8: Setting Powered False 23:50:38.787987 bus /sierra_8: Setting Powered False 23:50:39.902704 bus /sierra_3: Setting Powered False 23:50:41.000639 bus /sierra_3: Setting Powered False 23:50:42.115804 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 emergency:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 gprs:trx-umtrx --------------------------------------------------------------------- 23:50:43.391831 tst gprs:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:50:43.396403 tst gprs:trx-umtrx: Verifying 1 x bts (candidates: 11) 23:50:43.429910 tst gprs:trx-umtrx: Verifying 9 x ip_address (candidates: 9) 23:50:43.469400 tst gprs:trx-umtrx: Verifying 4 x modem (candidates: 12) 23:50:43.556465 tst gprs:trx-umtrx: Reserving 1 x bts (candidates: 11) 23:50:43.590197 tst gprs:trx-umtrx: Reserving 9 x ip_address (candidates: 9) 23:50:43.630202 tst gprs:trx-umtrx: Reserving 4 x modem (candidates: 12) 23:50:44.222088 tst gprs:trx-umtrx: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2366 gprs:trx-umtrx cs_paging_gprs_active.py ---------------------------------------------- 23:50:44.275203 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:50:44.286192 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 23:50:44.335579 tst cs_paging_gprs_active.py: using LAC 24529 23:50:44.462991 tst cs_paging_gprs_active.py: using RAC 49 23:50:44.590634 tst cs_paging_gprs_active.py: using CellId 24529 23:50:44.718518 tst cs_paging_gprs_active.py: using BVCI 24530 23:50:44.837454 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:50:44.848465 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:50:44.859249 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:50:44.870345 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:50:44.881429 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:50:44.892232 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:50:44.903374 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:50:44.914341 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:50:44.925478 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 23:50:45.040306 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 23:50:45.160753 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:50:45.365189 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:50:45.666958 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31599): Launched 23:50:45.945680 run iperf3-srv_10.42.42.10(pid=31600): Launched 23:50:46.092314 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:50:46.298938 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:50:46.617778 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31601): Launched 23:50:46.897709 run iperf3-srv_10.42.42.10(pid=31602): Launched 23:50:47.056894 tst cs_paging_gprs_active.py:38: start network... 23:50:47.263984 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:50:47.729532 run create_hlr_db(pid=31603): Launched 23:50:47.853580 bus /sierra_2: Setting Powered False 23:50:48.913794 run create_hlr_db(pid=31603): Terminated: ok {rc=0} 23:50:49.353653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31605): Launched 23:50:49.675422 run osmo-hlr_10.42.42.2(pid=31606): Launched 23:50:49.798795 run osmo-stp_10.42.42.5: Starting osmo-stp 23:50:50.356207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31608): Launched 23:50:50.677093 run osmo-stp_10.42.42.5(pid=31609): Launched 23:50:50.799481 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:50:51.354752 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31611): Launched 23:50:51.478189 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:50:51.749849 run patchelf(pid=31612): Launched 23:50:51.928400 run osmo-stp_10.42.42.5(pid=31609): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31609)] 23:50:52.064847 run osmo-stp_10.42.42.5(pid=31609): stdout: | (launched: 2022-12-09_23:50:50.618676) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:50:52.203071 run osmo-stp_10.42.42.5(pid=31609): stderr: | 20221209235050811 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235050811 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235050811 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235050812 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235050812 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235050812 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235050813 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:50:52.341520 run osmo-stp_10.42.42.5(pid=31609): stdout: | (launched: 2022-12-09_23:50:50.618676) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:50:52.473505 run osmo-stp_10.42.42.5(pid=31609): stderr: | 20221209235050811 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235050811 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235050811 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235050812 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235050812 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235050812 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235050813 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:50:52.629931 run patchelf(pid=31612): Terminating (SIGINT) 23:50:52.810744 run patchelf(pid=31612): Terminated: ok {rc=0} 23:50:52.941340 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=31609): Process ended prematurely: osmo-stp_10.42.42.5(pid=31609) [trial-2366↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31609)] [trial-2366↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38] 23:50:52.951369 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 23:50:52.980605 run osmo-hlr_10.42.42.2(pid=31606): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-umtrx↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31606)] 23:50:53.031282 run osmo-hlr_10.42.42.2(pid=31606): stdout: | (launched: 2022-12-09_23:50:49.617244) 23:50:53.083353 run osmo-hlr_10.42.42.2(pid=31606): stderr: | 20221209235049813 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209235049813 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209235049813 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209235049813 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209235049813 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209235049813 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209235049826 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-umtrx/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209235049834 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209235049835 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209235049835 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:50:53.135606 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31599): Terminating (SIGTERM) 23:50:53.177672 run iperf3-srv_10.42.42.10(pid=31600): Terminating (SIGTERM) 23:50:53.219741 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31601): Terminating (SIGTERM) 23:50:53.261568 run iperf3-srv_10.42.42.10(pid=31602): Terminating (SIGTERM) 23:50:53.303157 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31605): Terminating (SIGTERM) 23:50:53.344878 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31608): Terminating (SIGTERM) 23:50:53.386906 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31611): Terminating (SIGTERM) 23:50:53.429205 --- ParallelTerminationStrategy: PID 31599 died... 23:50:53.449183 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31599): Terminated: ok {rc=0} 23:50:53.495969 --- ParallelTerminationStrategy: PID 31600 died... 23:50:53.515440 run iperf3-srv_10.42.42.10(pid=31600): Terminated {rc=256} 23:50:53.561894 --- ParallelTerminationStrategy: PID 31601 died... 23:50:53.581381 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31601): Terminated: ok {rc=0} 23:50:53.628058 --- ParallelTerminationStrategy: PID 31602 died... 23:50:53.647553 run iperf3-srv_10.42.42.10(pid=31602): Terminated {rc=256} 23:50:53.693955 --- ParallelTerminationStrategy: PID 31605 died... 23:50:53.713446 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31605): Terminated: ok {rc=0} 23:50:53.759881 --- ParallelTerminationStrategy: PID 31608 died... 23:50:53.779287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31608): Terminated: ok {rc=0} 23:50:53.825991 --- ParallelTerminationStrategy: PID 31611 died... 23:50:53.845598 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31611): Terminated: ok {rc=0} 23:50:53.934027 bus /gobi_0: Setting Powered False 23:50:55.033523 bus /gobi_0: Setting Powered False 23:50:56.149099 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-umtrx iperf3.py ---------------------------------------------- 23:50:57.298172 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:50:57.309763 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 23:50:57.362220 tst iperf3.py: using LAC 24530 23:50:57.484287 tst iperf3.py: using RAC 50 23:50:57.609796 tst iperf3.py: using CellId 24530 23:50:57.736753 tst iperf3.py: using BVCI 24531 23:50:57.854243 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:50:57.865512 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:50:57.876308 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:50:57.887492 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:50:57.898578 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:50:57.909559 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:50:57.920657 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:50:57.931644 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:50:57.942797 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 23:50:58.059924 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:50:58.279524 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:50:58.602729 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31613): Launched 23:50:58.882230 run iperf3-srv_10.42.42.10(pid=31614): Launched 23:50:59.002491 tst iperf3.py:8: start network... 23:50:59.221626 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:50:59.719190 run create_hlr_db(pid=31615): Launched 23:50:59.841223 bus /gobi_6: Setting Powered False 23:51:00.933536 run create_hlr_db(pid=31615): Terminated: ok {rc=0} 23:51:01.390278 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31617): Launched 23:51:01.738630 run osmo-hlr_10.42.42.2(pid=31618): Launched 23:51:01.983386 run osmo-stp_10.42.42.5: Starting osmo-stp 23:51:02.580560 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31620): Launched 23:51:02.879187 run osmo-stp_10.42.42.5(pid=31621): Launched 23:51:02.992740 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:51:03.507739 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31623): Launched 23:51:03.621965 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:51:03.874520 run patchelf(pid=31624): Launched 23:51:04.040720 run osmo-stp_10.42.42.5(pid=31621): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31621)] 23:51:04.167737 run osmo-stp_10.42.42.5(pid=31621): stdout: | (launched: 2022-12-09_23:51:02.824331) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:51:04.296686 run osmo-stp_10.42.42.5(pid=31621): stderr: | 20221209235102996 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235102996 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235102996 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235102997 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235102997 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235102997 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235102997 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:51:04.426250 run osmo-stp_10.42.42.5(pid=31621): stdout: | (launched: 2022-12-09_23:51:02.824331) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:51:04.549873 run osmo-stp_10.42.42.5(pid=31621): stderr: | 20221209235102996 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235102996 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235102996 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235102997 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235102997 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235102997 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235102997 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:51:04.696099 run patchelf(pid=31624): Terminating (SIGINT) 23:51:04.864316 run patchelf(pid=31624): Terminated: ok {rc=0} 23:51:04.985495 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31621): Process ended prematurely: osmo-stp_10.42.42.5(pid=31621) [trial-2366↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31621)] [trial-2366↪gprs:trx-umtrx↪iperf3.py:8] 23:51:04.995005 tst iperf3.py:8: Test FAILED (7.7 sec) 23:51:05.022394 run osmo-hlr_10.42.42.2(pid=31618): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-umtrx↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31618)] 23:51:05.070090 run osmo-hlr_10.42.42.2(pid=31618): stdout: | (launched: 2022-12-09_23:51:01.667520) 23:51:05.119319 run osmo-hlr_10.42.42.2(pid=31618): stderr: | 20221209235101972 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209235101972 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209235101972 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209235101972 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209235101972 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209235101972 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209235101995 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-umtrx/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209235102012 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209235102012 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209235102012 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:51:05.169165 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31613): Terminating (SIGTERM) 23:51:05.209055 run iperf3-srv_10.42.42.10(pid=31614): Terminating (SIGTERM) 23:51:05.248749 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31617): Terminating (SIGTERM) 23:51:05.288550 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31620): Terminating (SIGTERM) 23:51:05.328315 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31623): Terminating (SIGTERM) 23:51:05.368491 --- ParallelTerminationStrategy: PID 31613 died... 23:51:05.387649 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31613): Terminated: ok {rc=0} 23:51:05.431730 --- ParallelTerminationStrategy: PID 31614 died... 23:51:05.450362 run iperf3-srv_10.42.42.10(pid=31614): Terminated {rc=256} 23:51:05.494532 --- ParallelTerminationStrategy: PID 31617 died... 23:51:05.512911 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31617): Terminated: ok {rc=0} 23:51:05.557416 --- ParallelTerminationStrategy: PID 31620 died... 23:51:05.576067 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31620): Terminated: ok {rc=0} 23:51:05.619965 --- ParallelTerminationStrategy: PID 31623 died... 23:51:05.638542 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31623): Terminated: ok {rc=0} 23:51:05.723403 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-umtrx iperf3m4.py ---------------------------------------------- 23:51:06.871539 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:06.882801 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 23:51:06.932281 tst iperf3m4.py: using LAC 24531 23:51:07.060219 tst iperf3m4.py: using RAC 51 23:51:07.187792 tst iperf3m4.py: using CellId 24531 23:51:07.315691 tst iperf3m4.py: using BVCI 24532 23:51:07.433239 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:07.444304 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:07.455326 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:07.466411 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:07.477406 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:07.488408 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:07.499595 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:07.510717 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:07.521945 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 23:51:07.644285 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 23:51:07.766327 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 23:51:07.887204 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 23:51:08.002163 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:51:08.205765 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:51:08.507978 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31625): Launched 23:51:08.769568 run iperf3-srv_10.42.42.10(pid=31626): Launched 23:51:08.882207 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:51:09.084111 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:51:09.386112 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31627): Launched 23:51:09.646296 run iperf3-srv_10.42.42.10(pid=31628): Launched 23:51:09.758468 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:51:09.959794 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:51:10.260304 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31629): Launched 23:51:10.521035 run iperf3-srv_10.42.42.10(pid=31630): Launched 23:51:10.634181 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:51:10.835474 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:51:11.137877 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31631): Launched 23:51:11.398937 run iperf3-srv_10.42.42.10(pid=31632): Launched 23:51:11.511381 tst iperf3m4.py:8: start network... 23:51:11.711901 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:51:12.210358 run create_hlr_db(pid=31633): Launched 23:51:12.332549 bus /gobi_6: Setting Powered False 23:51:13.395936 run create_hlr_db(pid=31633): Terminated: ok {rc=0} 23:51:13.842429 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31635): Launched 23:51:14.163967 run osmo-hlr_10.42.42.2(pid=31636): Launched 23:51:14.287980 run osmo-stp_10.42.42.5: Starting osmo-stp 23:51:14.845598 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31638): Launched 23:51:15.168915 run osmo-stp_10.42.42.5(pid=31639): Launched 23:51:15.291525 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:51:15.857578 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31641): Launched 23:51:15.993852 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:51:16.307357 run patchelf(pid=31642): Launched 23:51:16.503702 run osmo-stp_10.42.42.5(pid=31639): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31639)] 23:51:16.645020 run osmo-stp_10.42.42.5(pid=31639): stdout: | (launched: 2022-12-09_23:51:15.110428) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:51:16.788539 run osmo-stp_10.42.42.5(pid=31639): stderr: | 20221209235115301 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235115302 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235115302 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235115302 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235115303 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235115303 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235115303 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:51:16.931226 run osmo-stp_10.42.42.5(pid=31639): stdout: | (launched: 2022-12-09_23:51:15.110428) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:51:17.068574 run osmo-stp_10.42.42.5(pid=31639): stderr: | 20221209235115301 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235115302 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235115302 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235115302 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235115303 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235115303 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235115303 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:51:17.229994 run patchelf(pid=31642): Terminating (SIGINT) 23:51:17.410981 run patchelf(pid=31642): Terminated: ok {rc=0} 23:51:17.541466 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31639): Process ended prematurely: osmo-stp_10.42.42.5(pid=31639) [trial-2366↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31639)] [trial-2366↪gprs:trx-umtrx↪iperf3m4.py:8] 23:51:17.551841 tst iperf3m4.py:8: Test FAILED (10.7 sec) 23:51:17.581228 run osmo-hlr_10.42.42.2(pid=31636): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-umtrx↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31636)] 23:51:17.631555 run osmo-hlr_10.42.42.2(pid=31636): stdout: | (launched: 2022-12-09_23:51:14.105704) 23:51:17.683616 run osmo-hlr_10.42.42.2(pid=31636): stderr: | 20221209235114302 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209235114302 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209235114302 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209235114302 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209235114302 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209235114302 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209235114315 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-umtrx/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209235114323 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209235114323 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209235114324 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:51:17.736238 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31625): Terminating (SIGTERM) 23:51:17.778439 run iperf3-srv_10.42.42.10(pid=31626): Terminating (SIGTERM) 23:51:17.820187 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31627): Terminating (SIGTERM) 23:51:17.862111 run iperf3-srv_10.42.42.10(pid=31628): Terminating (SIGTERM) 23:51:17.904158 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31629): Terminating (SIGTERM) 23:51:17.946558 run iperf3-srv_10.42.42.10(pid=31630): Terminating (SIGTERM) 23:51:17.988305 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31631): Terminating (SIGTERM) 23:51:18.030557 run iperf3-srv_10.42.42.10(pid=31632): Terminating (SIGTERM) 23:51:18.072340 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31635): Terminating (SIGTERM) 23:51:18.114406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31638): Terminating (SIGTERM) 23:51:18.156167 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31641): Terminating (SIGTERM) 23:51:18.198354 --- ParallelTerminationStrategy: PID 31625 died... 23:51:18.218321 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31625): Terminated: ok {rc=0} 23:51:18.265400 --- ParallelTerminationStrategy: PID 31626 died... 23:51:18.285104 run iperf3-srv_10.42.42.10(pid=31626): Terminated {rc=256} 23:51:18.331513 --- ParallelTerminationStrategy: PID 31627 died... 23:51:18.351224 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31627): Terminated: ok {rc=0} 23:51:18.397861 --- ParallelTerminationStrategy: PID 31628 died... 23:51:18.417388 run iperf3-srv_10.42.42.10(pid=31628): Terminated {rc=256} 23:51:18.463534 --- ParallelTerminationStrategy: PID 31629 died... 23:51:18.483059 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31629): Terminated: ok {rc=0} 23:51:18.529469 --- ParallelTerminationStrategy: PID 31630 died... 23:51:18.548916 run iperf3-srv_10.42.42.10(pid=31630): Terminated {rc=256} 23:51:18.595349 --- ParallelTerminationStrategy: PID 31631 died... 23:51:18.614771 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31631): Terminated: ok {rc=0} 23:51:18.661674 --- ParallelTerminationStrategy: PID 31632 died... 23:51:18.681370 run iperf3-srv_10.42.42.10(pid=31632): Terminated {rc=256} 23:51:18.727740 --- ParallelTerminationStrategy: PID 31635 died... 23:51:18.747368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31635): Terminated: ok {rc=0} 23:51:18.793827 --- ParallelTerminationStrategy: PID 31638 died... 23:51:18.813637 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31638): Terminated: ok {rc=0} 23:51:18.860127 --- ParallelTerminationStrategy: PID 31641 died... 23:51:18.879847 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31641): Terminated: ok {rc=0} 23:51:18.967440 bus /gobi_4: Setting Powered False 23:51:20.065405 bus /gobi_4: Setting Powered False 23:51:21.183433 bus /gobi_1: Setting Powered False 23:51:22.283340 bus /gobi_1: Setting Powered False 23:51:23.398160 bus /gobi_0: Setting Powered False 23:51:24.495299 bus /gobi_0: Setting Powered False 23:51:25.614015 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-umtrx ping.py ---------------------------------------------- 23:51:26.716309 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:26.727555 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 23:51:26.776118 tst ping.py: using LAC 24532 23:51:26.893047 tst ping.py: using RAC 52 23:51:27.008850 tst ping.py: using CellId 24532 23:51:27.125121 tst ping.py: using BVCI 24533 23:51:27.231119 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:27.241663 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:27.252034 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:27.262372 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:27.272551 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:27.282940 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:27.293376 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:27.303683 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 23:51:27.415357 tst ping.py:19: start network... 23:51:27.613883 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:51:28.068501 run create_hlr_db(pid=31643): Launched 23:51:28.188207 bus /gobi_6: Setting Powered False 23:51:29.247389 run create_hlr_db(pid=31643): Terminated: ok {rc=0} 23:51:29.677833 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31645): Launched 23:51:29.991817 run osmo-hlr_10.42.42.2(pid=31646): Launched 23:51:30.112778 run osmo-stp_10.42.42.5: Starting osmo-stp 23:51:30.657751 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31648): Launched 23:51:31.014149 run osmo-stp_10.42.42.5(pid=31649): Launched 23:51:31.163633 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:51:31.877232 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31651): Launched 23:51:32.019758 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:51:32.284060 run patchelf(pid=31652): Launched 23:51:32.487184 run osmo-stp_10.42.42.5(pid=31649): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31649)] 23:51:32.621227 run osmo-stp_10.42.42.5(pid=31649): stdout: | (launched: 2022-12-09_23:51:30.943127) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:51:32.757214 run osmo-stp_10.42.42.5(pid=31649): stderr: | 20221209235131285 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235131285 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235131287 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235131288 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235131288 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235131288 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235131289 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:51:32.893552 run osmo-stp_10.42.42.5(pid=31649): stdout: | (launched: 2022-12-09_23:51:30.943127) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:51:33.023359 run osmo-stp_10.42.42.5(pid=31649): stderr: | 20221209235131285 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235131285 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235131287 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235131288 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235131288 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235131288 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235131289 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:51:33.177959 run patchelf(pid=31652): Terminating (SIGINT) 23:51:33.355240 run patchelf(pid=31652): Terminated: ok {rc=0} 23:51:33.483129 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=31649): Process ended prematurely: osmo-stp_10.42.42.5(pid=31649) [trial-2366↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31649)] [trial-2366↪gprs:trx-umtrx↪ping.py:22] 23:51:33.492580 tst ping.py:22: Test FAILED (6.8 sec) 23:51:33.521286 run osmo-hlr_10.42.42.2(pid=31646): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-umtrx↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31646)] 23:51:33.571197 run osmo-hlr_10.42.42.2(pid=31646): stdout: | (launched: 2022-12-09_23:51:29.934809) 23:51:33.622999 run osmo-hlr_10.42.42.2(pid=31646): stderr: | 20221209235130131 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209235130131 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209235130131 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209235130131 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209235130131 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209235130131 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209235130166 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-umtrx/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209235130176 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209235130176 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209235130176 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:51:33.675123 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31645): Terminating (SIGTERM) 23:51:33.716913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31648): Terminating (SIGTERM) 23:51:33.758913 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31651): Terminating (SIGTERM) 23:51:33.801120 --- ParallelTerminationStrategy: PID 31645 died... 23:51:33.821076 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31645): Terminated: ok {rc=0} 23:51:33.867540 --- ParallelTerminationStrategy: PID 31648 died... 23:51:33.887256 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31648): Terminated: ok {rc=0} 23:51:33.933577 --- ParallelTerminationStrategy: PID 31651 died... 23:51:33.952998 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31651): Terminated: ok {rc=0} 23:51:34.040794 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-umtrx ping_idle_ping.py ---------------------------------------------- 23:51:35.127804 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:35.139159 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 23:51:35.188904 tst ping_idle_ping.py: using LAC 24533 23:51:35.306223 tst ping_idle_ping.py: using RAC 53 23:51:35.422837 tst ping_idle_ping.py: using CellId 24533 23:51:35.539523 tst ping_idle_ping.py: using BVCI 24534 23:51:35.648759 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:35.659671 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:35.670527 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:35.681394 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:35.692090 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:35.702713 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:35.713388 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 23:51:35.724058 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 23:51:35.841733 tst ping_idle_ping.py:24: start network... 23:51:36.057267 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:51:36.549242 run create_hlr_db(pid=31653): Launched 23:51:36.670156 bus /gobi_6: Setting Powered False 23:51:37.733126 run create_hlr_db(pid=31653): Terminated: ok {rc=0} 23:51:38.173944 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31655): Launched 23:51:38.490085 run osmo-hlr_10.42.42.2(pid=31656): Launched 23:51:38.611005 run osmo-stp_10.42.42.5: Starting osmo-stp 23:51:39.161515 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31658): Launched 23:51:39.478353 run osmo-stp_10.42.42.5(pid=31659): Launched 23:51:39.600049 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:51:40.150478 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31661): Launched 23:51:40.271140 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:51:40.539227 run patchelf(pid=31662): Launched 23:51:40.714835 run osmo-stp_10.42.42.5(pid=31659): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31659)] 23:51:40.848091 run osmo-stp_10.42.42.5(pid=31659): stdout: | (launched: 2022-12-09_23:51:39.420827) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:51:40.983479 run osmo-stp_10.42.42.5(pid=31659): stderr: | 20221209235139611 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235139611 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235139611 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235139612 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235139612 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235139612 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235139612 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:51:41.119864 run osmo-stp_10.42.42.5(pid=31659): stdout: | (launched: 2022-12-09_23:51:39.420827) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:51:41.249457 run osmo-stp_10.42.42.5(pid=31659): stderr: | 20221209235139611 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235139611 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235139611 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235139612 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235139612 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235139612 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235139612 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:51:41.402934 run patchelf(pid=31662): Terminating (SIGINT) 23:51:41.579796 run patchelf(pid=31662): Terminated: ok {rc=0} 23:51:41.707490 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=31659): Process ended prematurely: osmo-stp_10.42.42.5(pid=31659) [trial-2366↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31659)] [trial-2366↪gprs:trx-umtrx↪ping_idle_ping.py:27] 23:51:41.716910 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 23:51:41.745380 run osmo-hlr_10.42.42.2(pid=31656): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-umtrx↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31656)] 23:51:41.795233 run osmo-hlr_10.42.42.2(pid=31656): stdout: | (launched: 2022-12-09_23:51:38.432310) 23:51:41.846806 run osmo-hlr_10.42.42.2(pid=31656): stderr: | 20221209235138629 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209235138629 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209235138629 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209235138629 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209235138629 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209235138629 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209235138642 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-umtrx/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209235138652 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209235138653 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209235138653 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:51:41.898830 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31655): Terminating (SIGTERM) 23:51:41.940445 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31658): Terminating (SIGTERM) 23:51:41.982158 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31661): Terminating (SIGTERM) 23:51:42.024098 --- ParallelTerminationStrategy: PID 31655 died... 23:51:42.044325 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31655): Terminated: ok {rc=0} 23:51:42.090619 --- ParallelTerminationStrategy: PID 31658 died... 23:51:42.109951 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31658): Terminated: ok {rc=0} 23:51:42.155918 --- ParallelTerminationStrategy: PID 31661 died... 23:51:42.175185 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31661): Terminated: ok {rc=0} 23:51:42.262303 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2366 gprs:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 gprs:trx-umtrx+mod-bts0-egprs --------------------------------------------------------------------- 23:51:43.560154 tst gprs:trx-umtrx+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:51:43.565489 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 23:51:43.598141 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 23:51:43.636840 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 23:51:43.723845 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 23:51:43.757895 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 23:51:43.798306 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 23:51:44.392913 tst gprs:trx-umtrx+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2366 gprs:trx-umtrx+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 23:51:44.445647 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:51:44.456780 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:51:44.507327 tst cs_paging_gprs_active.py: using LAC 24534 23:51:44.635530 tst cs_paging_gprs_active.py: using RAC 54 23:51:44.763860 tst cs_paging_gprs_active.py: using CellId 24534 23:51:44.890829 tst cs_paging_gprs_active.py: using BVCI 24535 23:51:45.009906 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:51:45.021271 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:51:45.032281 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:51:45.044936 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:51:45.056190 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:51:45.067537 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:51:45.079091 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:51:45.090594 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:51:45.102301 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:51:45.218861 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:51:45.338572 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:51:45.558507 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:51:45.896142 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31666): Launched 23:51:46.197767 run iperf3-srv_10.42.42.10(pid=31667): Launched 23:51:46.355101 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:51:46.586143 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:51:46.925948 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31668): Launched 23:51:47.221763 run iperf3-srv_10.42.42.10(pid=31669): Launched 23:51:47.354263 tst cs_paging_gprs_active.py:38: start network... 23:51:47.573875 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:51:48.074743 run create_hlr_db(pid=31670): Launched 23:51:48.197513 bus /gobi_6: Setting Powered False 23:51:49.262075 run create_hlr_db(pid=31670): Terminated: ok {rc=0} 23:51:49.692752 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31672): Launched 23:51:49.995020 run osmo-hlr_10.42.42.2(pid=31673): Launched 23:51:50.110185 run osmo-stp_10.42.42.5: Starting osmo-stp 23:51:50.628230 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31675): Launched 23:51:50.929669 run osmo-stp_10.42.42.5(pid=31676): Launched 23:51:51.044211 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:51:51.564758 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31678): Launched 23:51:51.679978 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:51:51.934329 run patchelf(pid=31679): Launched 23:51:52.101153 run osmo-stp_10.42.42.5(pid=31676): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31676)] 23:51:52.228128 run osmo-stp_10.42.42.5(pid=31676): stdout: | (launched: 2022-12-09_23:51:50.873980) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:51:52.357290 run osmo-stp_10.42.42.5(pid=31676): stderr: | 20221209235151045 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235151045 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235151046 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235151046 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235151047 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235151047 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235151047 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:51:52.486310 run osmo-stp_10.42.42.5(pid=31676): stdout: | (launched: 2022-12-09_23:51:50.873980) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:51:52.609218 run osmo-stp_10.42.42.5(pid=31676): stderr: | 20221209235151045 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235151045 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235151046 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235151046 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235151047 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235151047 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235151047 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:51:52.754832 run patchelf(pid=31679): Terminating (SIGINT) 23:51:52.924818 run patchelf(pid=31679): Terminated: ok {rc=0} 23:51:53.046955 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=31676): Process ended prematurely: osmo-stp_10.42.42.5(pid=31676) [trial-2366↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31676)] [trial-2366↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 23:51:53.056262 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 23:51:53.083314 run osmo-hlr_10.42.42.2(pid=31673): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31673)] 23:51:53.130495 run osmo-hlr_10.42.42.2(pid=31673): stdout: | (launched: 2022-12-09_23:51:49.940029) 23:51:53.179435 run osmo-hlr_10.42.42.2(pid=31673): stderr: | 20221209235150117 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209235150117 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209235150117 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209235150117 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209235150117 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209235150117 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209235150129 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-umtrx+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209235150139 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209235150139 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209235150139 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:51:53.228786 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31666): Terminating (SIGTERM) 23:51:53.268236 run iperf3-srv_10.42.42.10(pid=31667): Terminating (SIGTERM) 23:51:53.307557 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31668): Terminating (SIGTERM) 23:51:53.346926 run iperf3-srv_10.42.42.10(pid=31669): Terminating (SIGTERM) 23:51:53.386182 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31672): Terminating (SIGTERM) 23:51:53.425692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31675): Terminating (SIGTERM) 23:51:53.464909 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31678): Terminating (SIGTERM) 23:51:53.504334 --- ParallelTerminationStrategy: PID 31666 died... 23:51:53.523460 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31666): Terminated: ok {rc=0} 23:51:53.567337 --- ParallelTerminationStrategy: PID 31667 died... 23:51:53.585899 run iperf3-srv_10.42.42.10(pid=31667): Terminated {rc=256} 23:51:53.629297 --- ParallelTerminationStrategy: PID 31668 died... 23:51:53.647730 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31668): Terminated: ok {rc=0} 23:51:53.691479 --- ParallelTerminationStrategy: PID 31669 died... 23:51:53.710076 run iperf3-srv_10.42.42.10(pid=31669): Terminated {rc=256} 23:51:53.753569 --- ParallelTerminationStrategy: PID 31672 died... 23:51:53.772068 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31672): Terminated: ok {rc=0} 23:51:53.815842 --- ParallelTerminationStrategy: PID 31675 died... 23:51:53.834294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31675): Terminated: ok {rc=0} 23:51:53.877732 --- ParallelTerminationStrategy: PID 31678 died... 23:51:53.896139 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31678): Terminated: ok {rc=0} 23:51:53.981739 bus /gobi_0: Setting Powered False 23:51:55.080517 bus /gobi_0: Setting Powered False 23:51:56.195880 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-umtrx+mod-bts0-egprs iperf3.py ---------------------------------------------- 23:51:57.341764 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:51:57.353332 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:51:57.405566 tst iperf3.py: using LAC 24535 23:51:57.526340 tst iperf3.py: using RAC 55 23:51:57.647984 tst iperf3.py: using CellId 24535 23:51:57.768174 tst iperf3.py: using BVCI 24536 23:51:57.879061 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:51:57.889959 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:51:57.900496 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:51:57.911192 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:51:57.921710 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:51:57.932189 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:51:57.942914 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:51:57.953429 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:51:57.964380 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:51:58.081747 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:51:58.284383 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:51:58.585867 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31680): Launched 23:51:58.846708 run iperf3-srv_10.42.42.10(pid=31681): Launched 23:51:58.959172 tst iperf3.py:8: start network... 23:51:59.161137 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:51:59.624541 run create_hlr_db(pid=31682): Launched 23:51:59.746599 bus /gobi_6: Setting Powered False 23:52:00.809077 run create_hlr_db(pid=31682): Terminated: ok {rc=0} 23:52:01.274488 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31684): Launched 23:52:01.618885 run osmo-hlr_10.42.42.2(pid=31685): Launched 23:52:01.866163 run osmo-stp_10.42.42.5: Starting osmo-stp 23:52:02.518285 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31687): Launched 23:52:02.839177 run osmo-stp_10.42.42.5(pid=31688): Launched 23:52:02.962113 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:52:03.517581 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31690): Launched 23:52:03.641361 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:52:03.913663 run patchelf(pid=31691): Launched 23:52:04.091895 run osmo-stp_10.42.42.5(pid=31688): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31688)] 23:52:04.227771 run osmo-stp_10.42.42.5(pid=31688): stdout: | (launched: 2022-12-09_23:52:02.781312) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:52:04.365881 run osmo-stp_10.42.42.5(pid=31688): stderr: | 20221209235202977 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235202977 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235202977 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235202978 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235202978 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235202978 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235202978 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:52:04.503700 run osmo-stp_10.42.42.5(pid=31688): stdout: | (launched: 2022-12-09_23:52:02.781312) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:52:04.635287 run osmo-stp_10.42.42.5(pid=31688): stderr: | 20221209235202977 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235202977 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235202977 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235202978 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235202978 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235202978 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235202978 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:52:04.791300 run patchelf(pid=31691): Terminating (SIGINT) 23:52:04.971886 run patchelf(pid=31691): Terminated: ok {rc=0} 23:52:05.102958 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31688): Process ended prematurely: osmo-stp_10.42.42.5(pid=31688) [trial-2366↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31688)] [trial-2366↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8] 23:52:05.112934 tst iperf3.py:8: Test FAILED (7.8 sec) 23:52:05.141932 run osmo-hlr_10.42.42.2(pid=31685): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31685)] 23:52:05.191947 run osmo-hlr_10.42.42.2(pid=31685): stdout: | (launched: 2022-12-09_23:52:01.554723) 23:52:05.243442 run osmo-hlr_10.42.42.2(pid=31685): stderr: | 20221209235201859 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209235201859 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209235201859 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209235201859 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209235201859 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209235201859 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209235201877 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-umtrx+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209235201886 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209235201886 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209235201886 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:52:05.295537 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31680): Terminating (SIGTERM) 23:52:05.337259 run iperf3-srv_10.42.42.10(pid=31681): Terminating (SIGTERM) 23:52:05.379218 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31684): Terminating (SIGTERM) 23:52:05.420698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31687): Terminating (SIGTERM) 23:52:05.462284 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31690): Terminating (SIGTERM) 23:52:05.504006 --- ParallelTerminationStrategy: PID 31680 died... 23:52:05.523875 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31680): Terminated: ok {rc=0} 23:52:05.570326 --- ParallelTerminationStrategy: PID 31681 died... 23:52:05.589671 run iperf3-srv_10.42.42.10(pid=31681): Terminated {rc=256} 23:52:05.635982 --- ParallelTerminationStrategy: PID 31684 died... 23:52:05.655461 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31684): Terminated: ok {rc=0} 23:52:05.701586 --- ParallelTerminationStrategy: PID 31687 died... 23:52:05.721037 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31687): Terminated: ok {rc=0} 23:52:05.767296 --- ParallelTerminationStrategy: PID 31690 died... 23:52:05.786741 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31690): Terminated: ok {rc=0} 23:52:05.874390 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-umtrx+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 23:52:07.021193 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:07.032605 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:52:07.093568 tst iperf3m4.py: using LAC 24536 23:52:07.219863 tst iperf3m4.py: using RAC 56 23:52:07.338874 tst iperf3m4.py: using CellId 24536 23:52:07.456878 tst iperf3m4.py: using BVCI 24537 23:52:07.565890 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:07.576638 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:07.587359 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:07.598463 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:07.609487 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:07.620403 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:07.631639 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:07.642633 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:07.653878 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:52:07.775181 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:52:07.893624 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:52:08.013457 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:52:08.131475 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:52:08.335085 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:52:08.636623 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31692): Launched 23:52:08.898121 run iperf3-srv_10.42.42.10(pid=31693): Launched 23:52:09.010491 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:52:09.213268 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:52:09.514294 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31694): Launched 23:52:09.775394 run iperf3-srv_10.42.42.10(pid=31695): Launched 23:52:09.887632 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:52:10.089148 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:52:10.390335 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31696): Launched 23:52:10.650911 run iperf3-srv_10.42.42.10(pid=31697): Launched 23:52:10.762781 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:52:10.964018 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:52:11.265859 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31698): Launched 23:52:11.527613 run iperf3-srv_10.42.42.10(pid=31699): Launched 23:52:11.639609 tst iperf3m4.py:8: start network... 23:52:11.840444 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:52:12.305477 run create_hlr_db(pid=31700): Launched 23:52:12.428197 bus /gobi_6: Setting Powered False 23:52:13.489128 run create_hlr_db(pid=31700): Terminated: ok {rc=0} 23:52:13.928172 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31702): Launched 23:52:14.250143 run osmo-hlr_10.42.42.2(pid=31703): Launched 23:52:14.374408 run osmo-stp_10.42.42.5: Starting osmo-stp 23:52:14.934227 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31705): Launched 23:52:15.257670 run osmo-stp_10.42.42.5(pid=31706): Launched 23:52:15.381547 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:52:15.946513 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31708): Launched 23:52:16.123211 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:52:16.414321 run patchelf(pid=31709): Launched 23:52:16.599996 run osmo-stp_10.42.42.5(pid=31706): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31706)] 23:52:16.741720 run osmo-stp_10.42.42.5(pid=31706): stdout: | (launched: 2022-12-09_23:52:15.198681) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:52:16.884818 run osmo-stp_10.42.42.5(pid=31706): stderr: | 20221209235215391 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235215391 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235215391 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235215392 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235215392 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235215392 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235215392 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:52:17.027007 run osmo-stp_10.42.42.5(pid=31706): stdout: | (launched: 2022-12-09_23:52:15.198681) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:52:17.162752 run osmo-stp_10.42.42.5(pid=31706): stderr: | 20221209235215391 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235215391 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235215391 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235215392 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235215392 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235215392 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235215392 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:52:17.323083 run patchelf(pid=31709): Terminating (SIGINT) 23:52:17.505231 run patchelf(pid=31709): Terminated: ok {rc=0} 23:52:17.636308 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31706): Process ended prematurely: osmo-stp_10.42.42.5(pid=31706) [trial-2366↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31706)] [trial-2366↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8] 23:52:17.646820 tst iperf3m4.py:8: Test FAILED (10.7 sec) 23:52:17.676651 run osmo-hlr_10.42.42.2(pid=31703): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31703)] 23:52:17.727453 run osmo-hlr_10.42.42.2(pid=31703): stdout: | (launched: 2022-12-09_23:52:14.191760) 23:52:17.779391 run osmo-hlr_10.42.42.2(pid=31703): stderr: | 20221209235214388 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209235214388 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209235214388 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209235214389 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209235214389 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209235214389 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209235214405 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-umtrx+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209235214415 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209235214415 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209235214415 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:52:17.831920 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31692): Terminating (SIGTERM) 23:52:17.874074 run iperf3-srv_10.42.42.10(pid=31693): Terminating (SIGTERM) 23:52:17.916010 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31694): Terminating (SIGTERM) 23:52:17.958101 run iperf3-srv_10.42.42.10(pid=31695): Terminating (SIGTERM) 23:52:18.000155 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31696): Terminating (SIGTERM) 23:52:18.042560 run iperf3-srv_10.42.42.10(pid=31697): Terminating (SIGTERM) 23:52:18.084942 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31698): Terminating (SIGTERM) 23:52:18.126955 run iperf3-srv_10.42.42.10(pid=31699): Terminating (SIGTERM) 23:52:18.168873 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31702): Terminating (SIGTERM) 23:52:18.211103 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31705): Terminating (SIGTERM) 23:52:18.253070 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31708): Terminating (SIGTERM) 23:52:18.295423 --- ParallelTerminationStrategy: PID 31692 died... 23:52:18.315403 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31692): Terminated: ok {rc=0} 23:52:18.362393 --- ParallelTerminationStrategy: PID 31693 died... 23:52:18.382047 run iperf3-srv_10.42.42.10(pid=31693): Terminated {rc=256} 23:52:18.428727 --- ParallelTerminationStrategy: PID 31694 died... 23:52:18.448518 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31694): Terminated: ok {rc=0} 23:52:18.495360 --- ParallelTerminationStrategy: PID 31695 died... 23:52:18.515009 run iperf3-srv_10.42.42.10(pid=31695): Terminated {rc=256} 23:52:18.561604 --- ParallelTerminationStrategy: PID 31696 died... 23:52:18.581286 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31696): Terminated: ok {rc=0} 23:52:18.627823 --- ParallelTerminationStrategy: PID 31697 died... 23:52:18.647377 run iperf3-srv_10.42.42.10(pid=31697): Terminated {rc=256} 23:52:18.693998 --- ParallelTerminationStrategy: PID 31698 died... 23:52:18.713813 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31698): Terminated: ok {rc=0} 23:52:18.760472 --- ParallelTerminationStrategy: PID 31699 died... 23:52:18.780103 run iperf3-srv_10.42.42.10(pid=31699): Terminated {rc=256} 23:52:18.826731 --- ParallelTerminationStrategy: PID 31702 died... 23:52:18.846589 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31702): Terminated: ok {rc=0} 23:52:18.893322 --- ParallelTerminationStrategy: PID 31705 died... 23:52:18.913310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31705): Terminated: ok {rc=0} 23:52:18.959930 --- ParallelTerminationStrategy: PID 31708 died... 23:52:18.979993 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31708): Terminated: ok {rc=0} 23:52:19.068580 bus /gobi_4: Setting Powered False 23:52:20.166648 bus /gobi_4: Setting Powered False 23:52:21.284342 bus /gobi_1: Setting Powered False 23:52:22.382381 bus /gobi_1: Setting Powered False 23:52:23.496558 bus /gobi_0: Setting Powered False 23:52:24.595180 bus /gobi_0: Setting Powered False 23:52:25.710778 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-umtrx+mod-bts0-egprs ping.py ---------------------------------------------- 23:52:26.814126 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:26.826026 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:52:26.876132 tst ping.py: using LAC 24537 23:52:26.994899 tst ping.py: using RAC 57 23:52:27.111684 tst ping.py: using CellId 24537 23:52:27.230491 tst ping.py: using BVCI 24538 23:52:27.339299 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:27.350294 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:27.361057 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:27.371700 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:27.382264 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:27.392817 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:27.403618 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:27.414314 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:52:27.526928 tst ping.py:19: start network... 23:52:27.726996 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:52:28.184907 run create_hlr_db(pid=31710): Launched 23:52:28.306169 bus /gobi_6: Setting Powered False 23:52:29.365850 run create_hlr_db(pid=31710): Terminated: ok {rc=0} 23:52:29.778703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31712): Launched 23:52:30.072870 run osmo-hlr_10.42.42.2(pid=31713): Launched 23:52:30.185358 run osmo-stp_10.42.42.5: Starting osmo-stp 23:52:30.724183 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31715): Launched 23:52:31.045512 run osmo-stp_10.42.42.5(pid=31716): Launched 23:52:31.312199 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:52:31.965945 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31718): Launched 23:52:32.091829 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:52:32.357712 run patchelf(pid=31719): Launched 23:52:32.520672 run osmo-stp_10.42.42.5(pid=31716): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31716)] 23:52:32.645250 run osmo-stp_10.42.42.5(pid=31716): stdout: | (launched: 2022-12-09_23:52:30.980470) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:52:32.771759 run osmo-stp_10.42.42.5(pid=31716): stderr: | 20221209235231355 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235231356 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235231357 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235231359 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235231365 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235231366 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235231366 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:52:32.898419 run osmo-stp_10.42.42.5(pid=31716): stdout: | (launched: 2022-12-09_23:52:30.980470) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:52:33.019207 run osmo-stp_10.42.42.5(pid=31716): stderr: | 20221209235231355 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235231356 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235231357 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235231359 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235231365 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235231366 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235231366 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:52:33.162456 run patchelf(pid=31719): Terminating (SIGINT) 23:52:33.328695 run patchelf(pid=31719): Terminated: ok {rc=0} 23:52:33.447842 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=31716): Process ended prematurely: osmo-stp_10.42.42.5(pid=31716) [trial-2366↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31716)] [trial-2366↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22] 23:52:33.456714 tst ping.py:22: Test FAILED (6.6 sec) 23:52:33.483487 run osmo-hlr_10.42.42.2(pid=31713): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31713)] 23:52:33.530684 run osmo-hlr_10.42.42.2(pid=31713): stdout: | (launched: 2022-12-09_23:52:30.019013) 23:52:33.579678 run osmo-hlr_10.42.42.2(pid=31713): stderr: | 20221209235230194 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209235230194 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209235230194 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209235230194 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209235230194 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209235230194 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209235230229 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-umtrx+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209235230238 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209235230238 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209235230238 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:52:33.629267 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31712): Terminating (SIGTERM) 23:52:33.669017 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31715): Terminating (SIGTERM) 23:52:33.708889 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31718): Terminating (SIGTERM) 23:52:33.749139 --- ParallelTerminationStrategy: PID 31712 died... 23:52:33.768215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31712): Terminated: ok {rc=0} 23:52:33.812393 --- ParallelTerminationStrategy: PID 31715 died... 23:52:33.831033 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31715): Terminated: ok {rc=0} 23:52:33.875071 --- ParallelTerminationStrategy: PID 31718 died... 23:52:33.893851 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31718): Terminated: ok {rc=0} 23:52:33.979243 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-umtrx+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 23:52:35.068158 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:35.080211 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 23:52:35.132668 tst ping_idle_ping.py: using LAC 24538 23:52:35.250490 tst ping_idle_ping.py: using RAC 58 23:52:35.369721 tst ping_idle_ping.py: using CellId 24538 23:52:35.497957 tst ping_idle_ping.py: using BVCI 24539 23:52:35.608206 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:35.619357 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:35.630384 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:35.641350 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:35.652231 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:35.663294 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:35.674501 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 23:52:35.685603 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 23:52:35.803897 tst ping_idle_ping.py:24: start network... 23:52:36.026343 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:52:36.522740 run create_hlr_db(pid=31724): Launched 23:52:36.644877 bus /gobi_6: Setting Powered False 23:52:37.708454 run create_hlr_db(pid=31724): Terminated: ok {rc=0} 23:52:38.134175 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31726): Launched 23:52:38.431697 run osmo-hlr_10.42.42.2(pid=31727): Launched 23:52:38.544726 run osmo-stp_10.42.42.5: Starting osmo-stp 23:52:39.055722 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31729): Launched 23:52:39.353750 run osmo-stp_10.42.42.5(pid=31730): Launched 23:52:39.466482 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:52:39.977911 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31732): Launched 23:52:40.090935 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:52:40.341399 run patchelf(pid=31733): Launched 23:52:40.508416 run osmo-stp_10.42.42.5(pid=31730): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31730)] 23:52:40.634369 run osmo-stp_10.42.42.5(pid=31730): stdout: | (launched: 2022-12-09_23:52:39.298559) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:52:40.762444 run osmo-stp_10.42.42.5(pid=31730): stderr: | 20221209235239468 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235239468 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235239468 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235239469 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235239469 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235239469 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235239469 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:52:40.890353 run osmo-stp_10.42.42.5(pid=31730): stdout: | (launched: 2022-12-09_23:52:39.298559) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:52:41.012399 run osmo-stp_10.42.42.5(pid=31730): stderr: | 20221209235239468 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235239468 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235239468 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235239469 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235239469 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235239469 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235239469 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:52:41.156792 run patchelf(pid=31733): Terminating (SIGINT) 23:52:41.324481 run patchelf(pid=31733): Terminated: ok {rc=0} 23:52:41.445590 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=31730): Process ended prematurely: osmo-stp_10.42.42.5(pid=31730) [trial-2366↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31730)] [trial-2366↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27] 23:52:41.454647 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 23:52:41.481643 run osmo-hlr_10.42.42.2(pid=31727): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31727)] 23:52:41.529224 run osmo-hlr_10.42.42.2(pid=31727): stdout: | (launched: 2022-12-09_23:52:38.377618) 23:52:41.578493 run osmo-hlr_10.42.42.2(pid=31727): stderr: | 20221209235238555 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209235238555 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209235238555 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209235238555 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209235238555 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209235238555 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209235238569 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-umtrx+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209235238577 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209235238577 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209235238577 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:52:41.628140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31726): Terminating (SIGTERM) 23:52:41.667633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31729): Terminating (SIGTERM) 23:52:41.706946 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31732): Terminating (SIGTERM) 23:52:41.746591 --- ParallelTerminationStrategy: PID 31726 died... 23:52:41.765675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31726): Terminated: ok {rc=0} 23:52:41.809824 --- ParallelTerminationStrategy: PID 31729 died... 23:52:41.828262 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31729): Terminated: ok {rc=0} 23:52:41.872207 --- ParallelTerminationStrategy: PID 31732 died... 23:52:41.890946 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31732): Terminated: ok {rc=0} 23:52:41.973615 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2366 gprs:trx-umtrx+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 gprs:trx-umtrx+mod-bts0-dynts-ipa --------------------------------------------------------------------- 23:52:43.278243 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:52:43.285157 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 23:52:43.320754 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 23:52:43.361115 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 23:52:43.449271 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 23:52:43.483127 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 23:52:43.523611 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 23:52:44.120343 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2366 gprs:trx-umtrx+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 23:52:44.174163 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:52:44.185619 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:52:44.257039 tst cs_paging_gprs_active.py: using LAC 24539 23:52:44.385888 tst cs_paging_gprs_active.py: using RAC 59 23:52:44.513227 tst cs_paging_gprs_active.py: using CellId 24539 23:52:44.641414 tst cs_paging_gprs_active.py: using BVCI 24540 23:52:44.760136 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:52:44.771469 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:52:44.782724 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:52:44.794683 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:52:44.806643 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:52:44.818719 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:52:44.831022 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:52:44.843790 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:52:44.855295 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:52:44.974662 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:52:45.093984 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:52:45.313717 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:52:45.637688 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31737): Launched 23:52:45.941734 run iperf3-srv_10.42.42.10(pid=31738): Launched 23:52:46.078004 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:52:46.359438 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:52:46.680272 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31739): Launched 23:52:47.034432 run iperf3-srv_10.42.42.10(pid=31740): Launched 23:52:47.203523 tst cs_paging_gprs_active.py:38: start network... 23:52:47.424464 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:52:47.890199 run create_hlr_db(pid=31741): Launched 23:52:48.013763 bus /gobi_6: Setting Powered False 23:52:49.074166 run create_hlr_db(pid=31741): Terminated: ok {rc=0} 23:52:49.514355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31743): Launched 23:52:49.837290 run osmo-hlr_10.42.42.2(pid=31744): Launched 23:52:49.960746 run osmo-stp_10.42.42.5: Starting osmo-stp 23:52:50.518734 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31746): Launched 23:52:50.841516 run osmo-stp_10.42.42.5(pid=31747): Launched 23:52:50.964736 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:52:51.522361 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31749): Launched 23:52:51.646126 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:52:51.925714 run patchelf(pid=31750): Launched 23:52:52.105429 run osmo-stp_10.42.42.5(pid=31747): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31747)] 23:52:52.242787 run osmo-stp_10.42.42.5(pid=31747): stdout: | (launched: 2022-12-09_23:52:50.782941) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:52:52.381938 run osmo-stp_10.42.42.5(pid=31747): stderr: | 20221209235250975 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235250976 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235250976 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235250976 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235250977 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235250977 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235250977 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:52:52.520814 run osmo-stp_10.42.42.5(pid=31747): stdout: | (launched: 2022-12-09_23:52:50.782941) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:52:52.653322 run osmo-stp_10.42.42.5(pid=31747): stderr: | 20221209235250975 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235250976 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235250976 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235250976 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235250977 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235250977 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235250977 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:52:52.810265 run patchelf(pid=31750): Terminating (SIGINT) 23:52:52.991882 run patchelf(pid=31750): Terminated: ok {rc=0} 23:52:53.123387 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=31747): Process ended prematurely: osmo-stp_10.42.42.5(pid=31747) [trial-2366↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31747)] [trial-2366↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 23:52:53.133546 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 23:52:53.162526 run osmo-hlr_10.42.42.2(pid=31744): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31744)] 23:52:53.213065 run osmo-hlr_10.42.42.2(pid=31744): stdout: | (launched: 2022-12-09_23:52:49.778568) 23:52:53.264786 run osmo-hlr_10.42.42.2(pid=31744): stderr: | 20221209235249977 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209235249977 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209235249977 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209235249977 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209235249977 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209235249978 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209235249990 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-umtrx+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209235249998 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209235249998 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209235249998 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:52:53.317103 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31737): Terminating (SIGTERM) 23:52:53.358957 run iperf3-srv_10.42.42.10(pid=31738): Terminating (SIGTERM) 23:52:53.400704 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31739): Terminating (SIGTERM) 23:52:53.442717 run iperf3-srv_10.42.42.10(pid=31740): Terminating (SIGTERM) 23:52:53.484377 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31743): Terminating (SIGTERM) 23:52:53.526414 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31746): Terminating (SIGTERM) 23:52:53.568389 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31749): Terminating (SIGTERM) 23:52:53.610623 --- ParallelTerminationStrategy: PID 31737 died... 23:52:53.630626 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31737): Terminated: ok {rc=0} 23:52:53.677155 --- ParallelTerminationStrategy: PID 31738 died... 23:52:53.696370 run iperf3-srv_10.42.42.10(pid=31738): Terminated {rc=256} 23:52:53.742846 --- ParallelTerminationStrategy: PID 31739 died... 23:52:53.762339 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31739): Terminated: ok {rc=0} 23:52:53.808600 --- ParallelTerminationStrategy: PID 31740 died... 23:52:53.828138 run iperf3-srv_10.42.42.10(pid=31740): Terminated {rc=256} 23:52:53.874390 --- ParallelTerminationStrategy: PID 31743 died... 23:52:53.893996 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31743): Terminated: ok {rc=0} 23:52:53.940626 --- ParallelTerminationStrategy: PID 31746 died... 23:52:53.960071 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31746): Terminated: ok {rc=0} 23:52:54.006908 --- ParallelTerminationStrategy: PID 31749 died... 23:52:54.026506 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31749): Terminated: ok {rc=0} 23:52:54.115264 bus /gobi_0: Setting Powered False 23:52:55.214457 bus /gobi_0: Setting Powered False 23:52:56.331125 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 23:52:57.477828 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:52:57.489404 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:52:57.562035 tst iperf3.py: using LAC 24540 23:52:57.679808 tst iperf3.py: using RAC 60 23:52:57.796879 tst iperf3.py: using CellId 24540 23:52:57.914049 tst iperf3.py: using BVCI 24541 23:52:58.022743 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:52:58.033890 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:52:58.044563 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:52:58.055405 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:52:58.066211 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:52:58.077130 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:52:58.088039 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:52:58.098874 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:52:58.109856 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:52:58.224566 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:52:58.443235 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:52:58.766518 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31751): Launched 23:52:59.046309 run iperf3-srv_10.42.42.10(pid=31752): Launched 23:52:59.167108 tst iperf3.py:8: start network... 23:52:59.384197 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:52:59.881991 run create_hlr_db(pid=31753): Launched 23:53:00.004012 bus /gobi_6: Setting Powered False 23:53:01.084059 run create_hlr_db(pid=31753): Terminated: ok {rc=0} 23:53:01.519739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31755): Launched 23:53:01.843238 run osmo-hlr_10.42.42.2(pid=31756): Launched 23:53:02.090888 run osmo-stp_10.42.42.5: Starting osmo-stp 23:53:02.837770 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31769): Launched 23:53:03.177689 run osmo-stp_10.42.42.5(pid=31770): Launched 23:53:03.412220 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:53:04.057519 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31772): Launched 23:53:04.191192 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:53:04.473744 run patchelf(pid=31773): Launched 23:53:04.652623 run osmo-stp_10.42.42.5(pid=31770): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31770)] 23:53:04.780324 run osmo-stp_10.42.42.5(pid=31770): stdout: | (launched: 2022-12-09_23:53:03.107122) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:53:04.908853 run osmo-stp_10.42.42.5(pid=31770): stderr: | 20221209235303404 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235303404 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235303404 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235303413 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235303413 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235303414 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235303414 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:53:05.038787 run osmo-stp_10.42.42.5(pid=31770): stdout: | (launched: 2022-12-09_23:53:03.107122) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:53:05.161312 run osmo-stp_10.42.42.5(pid=31770): stderr: | 20221209235303404 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235303404 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235303404 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235303413 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235303413 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235303414 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235303414 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:53:05.308623 run patchelf(pid=31773): Terminating (SIGINT) 23:53:05.479418 run patchelf(pid=31773): Terminated: ok {rc=0} 23:53:05.604497 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31770): Process ended prematurely: osmo-stp_10.42.42.5(pid=31770) [trial-2366↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31770)] [trial-2366↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8] 23:53:05.614555 tst iperf3.py:8: Test FAILED (8.2 sec) 23:53:05.642670 run osmo-hlr_10.42.42.2(pid=31756): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31756)] 23:53:05.691407 run osmo-hlr_10.42.42.2(pid=31756): stdout: | (launched: 2022-12-09_23:53:01.776725) 23:53:05.741760 run osmo-hlr_10.42.42.2(pid=31756): stderr: | 20221209235302133 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209235302133 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209235302134 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209235302134 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209235302134 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209235302134 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209235302145 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209235302166 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209235302166 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209235302166 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:53:05.792389 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31751): Terminating (SIGTERM) 23:53:05.833800 run iperf3-srv_10.42.42.10(pid=31752): Terminating (SIGTERM) 23:53:05.877836 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31755): Terminating (SIGTERM) 23:53:05.919553 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31769): Terminating (SIGTERM) 23:53:05.961551 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31772): Terminating (SIGTERM) 23:53:06.004209 --- ParallelTerminationStrategy: PID 31751 died... 23:53:06.024014 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31751): Terminated: ok {rc=0} 23:53:06.070426 --- ParallelTerminationStrategy: PID 31752 died... 23:53:06.090556 run iperf3-srv_10.42.42.10(pid=31752): Terminated {rc=256} 23:53:06.135400 --- ParallelTerminationStrategy: PID 31755 died... 23:53:06.154579 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31755): Terminated: ok {rc=0} 23:53:06.199183 --- ParallelTerminationStrategy: PID 31769 died... 23:53:06.218287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31769): Terminated: ok {rc=0} 23:53:06.262936 --- ParallelTerminationStrategy: PID 31772 died... 23:53:06.282007 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31772): Terminated: ok {rc=0} 23:53:06.368656 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 23:53:07.515417 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:07.527636 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:53:07.598374 tst iperf3m4.py: using LAC 24541 23:53:07.716142 tst iperf3m4.py: using RAC 61 23:53:07.833888 tst iperf3m4.py: using CellId 24541 23:53:07.956844 tst iperf3m4.py: using BVCI 24542 23:53:08.067589 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:08.079043 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:08.090689 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:08.102042 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:08.113399 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:08.124633 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:08.136408 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:08.147695 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:08.160141 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:53:08.279622 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:53:08.404645 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:53:08.528165 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:53:08.651402 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:53:08.870545 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:53:09.198496 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31776): Launched 23:53:09.491214 run iperf3-srv_10.42.42.10(pid=31777): Launched 23:53:09.625466 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:53:09.842566 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:53:10.172074 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31778): Launched 23:53:10.466928 run iperf3-srv_10.42.42.10(pid=31779): Launched 23:53:10.599463 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:53:10.816082 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:53:11.145232 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31780): Launched 23:53:11.438668 run iperf3-srv_10.42.42.10(pid=31781): Launched 23:53:11.572236 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:53:11.820018 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:53:12.178972 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31815): Launched 23:53:12.490825 run iperf3-srv_10.42.42.10(pid=31832): Launched 23:53:12.655100 tst iperf3m4.py:8: start network... 23:53:12.898482 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:53:13.484569 run create_hlr_db(pid=31950): Launched 23:53:13.671552 bus /gobi_6: Setting Powered False 23:53:14.736044 run create_hlr_db(pid=31950): Terminated: ok {rc=0} 23:53:15.221733 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32045): Launched 23:53:15.565678 run osmo-hlr_10.42.42.2(pid=32046): Launched 23:53:15.811556 run osmo-stp_10.42.42.5: Starting osmo-stp 23:53:16.598695 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32048): Launched 23:53:16.933729 run osmo-stp_10.42.42.5(pid=32049): Launched 23:53:17.172103 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:53:17.978933 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32051): Launched 23:53:18.119940 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:53:18.380666 run patchelf(pid=32052): Launched 23:53:18.561521 run osmo-stp_10.42.42.5(pid=32049): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32049)] 23:53:18.689502 run osmo-stp_10.42.42.5(pid=32049): stdout: | (launched: 2022-12-09_23:53:16.870760) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:53:18.819188 run osmo-stp_10.42.42.5(pid=32049): stderr: | 20221209235317218 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235317218 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235317218 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235317219 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235317219 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235317220 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235317220 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:53:18.950231 run osmo-stp_10.42.42.5(pid=32049): stdout: | (launched: 2022-12-09_23:53:16.870760) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:53:19.074650 run osmo-stp_10.42.42.5(pid=32049): stderr: | 20221209235317218 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235317218 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235317218 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235317219 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235317219 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235317220 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235317220 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:53:19.222409 run patchelf(pid=32052): Terminating (SIGINT) 23:53:19.392805 run patchelf(pid=32052): Terminated: ok {rc=0} 23:53:19.516091 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32049): Process ended prematurely: osmo-stp_10.42.42.5(pid=32049) [trial-2366↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32049)] [trial-2366↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8] 23:53:19.526834 tst iperf3m4.py:8: Test FAILED (12.0 sec) 23:53:19.555830 run osmo-hlr_10.42.42.2(pid=32046): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32046)] 23:53:19.606094 run osmo-hlr_10.42.42.2(pid=32046): stdout: | (launched: 2022-12-09_23:53:15.496790) 23:53:19.657304 run osmo-hlr_10.42.42.2(pid=32046): stderr: | 20221209235315813 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209235315813 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209235315813 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209235315813 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209235315813 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209235315813 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209235315830 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209235315860 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209235315860 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209235315860 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:53:19.709091 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31776): Terminating (SIGTERM) 23:53:19.750515 run iperf3-srv_10.42.42.10(pid=31777): Terminating (SIGTERM) 23:53:19.793843 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31778): Terminating (SIGTERM) 23:53:19.836443 run iperf3-srv_10.42.42.10(pid=31779): Terminating (SIGTERM) 23:53:19.881322 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31780): Terminating (SIGTERM) 23:53:19.923796 run iperf3-srv_10.42.42.10(pid=31781): Terminating (SIGTERM) 23:53:19.968629 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31815): Terminating (SIGTERM) 23:53:20.010875 run iperf3-srv_10.42.42.10(pid=31832): Terminating (SIGTERM) 23:53:20.054112 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32045): Terminating (SIGTERM) 23:53:20.096236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32048): Terminating (SIGTERM) 23:53:20.139591 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32051): Terminating (SIGTERM) 23:53:20.183823 --- ParallelTerminationStrategy: PID 31776 died... 23:53:20.204284 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31776): Terminated: ok {rc=0} 23:53:20.251612 --- ParallelTerminationStrategy: PID 31777 died... 23:53:20.271533 run iperf3-srv_10.42.42.10(pid=31777): Terminated {rc=256} 23:53:20.317076 --- ParallelTerminationStrategy: PID 31778 died... 23:53:20.336579 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31778): Terminated: ok {rc=0} 23:53:20.383518 --- ParallelTerminationStrategy: PID 31779 died... 23:53:20.403185 run iperf3-srv_10.42.42.10(pid=31779): Terminated {rc=256} 23:53:20.448725 --- ParallelTerminationStrategy: PID 31780 died... 23:53:20.468481 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31780): Terminated: ok {rc=0} 23:53:20.514639 --- ParallelTerminationStrategy: PID 31781 died... 23:53:20.534333 run iperf3-srv_10.42.42.10(pid=31781): Terminated {rc=256} 23:53:20.579992 --- ParallelTerminationStrategy: PID 31815 died... 23:53:20.599706 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31815): Terminated: ok {rc=0} 23:53:20.645294 --- ParallelTerminationStrategy: PID 31832 died... 23:53:20.665082 run iperf3-srv_10.42.42.10(pid=31832): Terminated {rc=256} 23:53:20.710769 --- ParallelTerminationStrategy: PID 32045 died... 23:53:20.730394 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32045): Terminated: ok {rc=0} 23:53:20.776277 --- ParallelTerminationStrategy: PID 32048 died... 23:53:20.796045 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32048): Terminated: ok {rc=0} 23:53:20.845865 --- ParallelTerminationStrategy: PID 32051 died... 23:53:20.865517 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32051): Terminated: ok {rc=0} 23:53:20.952272 bus /gobi_4: Setting Powered False 23:53:22.051982 bus /gobi_4: Setting Powered False 23:53:23.171343 bus /gobi_1: Setting Powered False 23:53:24.270242 bus /gobi_1: Setting Powered False 23:53:25.386318 bus /gobi_0: Setting Powered False 23:53:26.483624 bus /gobi_0: Setting Powered False 23:53:27.598226 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-umtrx+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 23:53:28.698964 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:28.710544 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:53:28.784807 tst ping.py: using LAC 24542 23:53:28.899711 tst ping.py: using RAC 62 23:53:29.012908 tst ping.py: using CellId 24542 23:53:29.125691 tst ping.py: using BVCI 24543 23:53:29.231376 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:29.242491 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:29.253130 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:29.263891 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:29.274685 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:29.285313 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:29.296325 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:29.307159 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:53:29.420353 tst ping.py:19: start network... 23:53:29.615999 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:53:30.070967 run create_hlr_db(pid=32054): Launched 23:53:30.189420 bus /gobi_6: Setting Powered False 23:53:31.257890 run create_hlr_db(pid=32054): Terminated: ok {rc=0} 23:53:31.759764 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32056): Launched 23:53:32.125676 run osmo-hlr_10.42.42.2(pid=32057): Launched 23:53:32.302311 run osmo-stp_10.42.42.5: Starting osmo-stp 23:53:32.803978 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32059): Launched 23:53:33.094543 run osmo-stp_10.42.42.5(pid=32060): Launched 23:53:33.205674 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:53:33.711024 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32062): Launched 23:53:33.822657 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:53:34.068749 run patchelf(pid=32063): Launched 23:53:34.230401 run osmo-stp_10.42.42.5(pid=32060): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32060)] 23:53:34.354193 run osmo-stp_10.42.42.5(pid=32060): stdout: | (launched: 2022-12-09_23:53:33.040845) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:53:34.479335 run osmo-stp_10.42.42.5(pid=32060): stderr: | 20221209235333210 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235333210 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235333211 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235333211 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235333212 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235333212 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235333212 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:53:34.604433 run osmo-stp_10.42.42.5(pid=32060): stdout: | (launched: 2022-12-09_23:53:33.040845) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:53:34.723622 run osmo-stp_10.42.42.5(pid=32060): stderr: | 20221209235333210 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235333210 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235333211 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235333211 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235333212 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235333212 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235333212 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:53:34.864898 run patchelf(pid=32063): Terminating (SIGINT) 23:53:35.028207 run patchelf(pid=32063): Terminated: ok {rc=0} 23:53:35.146083 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=32060): Process ended prematurely: osmo-stp_10.42.42.5(pid=32060) [trial-2366↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32060)] [trial-2366↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22] 23:53:35.154833 tst ping.py:22: Test FAILED (6.4 sec) 23:53:35.181463 run osmo-hlr_10.42.42.2(pid=32057): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32057)] 23:53:35.228592 run osmo-hlr_10.42.42.2(pid=32057): stdout: | (launched: 2022-12-09_23:53:32.059186) 23:53:35.277777 run osmo-hlr_10.42.42.2(pid=32057): stderr: | 20221209235332307 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209235332307 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209235332307 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209235332307 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209235332307 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209235332307 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209235332319 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209235332328 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209235332328 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209235332328 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:53:35.327272 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32056): Terminating (SIGTERM) 23:53:35.366741 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32059): Terminating (SIGTERM) 23:53:35.406442 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32062): Terminating (SIGTERM) 23:53:35.446261 --- ParallelTerminationStrategy: PID 32056 died... 23:53:35.465124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32056): Terminated: ok {rc=0} 23:53:35.508810 --- ParallelTerminationStrategy: PID 32059 died... 23:53:35.527372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32059): Terminated: ok {rc=0} 23:53:35.570885 --- ParallelTerminationStrategy: PID 32062 died... 23:53:35.589501 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32062): Terminated: ok {rc=0} 23:53:35.674743 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-umtrx+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 23:53:36.762069 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:36.773616 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 23:53:36.843684 tst ping_idle_ping.py: using LAC 24543 23:53:36.960809 tst ping_idle_ping.py: using RAC 63 23:53:37.075329 tst ping_idle_ping.py: using CellId 24543 23:53:37.191706 tst ping_idle_ping.py: using BVCI 24544 23:53:37.297548 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:37.308286 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:37.318901 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:37.329753 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:37.340561 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:37.351359 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:37.362756 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 23:53:37.373698 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 23:53:37.491001 tst ping_idle_ping.py:24: start network... 23:53:37.702228 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:53:38.186653 run create_hlr_db(pid=32065): Launched 23:53:38.305800 bus /gobi_6: Setting Powered False 23:53:39.367348 run create_hlr_db(pid=32065): Terminated: ok {rc=0} 23:53:39.802787 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32067): Launched 23:53:40.114038 run osmo-hlr_10.42.42.2(pid=32068): Launched 23:53:40.233287 run osmo-stp_10.42.42.5: Starting osmo-stp 23:53:40.773594 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32070): Launched 23:53:41.087422 run osmo-stp_10.42.42.5(pid=32071): Launched 23:53:41.207589 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:53:41.745866 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32073): Launched 23:53:41.865180 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:53:42.129094 run patchelf(pid=32074): Launched 23:53:42.302084 run osmo-stp_10.42.42.5(pid=32071): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32071)] 23:53:42.434718 run osmo-stp_10.42.42.5(pid=32071): stdout: | (launched: 2022-12-09_23:53:41.030541) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:53:42.568871 run osmo-stp_10.42.42.5(pid=32071): stderr: | 20221209235341220 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235341220 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235341220 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235341220 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235341221 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235341221 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235341221 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:53:42.703303 run osmo-stp_10.42.42.5(pid=32071): stdout: | (launched: 2022-12-09_23:53:41.030541) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:53:42.831600 run osmo-stp_10.42.42.5(pid=32071): stderr: | 20221209235341220 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235341220 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235341220 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235341220 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235341221 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235341221 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235341221 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:53:42.983846 run patchelf(pid=32074): Terminating (SIGINT) 23:53:43.160056 run patchelf(pid=32074): Terminated: ok {rc=0} 23:53:43.286927 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=32071): Process ended prematurely: osmo-stp_10.42.42.5(pid=32071) [trial-2366↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32071)] [trial-2366↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 23:53:43.296457 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 23:53:43.324809 run osmo-hlr_10.42.42.2(pid=32068): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32068)] 23:53:43.374683 run osmo-hlr_10.42.42.2(pid=32068): stdout: | (launched: 2022-12-09_23:53:40.057324) 23:53:43.426347 run osmo-hlr_10.42.42.2(pid=32068): stderr: | 20221209235340254 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209235340254 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209235340254 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209235340254 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209235340254 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209235340254 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209235340267 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209235340275 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209235340275 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209235340275 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:53:43.478444 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32067): Terminating (SIGTERM) 23:53:43.519977 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32070): Terminating (SIGTERM) 23:53:43.561501 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32073): Terminating (SIGTERM) 23:53:43.603166 --- ParallelTerminationStrategy: PID 32067 died... 23:53:43.622925 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32067): Terminated: ok {rc=0} 23:53:43.669340 --- ParallelTerminationStrategy: PID 32070 died... 23:53:43.688580 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32070): Terminated: ok {rc=0} 23:53:43.734673 --- ParallelTerminationStrategy: PID 32073 died... 23:53:43.753959 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32073): Terminated: ok {rc=0} 23:53:43.841594 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2366 gprs:trx-umtrx+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 gprs:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 23:53:45.142900 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:53:45.148758 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 23:53:45.182250 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 23:53:45.220875 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 23:53:45.306544 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 23:53:45.338752 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 23:53:45.377207 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 23:53:45.995392 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2366 gprs:trx-umtrx+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 23:53:46.060160 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:53:46.072694 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:53:46.146551 tst cs_paging_gprs_active.py: using LAC 24544 23:53:46.267556 tst cs_paging_gprs_active.py: using RAC 64 23:53:46.426410 tst cs_paging_gprs_active.py: using CellId 24544 23:53:46.545214 tst cs_paging_gprs_active.py: using BVCI 24545 23:53:46.686511 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:53:46.698225 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:53:46.709629 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:53:46.721050 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:53:46.732441 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:53:46.743784 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:53:46.755456 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:53:46.766939 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:53:46.778311 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:53:46.898782 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:53:47.056190 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:53:47.290608 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:53:47.611863 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32078): Launched 23:53:47.888573 run iperf3-srv_10.42.42.10(pid=32079): Launched 23:53:48.007601 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:53:48.222443 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:53:48.540903 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32080): Launched 23:53:48.815916 run iperf3-srv_10.42.42.10(pid=32081): Launched 23:53:48.934611 tst cs_paging_gprs_active.py:38: start network... 23:53:49.149559 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:53:49.640906 run create_hlr_db(pid=32082): Launched 23:53:49.761868 bus /gobi_6: Setting Powered False 23:53:50.824626 run create_hlr_db(pid=32082): Terminated: ok {rc=0} 23:53:51.266963 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32084): Launched 23:53:51.583239 run osmo-hlr_10.42.42.2(pid=32085): Launched 23:53:51.704038 run osmo-stp_10.42.42.5: Starting osmo-stp 23:53:52.252473 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32087): Launched 23:53:52.568578 run osmo-stp_10.42.42.5(pid=32088): Launched 23:53:52.688710 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:53:53.233692 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32090): Launched 23:53:53.355006 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:53:53.624821 run patchelf(pid=32091): Launched 23:53:53.800712 run osmo-stp_10.42.42.5(pid=32088): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32088)] 23:53:53.935099 run osmo-stp_10.42.42.5(pid=32088): stdout: | (launched: 2022-12-09_23:53:52.511270) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:53:54.071237 run osmo-stp_10.42.42.5(pid=32088): stderr: | 20221209235352703 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235352703 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235352704 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235352704 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235352705 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235352705 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235352705 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:53:54.208038 run osmo-stp_10.42.42.5(pid=32088): stdout: | (launched: 2022-12-09_23:53:52.511270) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:53:54.338007 run osmo-stp_10.42.42.5(pid=32088): stderr: | 20221209235352703 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235352703 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235352704 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235352704 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235352705 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235352705 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235352705 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:53:54.492092 run patchelf(pid=32091): Terminating (SIGINT) 23:53:54.669862 run patchelf(pid=32091): Terminated: ok {rc=0} 23:53:54.798431 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=32088): Process ended prematurely: osmo-stp_10.42.42.5(pid=32088) [trial-2366↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32088)] [trial-2366↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 23:53:54.808518 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 23:53:54.837333 run osmo-hlr_10.42.42.2(pid=32085): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32085)] 23:53:54.887142 run osmo-hlr_10.42.42.2(pid=32085): stdout: | (launched: 2022-12-09_23:53:51.525743) 23:53:54.938624 run osmo-hlr_10.42.42.2(pid=32085): stderr: | 20221209235351722 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209235351722 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209235351722 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209235351722 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209235351722 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209235351722 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209235351734 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-umtrx+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209235351742 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209235351742 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209235351742 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:53:54.990784 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32078): Terminating (SIGTERM) 23:53:55.032407 run iperf3-srv_10.42.42.10(pid=32079): Terminating (SIGTERM) 23:53:55.074042 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32080): Terminating (SIGTERM) 23:53:55.115997 run iperf3-srv_10.42.42.10(pid=32081): Terminating (SIGTERM) 23:53:55.158111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32084): Terminating (SIGTERM) 23:53:55.199668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32087): Terminating (SIGTERM) 23:53:55.241165 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32090): Terminating (SIGTERM) 23:53:55.282646 --- ParallelTerminationStrategy: PID 32078 died... 23:53:55.302356 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32078): Terminated: ok {rc=0} 23:53:55.348603 --- ParallelTerminationStrategy: PID 32079 died... 23:53:55.367966 run iperf3-srv_10.42.42.10(pid=32079): Terminated {rc=256} 23:53:55.413742 --- ParallelTerminationStrategy: PID 32080 died... 23:53:55.432822 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32080): Terminated: ok {rc=0} 23:53:55.478959 --- ParallelTerminationStrategy: PID 32081 died... 23:53:55.498273 run iperf3-srv_10.42.42.10(pid=32081): Terminated {rc=256} 23:53:55.544015 --- ParallelTerminationStrategy: PID 32084 died... 23:53:55.563272 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32084): Terminated: ok {rc=0} 23:53:55.609400 --- ParallelTerminationStrategy: PID 32087 died... 23:53:55.628715 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32087): Terminated: ok {rc=0} 23:53:55.674746 --- ParallelTerminationStrategy: PID 32090 died... 23:53:55.694145 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32090): Terminated: ok {rc=0} 23:53:55.780617 bus /gobi_0: Setting Powered False 23:53:56.879286 bus /gobi_0: Setting Powered False 23:53:57.993534 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 23:53:59.138857 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:53:59.150486 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:53:59.221639 tst iperf3.py: using LAC 24545 23:53:59.340718 tst iperf3.py: using RAC 65 23:53:59.457315 tst iperf3.py: using CellId 24545 23:53:59.574591 tst iperf3.py: using BVCI 24546 23:53:59.683983 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:53:59.695040 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:53:59.705917 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:53:59.716845 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:53:59.727712 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:53:59.738570 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:53:59.749476 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:53:59.760110 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:53:59.770982 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:53:59.889558 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:54:00.104694 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:54:00.423014 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32092): Launched 23:54:00.697733 run iperf3-srv_10.42.42.10(pid=32093): Launched 23:54:00.816120 tst iperf3.py:8: start network... 23:54:01.045962 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:54:01.551195 run create_hlr_db(pid=32094): Launched 23:54:01.701412 bus /gobi_6: Setting Powered False 23:54:02.761155 run create_hlr_db(pid=32094): Terminated: ok {rc=0} 23:54:03.176329 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32096): Launched 23:54:03.472403 run osmo-hlr_10.42.42.2(pid=32097): Launched 23:54:03.586400 run osmo-stp_10.42.42.5: Starting osmo-stp 23:54:04.101485 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32099): Launched 23:54:04.398268 run osmo-stp_10.42.42.5(pid=32100): Launched 23:54:04.511129 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:54:05.022155 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32102): Launched 23:54:05.135448 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:54:05.385334 run patchelf(pid=32103): Launched 23:54:05.549773 run osmo-stp_10.42.42.5(pid=32100): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32100)] 23:54:05.675345 run osmo-stp_10.42.42.5(pid=32100): stdout: | (launched: 2022-12-09_23:54:04.343867) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:54:05.802716 run osmo-stp_10.42.42.5(pid=32100): stderr: | 20221209235404515 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235404515 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235404515 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235404516 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235404516 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235404516 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235404516 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:54:05.930066 run osmo-stp_10.42.42.5(pid=32100): stdout: | (launched: 2022-12-09_23:54:04.343867) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:54:06.052150 run osmo-stp_10.42.42.5(pid=32100): stderr: | 20221209235404515 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235404515 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235404515 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235404516 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235404516 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235404516 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235404516 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:54:06.196419 run patchelf(pid=32103): Terminating (SIGINT) 23:54:06.363206 run patchelf(pid=32103): Terminated: ok {rc=0} 23:54:06.483569 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32100): Process ended prematurely: osmo-stp_10.42.42.5(pid=32100) [trial-2366↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32100)] [trial-2366↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8] 23:54:06.492859 tst iperf3.py:8: Test FAILED (7.4 sec) 23:54:06.519546 run osmo-hlr_10.42.42.2(pid=32097): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32097)] 23:54:06.566512 run osmo-hlr_10.42.42.2(pid=32097): stdout: | (launched: 2022-12-09_23:54:03.418501) 23:54:06.615154 run osmo-hlr_10.42.42.2(pid=32097): stderr: | 20221209235403596 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209235403596 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209235403596 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209235403596 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209235403596 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209235403596 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209235403609 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209235403617 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209235403618 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209235403618 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:54:06.664194 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32092): Terminating (SIGTERM) 23:54:06.703494 run iperf3-srv_10.42.42.10(pid=32093): Terminating (SIGTERM) 23:54:06.742641 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32096): Terminating (SIGTERM) 23:54:06.782003 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32099): Terminating (SIGTERM) 23:54:06.821293 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32102): Terminating (SIGTERM) 23:54:06.861189 --- ParallelTerminationStrategy: PID 32092 died... 23:54:06.879858 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32092): Terminated: ok {rc=0} 23:54:06.923752 --- ParallelTerminationStrategy: PID 32093 died... 23:54:06.942258 run iperf3-srv_10.42.42.10(pid=32093): Terminated {rc=256} 23:54:06.985721 --- ParallelTerminationStrategy: PID 32096 died... 23:54:07.004185 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32096): Terminated: ok {rc=0} 23:54:07.047745 --- ParallelTerminationStrategy: PID 32099 died... 23:54:07.066287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32099): Terminated: ok {rc=0} 23:54:07.109743 --- ParallelTerminationStrategy: PID 32102 died... 23:54:07.128287 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32102): Terminated: ok {rc=0} 23:54:07.210901 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 23:54:08.352361 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:08.363956 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:54:08.434032 tst iperf3m4.py: using LAC 24546 23:54:08.556135 tst iperf3m4.py: using RAC 66 23:54:08.687482 tst iperf3m4.py: using CellId 24546 23:54:08.811109 tst iperf3m4.py: using BVCI 24547 23:54:08.920092 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:08.931066 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:08.941831 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:08.952587 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:08.963296 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:08.974155 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:08.984924 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:08.995435 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:09.006208 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:54:09.123957 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:54:09.243740 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:54:09.358879 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:54:09.476551 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:54:09.677340 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:54:09.974975 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32104): Launched 23:54:10.234446 run iperf3-srv_10.42.42.10(pid=32105): Launched 23:54:10.345220 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:54:10.544233 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:54:10.841646 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32106): Launched 23:54:11.098865 run iperf3-srv_10.42.42.10(pid=32107): Launched 23:54:11.209558 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:54:11.408681 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:54:11.705699 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32108): Launched 23:54:11.962056 run iperf3-srv_10.42.42.10(pid=32109): Launched 23:54:12.072282 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:54:12.270256 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:54:12.565951 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32110): Launched 23:54:12.823596 run iperf3-srv_10.42.42.10(pid=32111): Launched 23:54:12.934271 tst iperf3m4.py:8: start network... 23:54:13.131965 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:54:13.591152 run create_hlr_db(pid=32112): Launched 23:54:13.712515 bus /gobi_6: Setting Powered False 23:54:14.772055 run create_hlr_db(pid=32112): Terminated: ok {rc=0} 23:54:15.206833 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32114): Launched 23:54:15.525205 run osmo-hlr_10.42.42.2(pid=32115): Launched 23:54:15.646676 run osmo-stp_10.42.42.5: Starting osmo-stp 23:54:16.223897 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32117): Launched 23:54:16.616018 run osmo-stp_10.42.42.5(pid=32118): Launched 23:54:16.843931 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:54:17.518840 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32120): Launched 23:54:17.640296 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:54:17.907982 run patchelf(pid=32121): Launched 23:54:18.084588 run osmo-stp_10.42.42.5(pid=32118): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32118)] 23:54:18.219631 run osmo-stp_10.42.42.5(pid=32118): stdout: | (launched: 2022-12-09_23:54:16.538934) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:54:18.356036 run osmo-stp_10.42.42.5(pid=32118): stderr: | 20221209235416855 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235416855 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235416855 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235416855 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235416856 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235416856 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235416856 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:54:18.493077 run osmo-stp_10.42.42.5(pid=32118): stdout: | (launched: 2022-12-09_23:54:16.538934) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:54:18.623051 run osmo-stp_10.42.42.5(pid=32118): stderr: | 20221209235416855 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235416855 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235416855 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235416855 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235416856 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235416856 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235416856 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:54:18.777281 run patchelf(pid=32121): Terminating (SIGINT) 23:54:18.955697 run patchelf(pid=32121): Terminated: ok {rc=0} 23:54:19.084622 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32118): Process ended prematurely: osmo-stp_10.42.42.5(pid=32118) [trial-2366↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32118)] [trial-2366↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8] 23:54:19.094944 tst iperf3m4.py:8: Test FAILED (10.8 sec) 23:54:19.124717 run osmo-hlr_10.42.42.2(pid=32115): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32115)] 23:54:19.174861 run osmo-hlr_10.42.42.2(pid=32115): stdout: | (launched: 2022-12-09_23:54:15.467290) 23:54:19.226950 run osmo-hlr_10.42.42.2(pid=32115): stderr: | 20221209235415667 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209235415667 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209235415667 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209235415667 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209235415667 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209235415667 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209235415680 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209235415690 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209235415690 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209235415690 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:54:19.279807 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32104): Terminating (SIGTERM) 23:54:19.322030 run iperf3-srv_10.42.42.10(pid=32105): Terminating (SIGTERM) 23:54:19.363994 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32106): Terminating (SIGTERM) 23:54:19.406386 run iperf3-srv_10.42.42.10(pid=32107): Terminating (SIGTERM) 23:54:19.448409 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32108): Terminating (SIGTERM) 23:54:19.490635 run iperf3-srv_10.42.42.10(pid=32109): Terminating (SIGTERM) 23:54:19.532695 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32110): Terminating (SIGTERM) 23:54:19.575060 run iperf3-srv_10.42.42.10(pid=32111): Terminating (SIGTERM) 23:54:19.617057 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32114): Terminating (SIGTERM) 23:54:19.659209 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32117): Terminating (SIGTERM) 23:54:19.701334 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32120): Terminating (SIGTERM) 23:54:19.743783 --- ParallelTerminationStrategy: PID 32104 died... 23:54:19.763476 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32104): Terminated: ok {rc=0} 23:54:19.810408 --- ParallelTerminationStrategy: PID 32105 died... 23:54:19.830000 run iperf3-srv_10.42.42.10(pid=32105): Terminated {rc=256} 23:54:19.876406 --- ParallelTerminationStrategy: PID 32106 died... 23:54:19.895901 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32106): Terminated: ok {rc=0} 23:54:19.942652 --- ParallelTerminationStrategy: PID 32107 died... 23:54:19.962237 run iperf3-srv_10.42.42.10(pid=32107): Terminated {rc=256} 23:54:20.009212 --- ParallelTerminationStrategy: PID 32108 died... 23:54:20.028822 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32108): Terminated: ok {rc=0} 23:54:20.075476 --- ParallelTerminationStrategy: PID 32109 died... 23:54:20.095310 run iperf3-srv_10.42.42.10(pid=32109): Terminated {rc=256} 23:54:20.142525 --- ParallelTerminationStrategy: PID 32110 died... 23:54:20.162219 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32110): Terminated: ok {rc=0} 23:54:20.209126 --- ParallelTerminationStrategy: PID 32111 died... 23:54:20.228569 run iperf3-srv_10.42.42.10(pid=32111): Terminated {rc=256} 23:54:20.274976 --- ParallelTerminationStrategy: PID 32114 died... 23:54:20.294578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32114): Terminated: ok {rc=0} 23:54:20.341204 --- ParallelTerminationStrategy: PID 32117 died... 23:54:20.360606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32117): Terminated: ok {rc=0} 23:54:20.406975 --- ParallelTerminationStrategy: PID 32120 died... 23:54:20.426528 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32120): Terminated: ok {rc=0} 23:54:20.514561 bus /gobi_4: Setting Powered False 23:54:21.612646 bus /gobi_4: Setting Powered False 23:54:22.727799 bus /gobi_1: Setting Powered False 23:54:23.825723 bus /gobi_1: Setting Powered False 23:54:24.941778 bus /gobi_0: Setting Powered False 23:54:26.039264 bus /gobi_0: Setting Powered False 23:54:27.157220 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-umtrx+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 23:54:28.259715 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:28.271936 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:54:28.345253 tst ping.py: using LAC 24547 23:54:28.473615 tst ping.py: using RAC 67 23:54:28.595664 tst ping.py: using CellId 24547 23:54:28.713396 tst ping.py: using BVCI 24548 23:54:28.822242 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:28.833389 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:28.844293 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:28.855670 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:28.867102 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:28.878536 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:28.890050 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:28.901296 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:54:29.019706 tst ping.py:19: start network... 23:54:29.230984 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:54:29.716920 run create_hlr_db(pid=32122): Launched 23:54:29.844182 bus /gobi_6: Setting Powered False 23:54:30.913998 run create_hlr_db(pid=32122): Terminated: ok {rc=0} 23:54:31.349980 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32124): Launched 23:54:31.664504 run osmo-hlr_10.42.42.2(pid=32125): Launched 23:54:31.935595 run osmo-stp_10.42.42.5: Starting osmo-stp 23:54:32.577333 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32127): Launched 23:54:32.886890 run osmo-stp_10.42.42.5(pid=32128): Launched 23:54:33.006012 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:54:33.543080 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32130): Launched 23:54:33.661983 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:54:33.925189 run patchelf(pid=32131): Launched 23:54:34.098239 run osmo-stp_10.42.42.5(pid=32128): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32128)] 23:54:34.231467 run osmo-stp_10.42.42.5(pid=32128): stdout: | (launched: 2022-12-09_23:54:32.830412) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:54:34.366132 run osmo-stp_10.42.42.5(pid=32128): stderr: | 20221209235433018 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235433019 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235433019 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235433019 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235433022 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235433022 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235433022 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:54:34.500619 run osmo-stp_10.42.42.5(pid=32128): stdout: | (launched: 2022-12-09_23:54:32.830412) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:54:34.629106 run osmo-stp_10.42.42.5(pid=32128): stderr: | 20221209235433018 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235433019 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235433019 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235433019 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235433022 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235433022 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235433022 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:54:34.781177 run patchelf(pid=32131): Terminating (SIGINT) 23:54:34.956416 run patchelf(pid=32131): Terminated: ok {rc=0} 23:54:35.083163 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=32128): Process ended prematurely: osmo-stp_10.42.42.5(pid=32128) [trial-2366↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32128)] [trial-2366↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22] 23:54:35.092582 tst ping.py:22: Test FAILED (6.8 sec) 23:54:35.121425 run osmo-hlr_10.42.42.2(pid=32125): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32125)] 23:54:35.171665 run osmo-hlr_10.42.42.2(pid=32125): stdout: | (launched: 2022-12-09_23:54:31.596391) 23:54:35.223495 run osmo-hlr_10.42.42.2(pid=32125): stderr: | 20221209235431824 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209235431824 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209235431824 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209235431825 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209235431825 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209235431825 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209235431839 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209235431862 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209235431863 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209235431864 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:54:35.276027 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32124): Terminating (SIGTERM) 23:54:35.318015 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32127): Terminating (SIGTERM) 23:54:35.360083 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32130): Terminating (SIGTERM) 23:54:35.402547 --- ParallelTerminationStrategy: PID 32124 died... 23:54:35.422470 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32124): Terminated: ok {rc=0} 23:54:35.469150 --- ParallelTerminationStrategy: PID 32127 died... 23:54:35.488548 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32127): Terminated: ok {rc=0} 23:54:35.534805 --- ParallelTerminationStrategy: PID 32130 died... 23:54:35.554212 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32130): Terminated: ok {rc=0} 23:54:35.642290 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-umtrx+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 23:54:36.729377 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:36.741934 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:54:36.817760 tst ping_idle_ping.py: using LAC 24548 23:54:36.942435 tst ping_idle_ping.py: using RAC 68 23:54:37.067695 tst ping_idle_ping.py: using CellId 24548 23:54:37.192054 tst ping_idle_ping.py: using BVCI 24549 23:54:37.306743 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:37.318140 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:37.329395 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:37.340698 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:37.352064 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:37.363872 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:37.375907 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 23:54:37.387247 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 23:54:37.505515 tst ping_idle_ping.py:24: start network... 23:54:37.716924 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:54:38.201726 run create_hlr_db(pid=32132): Launched 23:54:38.321026 bus /gobi_6: Setting Powered False 23:54:39.383793 run create_hlr_db(pid=32132): Terminated: ok {rc=0} 23:54:39.803356 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32134): Launched 23:54:40.095698 run osmo-hlr_10.42.42.2(pid=32135): Launched 23:54:40.208696 run osmo-stp_10.42.42.5: Starting osmo-stp 23:54:40.714947 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32137): Launched 23:54:41.008846 run osmo-stp_10.42.42.5(pid=32138): Launched 23:54:41.120633 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:54:41.625732 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32140): Launched 23:54:41.737493 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:54:41.985176 run patchelf(pid=32141): Launched 23:54:42.147915 run osmo-stp_10.42.42.5(pid=32138): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32138)] 23:54:42.272887 run osmo-stp_10.42.42.5(pid=32138): stdout: | (launched: 2022-12-09_23:54:40.955191) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:54:42.399097 run osmo-stp_10.42.42.5(pid=32138): stderr: | 20221209235441127 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235441127 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235441127 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235441127 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235441128 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235441128 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235441128 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:54:42.525217 run osmo-stp_10.42.42.5(pid=32138): stdout: | (launched: 2022-12-09_23:54:40.955191) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:54:42.645667 run osmo-stp_10.42.42.5(pid=32138): stderr: | 20221209235441127 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235441127 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235441127 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235441127 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235441128 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235441128 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235441128 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:54:42.788331 run patchelf(pid=32141): Terminating (SIGINT) 23:54:42.953405 run patchelf(pid=32141): Terminated: ok {rc=0} 23:54:43.071481 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=32138): Process ended prematurely: osmo-stp_10.42.42.5(pid=32138) [trial-2366↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32138)] [trial-2366↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 23:54:43.080394 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 23:54:43.106951 run osmo-hlr_10.42.42.2(pid=32135): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32135)] 23:54:43.154097 run osmo-hlr_10.42.42.2(pid=32135): stdout: | (launched: 2022-12-09_23:54:40.042539) 23:54:43.203264 run osmo-hlr_10.42.42.2(pid=32135): stderr: | 20221209235440219 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209235440219 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209235440219 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209235440219 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209235440219 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209235440220 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209235440233 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209235440242 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209235440242 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209235440243 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:54:43.252812 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32134): Terminating (SIGTERM) 23:54:43.292488 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32137): Terminating (SIGTERM) 23:54:43.332100 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32140): Terminating (SIGTERM) 23:54:43.371786 --- ParallelTerminationStrategy: PID 32134 died... 23:54:43.391496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32134): Terminated: ok {rc=0} 23:54:43.435536 --- ParallelTerminationStrategy: PID 32137 died... 23:54:43.454279 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32137): Terminated: ok {rc=0} 23:54:43.497933 --- ParallelTerminationStrategy: PID 32140 died... 23:54:43.516554 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32140): Terminated: ok {rc=0} 23:54:43.600291 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2366 gprs:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 23:54:44.898579 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:54:44.904880 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 23:54:44.937820 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 23:54:44.976141 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 23:54:45.062218 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 23:54:45.094711 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 23:54:45.133524 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 23:54:45.743959 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2366 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 23:54:45.798018 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:54:45.809887 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 23:54:45.866845 tst cs_paging_gprs_active.py: using LAC 24549 23:54:46.008417 tst cs_paging_gprs_active.py: using RAC 69 23:54:46.131081 tst cs_paging_gprs_active.py: using CellId 24549 23:54:46.288416 tst cs_paging_gprs_active.py: using BVCI 24550 23:54:46.438863 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:54:46.454501 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:54:46.469423 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:54:46.485200 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:54:46.500028 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:54:46.514131 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:54:46.528264 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:54:46.543266 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:54:46.560931 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 23:54:46.702580 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 23:54:46.830214 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:54:47.050463 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:54:47.368100 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32146): Launched 23:54:47.628345 run iperf3-srv_10.42.42.10(pid=32147): Launched 23:54:47.740184 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:54:47.941228 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:54:48.240322 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32148): Launched 23:54:48.500526 run iperf3-srv_10.42.42.10(pid=32149): Launched 23:54:48.611788 tst cs_paging_gprs_active.py:38: start network... 23:54:48.810648 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:54:49.271590 run create_hlr_db(pid=32150): Launched 23:54:49.394958 bus /gobi_6: Setting Powered False 23:54:50.454421 run create_hlr_db(pid=32150): Terminated: ok {rc=0} 23:54:50.891221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32152): Launched 23:54:51.195275 run osmo-hlr_10.42.42.2(pid=32153): Launched 23:54:51.307636 run osmo-stp_10.42.42.5: Starting osmo-stp 23:54:51.817279 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32155): Launched 23:54:52.113662 run osmo-stp_10.42.42.5(pid=32156): Launched 23:54:52.225757 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:54:52.737010 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32158): Launched 23:54:52.850584 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:54:53.101047 run patchelf(pid=32159): Launched 23:54:53.265800 run osmo-stp_10.42.42.5(pid=32156): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32156)] 23:54:53.391306 run osmo-stp_10.42.42.5(pid=32156): stdout: | (launched: 2022-12-09_23:54:52.059614) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:54:53.518975 run osmo-stp_10.42.42.5(pid=32156): stderr: | 20221209235452230 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235452230 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235452230 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235452231 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235452231 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235452231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235452231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:54:53.646621 run osmo-stp_10.42.42.5(pid=32156): stdout: | (launched: 2022-12-09_23:54:52.059614) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:54:53.768227 run osmo-stp_10.42.42.5(pid=32156): stderr: | 20221209235452230 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235452230 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235452230 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235452231 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235452231 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235452231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235452231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:54:53.912122 run patchelf(pid=32159): Terminating (SIGINT) 23:54:54.078886 run patchelf(pid=32159): Terminated: ok {rc=0} 23:54:54.199673 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=32156): Process ended prematurely: osmo-stp_10.42.42.5(pid=32156) [trial-2366↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32156)] [trial-2366↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 23:54:54.209075 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 23:54:54.235658 run osmo-hlr_10.42.42.2(pid=32153): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32153)] 23:54:54.282668 run osmo-hlr_10.42.42.2(pid=32153): stdout: | (launched: 2022-12-09_23:54:51.140511) 23:54:54.331420 run osmo-hlr_10.42.42.2(pid=32153): stderr: | 20221209235451315 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209235451315 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209235451315 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209235451315 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209235451315 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209235451315 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209235451327 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209235451338 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209235451338 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209235451338 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:54:54.381379 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32146): Terminating (SIGTERM) 23:54:54.420600 run iperf3-srv_10.42.42.10(pid=32147): Terminating (SIGTERM) 23:54:54.459774 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32148): Terminating (SIGTERM) 23:54:54.498737 run iperf3-srv_10.42.42.10(pid=32149): Terminating (SIGTERM) 23:54:54.537729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32152): Terminating (SIGTERM) 23:54:54.576843 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32155): Terminating (SIGTERM) 23:54:54.615769 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32158): Terminating (SIGTERM) 23:54:54.655079 --- ParallelTerminationStrategy: PID 32146 died... 23:54:54.673723 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32146): Terminated: ok {rc=0} 23:54:54.717497 --- ParallelTerminationStrategy: PID 32147 died... 23:54:54.735598 run iperf3-srv_10.42.42.10(pid=32147): Terminated {rc=256} 23:54:54.778849 --- ParallelTerminationStrategy: PID 32148 died... 23:54:54.797333 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32148): Terminated: ok {rc=0} 23:54:54.840491 --- ParallelTerminationStrategy: PID 32149 died... 23:54:54.858741 run iperf3-srv_10.42.42.10(pid=32149): Terminated {rc=256} 23:54:54.901893 --- ParallelTerminationStrategy: PID 32152 died... 23:54:54.920341 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32152): Terminated: ok {rc=0} 23:54:54.963988 --- ParallelTerminationStrategy: PID 32155 died... 23:54:54.982301 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32155): Terminated: ok {rc=0} 23:54:55.026281 --- ParallelTerminationStrategy: PID 32158 died... 23:54:55.044760 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32158): Terminated: ok {rc=0} 23:54:55.129866 bus /gobi_0: Setting Powered False 23:54:56.228755 bus /gobi_0: Setting Powered False 23:54:57.343772 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 23:54:58.489756 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:54:58.501572 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 23:54:58.555190 tst iperf3.py: using LAC 24550 23:54:58.681357 tst iperf3.py: using RAC 70 23:54:58.807649 tst iperf3.py: using CellId 24550 23:54:58.935962 tst iperf3.py: using BVCI 24551 23:54:59.053445 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:54:59.065496 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:54:59.077418 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:54:59.089799 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:54:59.101907 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:54:59.114229 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:54:59.126420 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:54:59.138635 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:54:59.151043 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 23:54:59.266931 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:54:59.467041 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:54:59.766029 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32162): Launched 23:55:00.024572 run iperf3-srv_10.42.42.10(pid=32163): Launched 23:55:00.136349 tst iperf3.py:8: start network... 23:55:00.337056 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:55:00.798862 run create_hlr_db(pid=32164): Launched 23:55:00.942910 bus /gobi_6: Setting Powered False 23:55:02.008012 run create_hlr_db(pid=32164): Terminated: ok {rc=0} 23:55:02.489054 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32169): Launched 23:55:02.807465 run osmo-hlr_10.42.42.2(pid=32170): Launched 23:55:02.928556 run osmo-stp_10.42.42.5: Starting osmo-stp 23:55:03.477209 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32172): Launched 23:55:03.792817 run osmo-stp_10.42.42.5(pid=32173): Launched 23:55:03.913720 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:55:04.461891 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32175): Launched 23:55:04.583763 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:55:04.852534 run patchelf(pid=32176): Launched 23:55:05.028703 run osmo-stp_10.42.42.5(pid=32173): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32173)] 23:55:05.163606 run osmo-stp_10.42.42.5(pid=32173): stdout: | (launched: 2022-12-09_23:55:03.735175) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:55:05.300298 run osmo-stp_10.42.42.5(pid=32173): stderr: | 20221209235503926 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235503926 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235503926 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235503927 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235503927 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235503927 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235503927 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:55:05.437235 run osmo-stp_10.42.42.5(pid=32173): stdout: | (launched: 2022-12-09_23:55:03.735175) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:55:05.567188 run osmo-stp_10.42.42.5(pid=32173): stderr: | 20221209235503926 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235503926 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235503926 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235503927 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235503927 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235503927 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235503927 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:55:05.721231 run patchelf(pid=32176): Terminating (SIGINT) 23:55:05.900191 run patchelf(pid=32176): Terminated: ok {rc=0} 23:55:06.029453 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32173): Process ended prematurely: osmo-stp_10.42.42.5(pid=32173) [trial-2366↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32173)] [trial-2366↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 23:55:06.039502 tst iperf3.py:8: Test FAILED (7.6 sec) 23:55:06.068348 run osmo-hlr_10.42.42.2(pid=32170): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32170)] 23:55:06.118375 run osmo-hlr_10.42.42.2(pid=32170): stdout: | (launched: 2022-12-09_23:55:02.749910) 23:55:06.170334 run osmo-hlr_10.42.42.2(pid=32170): stderr: | 20221209235502946 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209235502946 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209235502946 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209235502946 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209235502946 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209235502946 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209235502959 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209235502967 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209235502968 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209235502968 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:55:06.222844 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32162): Terminating (SIGTERM) 23:55:06.264639 run iperf3-srv_10.42.42.10(pid=32163): Terminating (SIGTERM) 23:55:06.306209 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32169): Terminating (SIGTERM) 23:55:06.348099 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32172): Terminating (SIGTERM) 23:55:06.389869 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32175): Terminating (SIGTERM) 23:55:06.431750 --- ParallelTerminationStrategy: PID 32162 died... 23:55:06.451543 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32162): Terminated: ok {rc=0} 23:55:06.497906 --- ParallelTerminationStrategy: PID 32163 died... 23:55:06.517156 run iperf3-srv_10.42.42.10(pid=32163): Terminated {rc=256} 23:55:06.563087 --- ParallelTerminationStrategy: PID 32169 died... 23:55:06.582437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32169): Terminated: ok {rc=0} 23:55:06.628631 --- ParallelTerminationStrategy: PID 32172 died... 23:55:06.648023 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32172): Terminated: ok {rc=0} 23:55:06.694310 --- ParallelTerminationStrategy: PID 32175 died... 23:55:06.713650 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32175): Terminated: ok {rc=0} 23:55:06.800424 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 23:55:07.950360 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:07.965749 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 23:55:08.016737 tst iperf3m4.py: using LAC 24551 23:55:08.141300 tst iperf3m4.py: using RAC 71 23:55:08.265337 tst iperf3m4.py: using CellId 24551 23:55:08.393760 tst iperf3m4.py: using BVCI 24552 23:55:08.510736 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:08.522491 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:08.533985 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:08.545765 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:08.557526 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:08.569257 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:08.580867 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:08.592537 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:08.604455 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 23:55:08.725311 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 23:55:08.845844 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 23:55:08.964582 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 23:55:09.084528 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:55:09.300566 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:55:09.618693 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32177): Launched 23:55:09.893088 run iperf3-srv_10.42.42.10(pid=32178): Launched 23:55:10.011672 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:55:10.226222 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:55:10.545045 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32179): Launched 23:55:10.820873 run iperf3-srv_10.42.42.10(pid=32180): Launched 23:55:10.939802 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 23:55:11.155165 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:55:11.474415 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32181): Launched 23:55:11.749631 run iperf3-srv_10.42.42.10(pid=32182): Launched 23:55:11.869109 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 23:55:12.084431 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:55:12.405280 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32183): Launched 23:55:12.681156 run iperf3-srv_10.42.42.10(pid=32184): Launched 23:55:12.799675 tst iperf3m4.py:8: start network... 23:55:13.013885 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:55:13.509876 run create_hlr_db(pid=32185): Launched 23:55:13.630496 bus /gobi_6: Setting Powered False 23:55:14.693859 run create_hlr_db(pid=32185): Terminated: ok {rc=0} 23:55:15.120502 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32187): Launched 23:55:15.418065 run osmo-hlr_10.42.42.2(pid=32188): Launched 23:55:15.531300 run osmo-stp_10.42.42.5: Starting osmo-stp 23:55:16.062208 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32190): Launched 23:55:16.376458 run osmo-stp_10.42.42.5(pid=32191): Launched 23:55:16.607428 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:55:17.222141 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32193): Launched 23:55:17.338633 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:55:17.589578 run patchelf(pid=32194): Launched 23:55:17.754760 run osmo-stp_10.42.42.5(pid=32191): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32191)] 23:55:17.881149 run osmo-stp_10.42.42.5(pid=32191): stdout: | (launched: 2022-12-09_23:55:16.318858) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:55:18.009128 run osmo-stp_10.42.42.5(pid=32191): stderr: | 20221209235516647 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235516648 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235516648 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235516648 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235516655 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235516655 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235516655 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:55:18.136866 run osmo-stp_10.42.42.5(pid=32191): stdout: | (launched: 2022-12-09_23:55:16.318858) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:55:18.258886 run osmo-stp_10.42.42.5(pid=32191): stderr: | 20221209235516647 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235516648 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235516648 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235516648 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235516655 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235516655 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235516655 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:55:18.403228 run patchelf(pid=32194): Terminating (SIGINT) 23:55:18.571404 run patchelf(pid=32194): Terminated: ok {rc=0} 23:55:18.691867 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32191): Process ended prematurely: osmo-stp_10.42.42.5(pid=32191) [trial-2366↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32191)] [trial-2366↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 23:55:18.701330 tst iperf3m4.py:8: Test FAILED (10.8 sec) 23:55:18.728241 run osmo-hlr_10.42.42.2(pid=32188): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32188)] 23:55:18.774944 run osmo-hlr_10.42.42.2(pid=32188): stdout: | (launched: 2022-12-09_23:55:15.363841) 23:55:18.823560 run osmo-hlr_10.42.42.2(pid=32188): stderr: | 20221209235515538 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209235515538 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209235515538 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209235515538 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209235515538 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209235515538 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209235515551 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209235515563 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209235515563 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209235515563 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:55:18.872720 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32177): Terminating (SIGTERM) 23:55:18.911854 run iperf3-srv_10.42.42.10(pid=32178): Terminating (SIGTERM) 23:55:18.950920 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32179): Terminating (SIGTERM) 23:55:18.989923 run iperf3-srv_10.42.42.10(pid=32180): Terminating (SIGTERM) 23:55:19.028681 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32181): Terminating (SIGTERM) 23:55:19.067699 run iperf3-srv_10.42.42.10(pid=32182): Terminating (SIGTERM) 23:55:19.106463 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32183): Terminating (SIGTERM) 23:55:19.145387 run iperf3-srv_10.42.42.10(pid=32184): Terminating (SIGTERM) 23:55:19.184568 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32187): Terminating (SIGTERM) 23:55:19.223773 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32190): Terminating (SIGTERM) 23:55:19.262635 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32193): Terminating (SIGTERM) 23:55:19.301759 --- ParallelTerminationStrategy: PID 32177 died... 23:55:19.320714 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32177): Terminated: ok {rc=0} 23:55:19.364236 --- ParallelTerminationStrategy: PID 32178 died... 23:55:19.382700 run iperf3-srv_10.42.42.10(pid=32178): Terminated {rc=256} 23:55:19.426177 --- ParallelTerminationStrategy: PID 32179 died... 23:55:19.444722 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32179): Terminated: ok {rc=0} 23:55:19.488120 --- ParallelTerminationStrategy: PID 32180 died... 23:55:19.506537 run iperf3-srv_10.42.42.10(pid=32180): Terminated {rc=256} 23:55:19.549724 --- ParallelTerminationStrategy: PID 32181 died... 23:55:19.568197 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32181): Terminated: ok {rc=0} 23:55:19.611374 --- ParallelTerminationStrategy: PID 32182 died... 23:55:19.629657 run iperf3-srv_10.42.42.10(pid=32182): Terminated {rc=256} 23:55:19.672546 --- ParallelTerminationStrategy: PID 32183 died... 23:55:19.691094 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32183): Terminated: ok {rc=0} 23:55:19.734365 --- ParallelTerminationStrategy: PID 32184 died... 23:55:19.752722 run iperf3-srv_10.42.42.10(pid=32184): Terminated {rc=256} 23:55:19.795596 --- ParallelTerminationStrategy: PID 32187 died... 23:55:19.814190 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32187): Terminated: ok {rc=0} 23:55:19.857443 --- ParallelTerminationStrategy: PID 32190 died... 23:55:19.875906 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32190): Terminated: ok {rc=0} 23:55:19.919181 --- ParallelTerminationStrategy: PID 32193 died... 23:55:19.937700 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32193): Terminated: ok {rc=0} 23:55:20.022630 bus /gobi_4: Setting Powered False 23:55:21.121893 bus /gobi_4: Setting Powered False 23:55:22.236395 bus /gobi_1: Setting Powered False 23:55:23.334062 bus /gobi_1: Setting Powered False 23:55:24.448182 bus /gobi_0: Setting Powered False 23:55:25.547060 bus /gobi_0: Setting Powered False 23:55:26.662320 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 23:55:27.765394 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:27.777149 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 23:55:27.829249 tst ping.py: using LAC 24552 23:55:27.945391 tst ping.py: using RAC 72 23:55:28.059790 tst ping.py: using CellId 24552 23:55:28.174820 tst ping.py: using BVCI 24553 23:55:28.282715 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:28.294009 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:28.305103 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:28.315961 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:28.326954 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:28.337956 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:28.348998 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:28.360044 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 23:55:28.473286 tst ping.py:19: start network... 23:55:28.670992 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:55:29.121458 run create_hlr_db(pid=32195): Launched 23:55:29.239550 bus /gobi_6: Setting Powered False 23:55:30.298090 run create_hlr_db(pid=32195): Terminated: ok {rc=0} 23:55:30.724510 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32197): Launched 23:55:31.065477 run osmo-hlr_10.42.42.2(pid=32198): Launched 23:55:31.331703 run osmo-stp_10.42.42.5: Starting osmo-stp 23:55:31.926713 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32200): Launched 23:55:32.253665 run osmo-stp_10.42.42.5(pid=32201): Launched 23:55:32.374133 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:55:32.913996 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32203): Launched 23:55:33.033187 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:55:33.297646 run patchelf(pid=32204): Launched 23:55:33.471656 run osmo-stp_10.42.42.5(pid=32201): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32201)] 23:55:33.604108 run osmo-stp_10.42.42.5(pid=32201): stdout: | (launched: 2022-12-09_23:55:32.197207) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:55:33.738494 run osmo-stp_10.42.42.5(pid=32201): stderr: | 20221209235532386 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235532386 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235532386 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235532387 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235532387 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235532387 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235532387 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:55:33.872825 run osmo-stp_10.42.42.5(pid=32201): stdout: | (launched: 2022-12-09_23:55:32.197207) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:55:34.001952 run osmo-stp_10.42.42.5(pid=32201): stderr: | 20221209235532386 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235532386 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235532386 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235532387 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235532387 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235532387 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235532387 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:55:34.154795 run patchelf(pid=32204): Terminating (SIGINT) 23:55:34.330763 run patchelf(pid=32204): Terminated: ok {rc=0} 23:55:34.457908 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=32201): Process ended prematurely: osmo-stp_10.42.42.5(pid=32201) [trial-2366↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32201)] [trial-2366↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 23:55:34.467272 tst ping.py:22: Test FAILED (6.7 sec) 23:55:34.495617 run osmo-hlr_10.42.42.2(pid=32198): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32198)] 23:55:34.545343 run osmo-hlr_10.42.42.2(pid=32198): stdout: | (launched: 2022-12-09_23:55:31.003816) 23:55:34.597424 run osmo-hlr_10.42.42.2(pid=32198): stderr: | 20221209235531219 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209235531219 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209235531219 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209235531219 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209235531219 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209235531219 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209235531245 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209235531261 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209235531261 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209235531261 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:55:34.649603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32197): Terminating (SIGTERM) 23:55:34.691335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32200): Terminating (SIGTERM) 23:55:34.733709 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32203): Terminating (SIGTERM) 23:55:34.775844 --- ParallelTerminationStrategy: PID 32197 died... 23:55:34.795667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32197): Terminated: ok {rc=0} 23:55:34.841817 --- ParallelTerminationStrategy: PID 32200 died... 23:55:34.860927 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32200): Terminated: ok {rc=0} 23:55:34.907142 --- ParallelTerminationStrategy: PID 32203 died... 23:55:34.926371 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32203): Terminated: ok {rc=0} 23:55:35.013762 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 23:55:36.101303 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:36.114295 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 23:55:36.170254 tst ping_idle_ping.py: using LAC 24553 23:55:36.295242 tst ping_idle_ping.py: using RAC 73 23:55:36.424738 tst ping_idle_ping.py: using CellId 24553 23:55:36.548211 tst ping_idle_ping.py: using BVCI 24554 23:55:36.662665 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:36.674925 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:36.686648 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:36.698758 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:36.711290 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:36.724018 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:36.736447 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 23:55:36.748759 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 23:55:36.864068 tst ping_idle_ping.py:24: start network... 23:55:37.060899 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:55:37.517538 run create_hlr_db(pid=32205): Launched 23:55:37.638341 bus /gobi_6: Setting Powered False 23:55:38.698201 run create_hlr_db(pid=32205): Terminated: ok {rc=0} 23:55:39.126690 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32207): Launched 23:55:39.423256 run osmo-hlr_10.42.42.2(pid=32208): Launched 23:55:39.534517 run osmo-stp_10.42.42.5: Starting osmo-stp 23:55:40.039676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32210): Launched 23:55:40.331167 run osmo-stp_10.42.42.5(pid=32211): Launched 23:55:40.442039 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:55:40.945698 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32213): Launched 23:55:41.057820 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:55:41.306303 run patchelf(pid=32214): Launched 23:55:41.468348 run osmo-stp_10.42.42.5(pid=32211): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32211)] 23:55:41.591939 run osmo-stp_10.42.42.5(pid=32211): stdout: | (launched: 2022-12-09_23:55:40.277632) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:55:41.717391 run osmo-stp_10.42.42.5(pid=32211): stderr: | 20221209235540448 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235540448 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235540448 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235540448 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235540449 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235540449 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235540449 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:55:41.843072 run osmo-stp_10.42.42.5(pid=32211): stdout: | (launched: 2022-12-09_23:55:40.277632) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:55:41.963285 run osmo-stp_10.42.42.5(pid=32211): stderr: | 20221209235540448 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235540448 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235540448 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235540448 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235540449 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235540449 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235540449 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:55:42.105551 run patchelf(pid=32214): Terminating (SIGINT) 23:55:42.269397 run patchelf(pid=32214): Terminated: ok {rc=0} 23:55:42.387096 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=32211): Process ended prematurely: osmo-stp_10.42.42.5(pid=32211) [trial-2366↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32211)] [trial-2366↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 23:55:42.395864 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 23:55:42.421968 run osmo-hlr_10.42.42.2(pid=32208): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32208)] 23:55:42.468543 run osmo-hlr_10.42.42.2(pid=32208): stdout: | (launched: 2022-12-09_23:55:39.369764) 23:55:42.517089 run osmo-hlr_10.42.42.2(pid=32208): stderr: | 20221209235539545 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209235539545 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209235539545 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209235539545 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209235539545 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209235539545 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209235539558 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209235539566 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209235539566 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209235539566 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:55:42.566288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32207): Terminating (SIGTERM) 23:55:42.605509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32210): Terminating (SIGTERM) 23:55:42.645039 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32213): Terminating (SIGTERM) 23:55:42.684647 --- ParallelTerminationStrategy: PID 32207 died... 23:55:42.703663 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32207): Terminated: ok {rc=0} 23:55:42.747967 --- ParallelTerminationStrategy: PID 32210 died... 23:55:42.766697 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32210): Terminated: ok {rc=0} 23:55:42.810199 --- ParallelTerminationStrategy: PID 32213 died... 23:55:42.828618 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32213): Terminated: ok {rc=0} 23:55:42.913741 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2366 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 23:55:44.220772 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:55:44.227725 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 23:55:44.260274 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 23:55:44.294403 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 23:55:44.347379 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 23:55:44.379459 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 23:55:44.413270 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 23:55:44.978901 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2366 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 23:55:44.983867 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:55:44.994961 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 23:55:45.062890 tst switch_tch_pdch.py: using LAC 24554 23:55:45.177221 tst switch_tch_pdch.py: using RAC 74 23:55:45.291974 tst switch_tch_pdch.py: using CellId 24554 23:55:45.405760 tst switch_tch_pdch.py: using BVCI 24555 23:55:45.511259 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:55:45.522421 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:55:45.533372 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:55:45.544238 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:55:45.555123 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:55:45.565974 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:55:45.576925 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 23:55:45.587886 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:55:45.704035 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:55:45.820037 tst switch_tch_pdch.py:51: start network... 23:55:46.055985 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:55:46.576669 run create_hlr_db(pid=32218): Launched 23:55:46.749313 bus /gobi_6: Setting Powered False 23:55:47.811327 run create_hlr_db(pid=32218): Terminated: ok {rc=0} 23:55:48.285547 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32220): Launched 23:55:48.597650 run osmo-hlr_10.42.42.2(pid=32221): Launched 23:55:48.717726 run osmo-stp_10.42.42.5: Starting osmo-stp 23:55:49.258594 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32223): Launched 23:55:49.568100 run osmo-stp_10.42.42.5(pid=32224): Launched 23:55:49.686384 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:55:50.223018 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32226): Launched 23:55:50.341981 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:55:50.605123 run patchelf(pid=32227): Launched 23:55:50.778265 run osmo-stp_10.42.42.5(pid=32224): ERR: Terminated: ERROR {rc=1} [trial-2366↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32224)] 23:55:50.910587 run osmo-stp_10.42.42.5(pid=32224): stdout: | (launched: 2022-12-09_23:55:49.511612) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:55:51.044497 run osmo-stp_10.42.42.5(pid=32224): stderr: | 20221209235549700 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235549700 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235549701 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235549701 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235549701 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235549702 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235549702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:55:51.179253 run osmo-stp_10.42.42.5(pid=32224): stdout: | (launched: 2022-12-09_23:55:49.511612) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:55:51.307297 run osmo-stp_10.42.42.5(pid=32224): stderr: | 20221209235549700 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235549700 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235549701 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235549701 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235549701 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235549702 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235549702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:55:51.458850 run patchelf(pid=32227): Terminating (SIGINT) 23:55:51.633502 run patchelf(pid=32227): Terminated: ok {rc=0} 23:55:51.759231 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=32224): Process ended prematurely: osmo-stp_10.42.42.5(pid=32224) [trial-2366↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32224)] [trial-2366↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 23:55:51.768666 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 23:55:51.796859 run osmo-hlr_10.42.42.2(pid=32221): ERR: Terminated: ERROR {rc=237} [trial-2366↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32221)] 23:55:51.846788 run osmo-hlr_10.42.42.2(pid=32221): stdout: | (launched: 2022-12-09_23:55:48.540913) 23:55:51.898841 run osmo-hlr_10.42.42.2(pid=32221): stderr: | 20221209235548737 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209235548737 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209235548737 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209235548737 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209235548737 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209235548737 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209235548750 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209235548759 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209235548759 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209235548759 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:55:51.951480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32220): Terminating (SIGTERM) 23:55:51.993358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32223): Terminating (SIGTERM) 23:55:52.035230 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32226): Terminating (SIGTERM) 23:55:52.077303 --- ParallelTerminationStrategy: PID 32220 died... 23:55:52.097099 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32220): Terminated: ok {rc=0} 23:55:52.143969 --- ParallelTerminationStrategy: PID 32223 died... 23:55:52.163561 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32223): Terminated: ok {rc=0} 23:55:52.210028 --- ParallelTerminationStrategy: PID 32226 died... 23:55:52.229521 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32226): Terminated: ok {rc=0} 23:55:52.317942 bus /gobi_0: Setting Powered False 23:55:53.417408 bus /gobi_0: Setting Powered False 23:55:54.532241 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2366 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 dynts:trx-umtrx+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 23:55:55.781678 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:55:55.787868 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 23:55:55.823150 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 23:55:55.858966 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 23:55:55.913567 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 23:55:55.947884 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 23:55:55.984024 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 23:55:56.538783 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2366 dynts:trx-umtrx+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 23:55:56.544130 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:55:56.555434 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 23:55:56.627818 tst switch_tch_pdch.py: using LAC 24555 23:55:56.750323 tst switch_tch_pdch.py: using RAC 75 23:55:56.873176 tst switch_tch_pdch.py: using CellId 24555 23:55:56.988762 tst switch_tch_pdch.py: using BVCI 24556 23:55:57.094084 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:55:57.105207 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:55:57.116025 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:55:57.126890 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:55:57.137707 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:55:57.148567 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:55:57.159348 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 23:55:57.170066 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 23:55:57.286979 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 23:55:57.403142 tst switch_tch_pdch.py:51: start network... 23:55:57.598398 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:55:58.024066 run create_hlr_db(pid=32231): Launched 23:55:58.143362 bus /gobi_6: Setting Powered False 23:55:59.202012 run create_hlr_db(pid=32231): Terminated: ok {rc=0} 23:55:59.602928 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32233): Launched 23:55:59.913937 run osmo-hlr_10.42.42.2(pid=32234): Launched 23:56:00.033191 run osmo-stp_10.42.42.5: Starting osmo-stp 23:56:00.547714 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32236): Launched 23:56:00.897718 run osmo-stp_10.42.42.5(pid=32237): Launched 23:56:01.111084 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:56:01.677303 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32239): Launched 23:56:01.810576 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:56:02.085213 run patchelf(pid=32240): Launched 23:56:02.281393 run osmo-stp_10.42.42.5(pid=32237): ERR: Terminated: ERROR {rc=1} [trial-2366↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32237)] 23:56:02.405657 run osmo-stp_10.42.42.5(pid=32237): stdout: | (launched: 2022-12-09_23:56:00.802344) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:56:02.531315 run osmo-stp_10.42.42.5(pid=32237): stderr: | 20221209235601056 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235601057 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235601057 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235601057 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235601058 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235601058 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235601058 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:56:02.657477 run osmo-stp_10.42.42.5(pid=32237): stdout: | (launched: 2022-12-09_23:56:00.802344) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:56:02.777490 run osmo-stp_10.42.42.5(pid=32237): stderr: | 20221209235601056 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235601057 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235601057 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235601057 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235601058 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235601058 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235601058 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:56:02.920669 run patchelf(pid=32240): Terminating (SIGINT) 23:56:03.084769 run patchelf(pid=32240): Terminated: ok {rc=0} 23:56:03.202690 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=32237): Process ended prematurely: osmo-stp_10.42.42.5(pid=32237) [trial-2366↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32237)] [trial-2366↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 23:56:03.211659 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 23:56:03.238181 run osmo-hlr_10.42.42.2(pid=32234): ERR: Terminated: ERROR {rc=237} [trial-2366↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32234)] 23:56:03.285845 run osmo-hlr_10.42.42.2(pid=32234): stdout: | (launched: 2022-12-09_23:55:59.857630) 23:56:03.335789 run osmo-hlr_10.42.42.2(pid=32234): stderr: | 20221209235600052 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209235600052 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209235600052 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209235600053 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209235600053 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209235600053 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209235600066 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/dynts:trx-umtrx+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209235600074 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209235600074 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209235600074 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:56:03.385857 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32233): Terminating (SIGTERM) 23:56:03.425774 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32236): Terminating (SIGTERM) 23:56:03.465967 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32239): Terminating (SIGTERM) 23:56:03.506207 --- ParallelTerminationStrategy: PID 32233 died... 23:56:03.525282 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32233): Terminated: ok {rc=0} 23:56:03.569782 --- ParallelTerminationStrategy: PID 32236 died... 23:56:03.588532 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32236): Terminated: ok {rc=0} 23:56:03.632650 --- ParallelTerminationStrategy: PID 32239 died... 23:56:03.651438 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32239): Terminated: ok {rc=0} 23:56:03.737861 bus /gobi_0: Setting Powered False 23:56:04.837358 bus /gobi_0: Setting Powered False 23:56:05.951379 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2366 dynts:trx-umtrx+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 nitb_sms:trx-lms --------------------------------------------------------------------- 23:56:07.197408 tst nitb_sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:56:07.201219 tst nitb_sms:trx-lms: Verifying 1 x bts (candidates: 11) 23:56:07.234872 tst nitb_sms:trx-lms: Verifying 1 x ip_address (candidates: 9) 23:56:07.241521 tst nitb_sms:trx-lms: Verifying 2 x modem (candidates: 12) 23:56:07.293407 tst nitb_sms:trx-lms: Reserving 1 x bts (candidates: 11) 23:56:07.326315 tst nitb_sms:trx-lms: Reserving 1 x ip_address (candidates: 9) 23:56:07.332922 tst nitb_sms:trx-lms: Reserving 2 x modem (candidates: 12) 23:56:07.870854 tst nitb_sms:trx-lms: RESERVED RESOURCES for nitb_sms: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 nitb_sms:trx-lms mo_mt_sms.py ---------------------------------------------- 23:56:07.875751 tst nitb_sms:trx-lms: Using 1 x ip_address (candidates: 1) 23:56:07.886417 tst nitb_sms:trx-lms: Using 1 x bts (candidates: 1) 23:56:07.934801 tst mo_mt_sms.py: using LAC 24556 23:56:08.050865 tst mo_mt_sms.py: using RAC 76 23:56:08.165670 tst mo_mt_sms.py: using CellId 24556 23:56:08.279435 tst mo_mt_sms.py: using BVCI 24557 23:56:08.384078 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 23:56:08.499932 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 23:56:08.614322 tst mo_mt_sms.py:9: start nitb and bts... 23:56:08.809566 run osmo-nitb_10.42.42.2: Starting osmo-nitb 23:56:09.401290 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32244): Launched 23:56:09.690939 run osmo-nitb_10.42.42.2(pid=32245): Launched 23:56:09.851802 run osmo-nitb_10.42.42.2(pid=32245): ERR: Terminated: ERROR {rc=2} [trial-2366↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32245)] 23:56:09.982390 run osmo-nitb_10.42.42.2(pid=32245): stdout: | (launched: 2022-12-09_23:56:09.637995) 23:56:10.114250 run osmo-nitb_10.42.42.2(pid=32245): stderr: | (launched: 2022-12-09_23:56:09.680871) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:56:10.246550 run osmo-nitb_10.42.42.2(pid=32245): stdout: | (launched: 2022-12-09_23:56:09.637995) 23:56:10.372910 run osmo-nitb_10.42.42.2(pid=32245): stderr: | (launched: 2022-12-09_23:56:09.680871) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=32245): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32245) [trial-2366↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32245)] 23:56:10.800674 tst osmo-nitb_10.42.42.2(pid=32245): stdout: | (launched: 2022-12-09_23:56:09.637995) 23:56:10.918297 tst osmo-nitb_10.42.42.2(pid=32245): stderr: | (launched: 2022-12-09_23:56:09.680871) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:56:11.057326 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=32245): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32245) [trial-2366↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32245)] [trial-2366↪nitb_sms:trx-lms↪mo_mt_sms.py:11] 23:56:11.065484 tst mo_mt_sms.py:11: Test FAILED (3.2 sec) 23:56:11.071933 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32244): Terminating (SIGTERM) 23:56:11.280111 --- ParallelTerminationStrategy: PID 32244 died... 23:56:11.300343 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32244): Terminated: ok {rc=0} 23:56:11.386468 bus /sierra_3: Setting Powered False 23:56:12.486567 bus /sierra_3: Setting Powered False 23:56:13.601684 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 nitb_sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 sms:trx-lms --------------------------------------------------------------------- 23:56:14.795102 tst sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:56:14.798965 tst sms:trx-lms: Verifying 1 x bts (candidates: 11) 23:56:14.831475 tst sms:trx-lms: Verifying 6 x ip_address (candidates: 9) 23:56:14.857891 tst sms:trx-lms: Verifying 2 x modem (candidates: 12) 23:56:14.909487 tst sms:trx-lms: Reserving 1 x bts (candidates: 11) 23:56:14.942513 tst sms:trx-lms: Reserving 6 x ip_address (candidates: 9) 23:56:14.968742 tst sms:trx-lms: Reserving 2 x modem (candidates: 12) 23:56:15.517233 tst sms:trx-lms: RESERVED RESOURCES for sms: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 sms:trx-lms mo_mt_sms.py ---------------------------------------------- 23:56:15.522759 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 23:56:15.534042 tst sms:trx-lms: Using 1 x bts (candidates: 1) 23:56:15.585269 tst mo_mt_sms.py: using LAC 24557 23:56:15.708119 tst mo_mt_sms.py: using RAC 77 23:56:15.824347 tst mo_mt_sms.py: using CellId 24557 23:56:15.945458 tst mo_mt_sms.py: using BVCI 24558 23:56:16.053344 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 23:56:16.064574 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 23:56:16.075948 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 23:56:16.087297 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 23:56:16.098212 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 23:56:16.109286 tst sms:trx-lms: Using 1 x modem (candidates: 2) 23:56:16.222774 tst sms:trx-lms: Using 1 x modem (candidates: 2) 23:56:16.339930 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:56:16.809967 run create_hlr_db(pid=32251): Launched 23:56:16.962266 bus /sierra_2: Setting Powered False 23:56:18.020774 run create_hlr_db(pid=32251): Terminated: ok {rc=0} 23:56:18.448096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32253): Launched 23:56:18.760044 run osmo-hlr_10.42.42.2(pid=32254): Launched 23:56:18.879308 run osmo-stp_10.42.42.5: Starting osmo-stp 23:56:19.419044 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32256): Launched 23:56:19.728302 run osmo-stp_10.42.42.5(pid=32257): Launched 23:56:19.846992 run osmo-msc_10.42.42.6: Starting osmo-msc 23:56:20.411519 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32259): Launched 23:56:20.722155 run osmo-msc_10.42.42.6(pid=32260): Launched 23:56:20.894766 run osmo-stp_10.42.42.5(pid=32257): ERR: Terminated: ERROR {rc=1} [trial-2366↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32257)] 23:56:21.026654 run osmo-stp_10.42.42.5(pid=32257): stdout: | (launched: 2022-12-09_23:56:19.671927) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:56:21.158383 run osmo-stp_10.42.42.5(pid=32257): stderr: | 20221209235619862 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235619862 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235619862 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235619862 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235619865 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235619865 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235619865 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:56:21.290654 run osmo-stp_10.42.42.5(pid=32257): stdout: | (launched: 2022-12-09_23:56:19.671927) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:56:21.415074 run osmo-stp_10.42.42.5(pid=32257): stderr: | 20221209235619862 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235619862 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235619862 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235619862 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235619865 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235619865 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235619865 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:56:21.563750 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=32257): Process ended prematurely: osmo-stp_10.42.42.5(pid=32257) [trial-2366↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32257)] [trial-2366↪sms:trx-lms↪mo_mt_sms.py:16] 23:56:21.572463 tst mo_mt_sms.py:16: Test FAILED (6.0 sec) 23:56:21.599864 run osmo-hlr_10.42.42.2(pid=32254): ERR: Terminated: ERROR {rc=237} [trial-2366↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32254)] 23:56:21.649274 run osmo-hlr_10.42.42.2(pid=32254): stdout: | (launched: 2022-12-09_23:56:18.702677) 23:56:21.700264 run osmo-hlr_10.42.42.2(pid=32254): stderr: | 20221209235618900 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209235618900 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209235618900 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209235618900 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209235618900 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209235618900 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209235618912 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/sms:trx-lms/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209235618921 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209235618921 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209235618921 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:56:21.771358 run osmo-msc_10.42.42.6(pid=32260): ERR: Terminated: ERROR {rc=2} [trial-2366↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32260)] 23:56:21.821134 run osmo-msc_10.42.42.6(pid=32260): stdout: | (launched: 2022-12-09_23:56:20.665780) 23:56:21.872230 run osmo-msc_10.42.42.6(pid=32260): stderr: | 20221209235620985 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209235620985 DLGLOBAL DEBUG validating counter group 0x7fc9022b5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209235620985 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209235620985 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209235620986 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209235620986 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209235620987 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209235620988 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209235620988 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209235620988 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:56:21.923897 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32253): Terminating (SIGTERM) 23:56:21.965310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32256): Terminating (SIGTERM) 23:56:22.006697 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32259): Terminating (SIGTERM) 23:56:22.048410 --- ParallelTerminationStrategy: PID 32253 died... 23:56:22.068034 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32253): Terminated: ok {rc=0} 23:56:22.114123 --- ParallelTerminationStrategy: PID 32256 died... 23:56:22.133359 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32256): Terminated: ok {rc=0} 23:56:22.179456 --- ParallelTerminationStrategy: PID 32259 died... 23:56:22.198777 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32259): Terminated: ok {rc=0} 23:56:22.285418 bus /sierra_3: Setting Powered False 23:56:23.382989 bus /sierra_3: Setting Powered False 23:56:24.498198 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 nitb_ussd:trx-lms --------------------------------------------------------------------- 23:56:25.726033 tst nitb_ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:56:25.730310 tst nitb_ussd:trx-lms: Verifying 1 x bts (candidates: 11) 23:56:25.762973 tst nitb_ussd:trx-lms: Verifying 1 x ip_address (candidates: 9) 23:56:25.769824 tst nitb_ussd:trx-lms: Verifying 1 x modem (candidates: 12) 23:56:25.803123 tst nitb_ussd:trx-lms: Reserving 1 x bts (candidates: 11) 23:56:25.835314 tst nitb_ussd:trx-lms: Reserving 1 x ip_address (candidates: 9) 23:56:25.841860 tst nitb_ussd:trx-lms: Reserving 1 x modem (candidates: 12) 23:56:26.363490 tst nitb_ussd:trx-lms: RESERVED RESOURCES for nitb_ussd: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2366 nitb_ussd:trx-lms assert_extension.py ---------------------------------------------- 23:56:26.368537 tst nitb_ussd:trx-lms: Using 1 x ip_address (candidates: 1) 23:56:26.379144 tst nitb_ussd:trx-lms: Using 1 x bts (candidates: 1) 23:56:26.425633 tst assert_extension.py: using LAC 24558 23:56:26.543131 tst assert_extension.py: using RAC 78 23:56:26.660350 tst assert_extension.py: using CellId 24558 23:56:26.774371 tst assert_extension.py: using BVCI 24559 23:56:26.881746 tst nitb_ussd:trx-lms: Using 1 x modem (candidates: 1) 23:56:26.996554 tst assert_extension.py:10: start nitb and bts... 23:56:27.209575 run osmo-nitb_10.42.42.2: Starting osmo-nitb 23:56:27.847428 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32265): Launched 23:56:28.158552 run osmo-nitb_10.42.42.2(pid=32266): Launched 23:56:28.321793 run osmo-nitb_10.42.42.2(pid=32266): ERR: Terminated: ERROR {rc=2} [trial-2366↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32266)] 23:56:28.453312 run osmo-nitb_10.42.42.2(pid=32266): stdout: | (launched: 2022-12-09_23:56:28.101743) 23:56:28.585593 run osmo-nitb_10.42.42.2(pid=32266): stderr: | (launched: 2022-12-09_23:56:28.148237) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:56:28.718342 run osmo-nitb_10.42.42.2(pid=32266): stdout: | (launched: 2022-12-09_23:56:28.101743) 23:56:28.845089 run osmo-nitb_10.42.42.2(pid=32266): stderr: | (launched: 2022-12-09_23:56:28.148237) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=32266): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32266) [trial-2366↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32266)] 23:56:29.270849 tst osmo-nitb_10.42.42.2(pid=32266): stdout: | (launched: 2022-12-09_23:56:28.101743) 23:56:29.389149 tst osmo-nitb_10.42.42.2(pid=32266): stderr: | (launched: 2022-12-09_23:56:28.148237) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 23:56:29.527632 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=32266): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32266) [trial-2366↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32266)] [trial-2366↪nitb_ussd:trx-lms↪assert_extension.py:12] 23:56:29.536191 tst assert_extension.py:12: Test FAILED (3.2 sec) 23:56:29.542934 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32265): Terminating (SIGTERM) 23:56:29.751395 --- ParallelTerminationStrategy: PID 32265 died... 23:56:29.771924 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32265): Terminated: ok {rc=0} 23:56:29.857699 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 nitb_ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 ussd:trx-lms --------------------------------------------------------------------- 23:56:31.061697 tst ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:56:31.068103 tst ussd:trx-lms: Verifying 1 x bts (candidates: 11) 23:56:31.108563 tst ussd:trx-lms: Verifying 6 x ip_address (candidates: 9) 23:56:31.142695 tst ussd:trx-lms: Verifying 1 x modem (candidates: 12) 23:56:31.183852 tst ussd:trx-lms: Reserving 1 x bts (candidates: 11) 23:56:31.224491 tst ussd:trx-lms: Reserving 6 x ip_address (candidates: 9) 23:56:31.255470 tst ussd:trx-lms: Reserving 1 x modem (candidates: 12) 23:56:31.794882 tst ussd:trx-lms: RESERVED RESOURCES for ussd: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2366 ussd:trx-lms assert_extension.py ---------------------------------------------- 23:56:31.803021 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 23:56:31.818240 tst ussd:trx-lms: Using 1 x bts (candidates: 1) 23:56:31.880317 tst assert_extension.py: using LAC 24559 23:56:32.023773 tst assert_extension.py: using RAC 79 23:56:32.184364 tst assert_extension.py: using CellId 24559 23:56:32.312402 tst assert_extension.py: using BVCI 24560 23:56:32.428091 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 23:56:32.439108 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 23:56:32.450026 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 23:56:32.461586 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 23:56:32.472940 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 23:56:32.484395 tst ussd:trx-lms: Using 1 x modem (candidates: 1) 23:56:32.599197 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:56:33.051467 run create_hlr_db(pid=32270): Launched 23:56:33.170348 bus /sierra_2: Setting Powered False 23:56:34.228871 run create_hlr_db(pid=32270): Terminated: ok {rc=0} 23:56:34.655260 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32272): Launched 23:56:34.967123 run osmo-hlr_10.42.42.2(pid=32273): Launched 23:56:35.086567 run osmo-stp_10.42.42.5: Starting osmo-stp 23:56:35.625099 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32275): Launched 23:56:35.935764 run osmo-stp_10.42.42.5(pid=32276): Launched 23:56:36.055016 run osmo-msc_10.42.42.6: Starting osmo-msc 23:56:36.620372 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32278): Launched 23:56:36.931508 run osmo-msc_10.42.42.6(pid=32279): Launched 23:56:37.105623 run osmo-stp_10.42.42.5(pid=32276): ERR: Terminated: ERROR {rc=1} [trial-2366↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32276)] 23:56:37.238017 run osmo-stp_10.42.42.5(pid=32276): stdout: | (launched: 2022-12-09_23:56:35.879352) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:56:37.371141 run osmo-stp_10.42.42.5(pid=32276): stderr: | 20221209235636072 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235636072 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235636072 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235636073 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235636075 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235636075 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235636075 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:56:37.502731 run osmo-stp_10.42.42.5(pid=32276): stdout: | (launched: 2022-12-09_23:56:35.879352) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:56:37.627383 run osmo-stp_10.42.42.5(pid=32276): stderr: | 20221209235636072 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235636072 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235636072 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235636073 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235636075 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235636075 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235636075 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:56:37.775815 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=32276): Process ended prematurely: osmo-stp_10.42.42.5(pid=32276) [trial-2366↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32276)] [trial-2366↪ussd:trx-lms↪assert_extension.py:17] 23:56:37.784600 tst assert_extension.py:17: Test FAILED (6.0 sec) 23:56:37.811955 run osmo-hlr_10.42.42.2(pid=32273): ERR: Terminated: ERROR {rc=237} [trial-2366↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32273)] 23:56:37.862254 run osmo-hlr_10.42.42.2(pid=32273): stdout: | (launched: 2022-12-09_23:56:34.910612) 23:56:37.914163 run osmo-hlr_10.42.42.2(pid=32273): stderr: | 20221209235635103 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209235635103 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209235635103 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209235635103 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209235635103 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209235635104 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209235635116 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/ussd:trx-lms/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209235635124 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209235635125 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209235635125 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:56:37.986190 run osmo-msc_10.42.42.6(pid=32279): ERR: Terminated: ERROR {rc=2} [trial-2366↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32279)] 23:56:38.036213 run osmo-msc_10.42.42.6(pid=32279): stdout: | (launched: 2022-12-09_23:56:36.875041) 23:56:38.087871 run osmo-msc_10.42.42.6(pid=32279): stderr: | 20221209235637193 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209235637193 DLGLOBAL DEBUG validating counter group 0x7f74ef59dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209235637194 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209235637194 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209235637194 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209235637194 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209235637196 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209235637196 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209235637196 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209235637196 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:56:38.139975 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32272): Terminating (SIGTERM) 23:56:38.181811 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32275): Terminating (SIGTERM) 23:56:38.223357 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32278): Terminating (SIGTERM) 23:56:38.265205 --- ParallelTerminationStrategy: PID 32272 died... 23:56:38.284867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32272): Terminated: ok {rc=0} 23:56:38.331346 --- ParallelTerminationStrategy: PID 32275 died... 23:56:38.350745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32275): Terminated: ok {rc=0} 23:56:38.397371 --- ParallelTerminationStrategy: PID 32278 died... 23:56:38.416628 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32278): Terminated: ok {rc=0} 23:56:38.503786 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 23:56:39.716229 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:56:39.723285 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 23:56:39.757463 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 23:56:39.785372 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 23:56:39.838002 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 23:56:39.872076 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 23:56:39.899859 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 23:56:40.448415 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 23:56:40.497319 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:56:40.508555 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 23:56:40.581118 tst mo_mt_call.py: using LAC 24560 23:56:40.698314 tst mo_mt_call.py: using RAC 80 23:56:40.815548 tst mo_mt_call.py: using CellId 24560 23:56:40.929699 tst mo_mt_call.py: using BVCI 24561 23:56:41.037917 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:56:41.048884 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:56:41.059711 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:56:41.070595 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:56:41.081392 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:56:41.092139 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:56:41.209076 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:56:41.328695 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:56:41.820323 run create_hlr_db(pid=32284): Launched 23:56:41.941662 bus /sierra_2: Setting Powered False 23:56:43.005191 run create_hlr_db(pid=32284): Terminated: ok {rc=0} 23:56:43.449211 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32286): Launched 23:56:43.764514 run osmo-hlr_10.42.42.2(pid=32287): Launched 23:56:43.885960 run osmo-stp_10.42.42.5: Starting osmo-stp 23:56:44.435125 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32289): Launched 23:56:44.751094 run osmo-stp_10.42.42.5(pid=32290): Launched 23:56:44.871391 run osmo-msc_10.42.42.6: Starting osmo-msc 23:56:45.443974 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32292): Launched 23:56:45.760405 run osmo-msc_10.42.42.6(pid=32293): Launched 23:56:45.970314 run osmo-stp_10.42.42.5(pid=32290): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32290)] 23:56:46.263260 run osmo-stp_10.42.42.5(pid=32290): stdout: | (launched: 2022-12-09_23:56:44.693712) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:56:46.427439 run osmo-stp_10.42.42.5(pid=32290): stderr: | 20221209235644884 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235644884 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235644884 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235644884 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235644887 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235644887 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235644887 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:56:46.605212 run osmo-stp_10.42.42.5(pid=32290): stdout: | (launched: 2022-12-09_23:56:44.693712) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:56:46.728156 run osmo-stp_10.42.42.5(pid=32290): stderr: | 20221209235644884 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235644884 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235644884 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235644884 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235644887 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235644887 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235644887 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:56:46.873382 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32290): Process ended prematurely: osmo-stp_10.42.42.5(pid=32290) [trial-2366↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32290)] [trial-2366↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 23:56:46.882911 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 23:56:46.910622 run osmo-hlr_10.42.42.2(pid=32287): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32287)] 23:56:46.959492 run osmo-hlr_10.42.42.2(pid=32287): stdout: | (launched: 2022-12-09_23:56:43.707776) 23:56:47.010108 run osmo-hlr_10.42.42.2(pid=32287): stderr: | 20221209235643903 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209235643903 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209235643903 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209235643903 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209235643903 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209235643903 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209235643917 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209235643927 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209235643927 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209235643927 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:56:47.080014 run osmo-msc_10.42.42.6(pid=32293): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32293)] 23:56:47.129319 run osmo-msc_10.42.42.6(pid=32293): stdout: | (launched: 2022-12-09_23:56:45.702863) 23:56:47.179953 run osmo-msc_10.42.42.6(pid=32293): stderr: | 20221209235646229 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209235646229 DLGLOBAL DEBUG validating counter group 0x7ff69bb41c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209235646229 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209235646229 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209235646229 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209235646229 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209235646231 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209235646231 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209235646231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209235646232 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:56:47.231836 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32286): Terminating (SIGTERM) 23:56:47.272879 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32289): Terminating (SIGTERM) 23:56:47.315697 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32292): Terminating (SIGTERM) 23:56:47.358895 --- ParallelTerminationStrategy: PID 32286 died... 23:56:47.378330 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32286): Terminated: ok {rc=0} 23:56:47.421956 --- ParallelTerminationStrategy: PID 32289 died... 23:56:47.440521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32289): Terminated: ok {rc=0} 23:56:47.483966 --- ParallelTerminationStrategy: PID 32292 died... 23:56:47.502710 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32292): Terminated: ok {rc=0} 23:56:47.586971 bus /sierra_3: Setting Powered False 23:56:48.686801 bus /sierra_3: Setting Powered False 23:56:49.801275 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 23:56:50.947450 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:56:50.959007 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 23:56:51.027787 tst mo_mt_call_osmux.py: using LAC 24561 23:56:51.146225 tst mo_mt_call_osmux.py: using RAC 81 23:56:51.263514 tst mo_mt_call_osmux.py: using CellId 24561 23:56:51.385827 tst mo_mt_call_osmux.py: using BVCI 24562 23:56:51.493821 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:56:51.504853 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:56:51.515735 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:56:51.526752 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:56:51.537667 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 23:56:51.548354 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:56:51.661865 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 23:56:51.779933 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:56:52.239994 run create_hlr_db(pid=32295): Launched 23:56:52.361123 bus /sierra_2: Setting Powered False 23:56:53.420168 run create_hlr_db(pid=32295): Terminated: ok {rc=0} 23:56:53.854357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32297): Launched 23:56:54.171379 run osmo-hlr_10.42.42.2(pid=32298): Launched 23:56:54.292710 run osmo-stp_10.42.42.5: Starting osmo-stp 23:56:54.843171 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32300): Launched 23:56:55.160678 run osmo-stp_10.42.42.5(pid=32301): Launched 23:56:55.282866 run osmo-msc_10.42.42.6: Starting osmo-msc 23:56:55.857486 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32303): Launched 23:56:56.174479 run osmo-msc_10.42.42.6(pid=32304): Launched 23:56:56.351409 run osmo-stp_10.42.42.5(pid=32301): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32301)] 23:56:56.485133 run osmo-stp_10.42.42.5(pid=32301): stdout: | (launched: 2022-12-09_23:56:55.103488) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:56:56.619404 run osmo-stp_10.42.42.5(pid=32301): stderr: | 20221209235655295 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235655295 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235655296 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235655296 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235655297 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235655297 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235655297 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:56:56.753186 run osmo-stp_10.42.42.5(pid=32301): stdout: | (launched: 2022-12-09_23:56:55.103488) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:56:56.879359 run osmo-stp_10.42.42.5(pid=32301): stderr: | 20221209235655295 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235655295 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235655296 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235655296 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235655297 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235655297 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235655297 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:56:57.030612 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32301): Process ended prematurely: osmo-stp_10.42.42.5(pid=32301) [trial-2366↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32301)] [trial-2366↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 23:56:57.040329 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 23:56:57.068607 run osmo-hlr_10.42.42.2(pid=32298): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32298)] 23:56:57.119314 run osmo-hlr_10.42.42.2(pid=32298): stdout: | (launched: 2022-12-09_23:56:54.114288) 23:56:57.171216 run osmo-hlr_10.42.42.2(pid=32298): stderr: | 20221209235654311 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209235654311 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209235654311 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209235654311 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209235654311 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209235654311 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209235654323 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209235654331 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209235654331 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209235654331 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:56:57.243965 run osmo-msc_10.42.42.6(pid=32304): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32304)] 23:56:57.293844 run osmo-msc_10.42.42.6(pid=32304): stdout: | (launched: 2022-12-09_23:56:56.117160) 23:56:57.346033 run osmo-msc_10.42.42.6(pid=32304): stderr: | 20221209235656438 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209235656438 DLGLOBAL DEBUG validating counter group 0x7fa306c6fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209235656439 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209235656439 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209235656439 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209235656439 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209235656441 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209235656441 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209235656441 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209235656441 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:56:57.398220 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32297): Terminating (SIGTERM) 23:56:57.440019 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32300): Terminating (SIGTERM) 23:56:57.482251 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32303): Terminating (SIGTERM) 23:56:57.524392 --- ParallelTerminationStrategy: PID 32297 died... 23:56:57.544273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32297): Terminated: ok {rc=0} 23:56:57.591241 --- ParallelTerminationStrategy: PID 32300 died... 23:56:57.610721 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32300): Terminated: ok {rc=0} 23:56:57.657249 --- ParallelTerminationStrategy: PID 32303 died... 23:56:57.676812 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32303): Terminated: ok {rc=0} 23:56:57.764251 bus /sierra_3: Setting Powered False 23:56:58.861366 bus /sierra_3: Setting Powered False 23:56:59.976035 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 23:57:01.230159 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:57:01.241354 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 23:57:01.287843 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 23:57:01.326545 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 23:57:01.384496 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 23:57:01.427795 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 23:57:01.466148 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 23:57:01.994644 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 23:57:02.059975 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:57:02.071931 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 23:57:02.141497 tst mo_mt_call.py: using LAC 24562 23:57:02.262397 tst mo_mt_call.py: using RAC 82 23:57:02.378613 tst mo_mt_call.py: using CellId 24562 23:57:02.495293 tst mo_mt_call.py: using BVCI 24563 23:57:02.604211 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:57:02.615411 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:57:02.626459 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:57:02.637529 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:57:02.648502 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:57:02.659444 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:57:02.777919 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:57:02.895221 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:57:03.387776 run create_hlr_db(pid=32309): Launched 23:57:03.509577 bus /sierra_2: Setting Powered False 23:57:04.572627 run create_hlr_db(pid=32309): Terminated: ok {rc=0} 23:57:04.997618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32311): Launched 23:57:05.296092 run osmo-hlr_10.42.42.2(pid=32312): Launched 23:57:05.411401 run osmo-stp_10.42.42.5: Starting osmo-stp 23:57:05.941570 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32314): Launched 23:57:06.237461 run osmo-stp_10.42.42.5(pid=32315): Launched 23:57:06.350113 run osmo-msc_10.42.42.6: Starting osmo-msc 23:57:06.886637 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32317): Launched 23:57:07.181420 run osmo-msc_10.42.42.6(pid=32318): Launched 23:57:07.347417 run osmo-stp_10.42.42.5(pid=32315): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32315)] 23:57:07.474033 run osmo-stp_10.42.42.5(pid=32315): stdout: | (launched: 2022-12-09_23:57:06.183434) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:57:07.600738 run osmo-stp_10.42.42.5(pid=32315): stderr: | 20221209235706352 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235706352 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235706352 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235706353 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235706353 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235706353 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235706353 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:57:07.724173 run osmo-stp_10.42.42.5(pid=32315): stdout: | (launched: 2022-12-09_23:57:06.183434) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:57:07.841945 run osmo-stp_10.42.42.5(pid=32315): stderr: | 20221209235706352 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235706352 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235706352 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235706353 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235706353 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235706353 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235706353 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:57:07.983289 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32315): Process ended prematurely: osmo-stp_10.42.42.5(pid=32315) [trial-2366↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32315)] [trial-2366↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 23:57:07.992373 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 23:57:08.018508 run osmo-hlr_10.42.42.2(pid=32312): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32312)] 23:57:08.065459 run osmo-hlr_10.42.42.2(pid=32312): stdout: | (launched: 2022-12-09_23:57:05.241848) 23:57:08.114502 run osmo-hlr_10.42.42.2(pid=32312): stderr: | 20221209235705416 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209235705416 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209235705416 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209235705416 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209235705416 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209235705416 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209235705428 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209235705437 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209235705437 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209235705437 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:57:08.182403 run osmo-msc_10.42.42.6(pid=32318): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32318)] 23:57:08.229340 run osmo-msc_10.42.42.6(pid=32318): stdout: | (launched: 2022-12-09_23:57:07.127274) 23:57:08.277865 run osmo-msc_10.42.42.6(pid=32318): stderr: | 20221209235707401 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209235707402 DLGLOBAL DEBUG validating counter group 0x7f1ef14c3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209235707402 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209235707402 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209235707402 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209235707402 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209235707404 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209235707404 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209235707404 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209235707404 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:57:08.326862 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32311): Terminating (SIGTERM) 23:57:08.365712 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32314): Terminating (SIGTERM) 23:57:08.404455 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32317): Terminating (SIGTERM) 23:57:08.443314 --- ParallelTerminationStrategy: PID 32311 died... 23:57:08.462053 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32311): Terminated: ok {rc=0} 23:57:08.505485 --- ParallelTerminationStrategy: PID 32314 died... 23:57:08.524018 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32314): Terminated: ok {rc=0} 23:57:08.567392 --- ParallelTerminationStrategy: PID 32317 died... 23:57:08.585924 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32317): Terminated: ok {rc=0} 23:57:08.668129 bus /sierra_3: Setting Powered False 23:57:09.761795 bus /sierra_3: Setting Powered False 23:57:10.875652 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 23:57:12.021478 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:57:12.033189 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 23:57:12.102390 tst mo_mt_call_osmux.py: using LAC 24563 23:57:12.233077 tst mo_mt_call_osmux.py: using RAC 83 23:57:12.357120 tst mo_mt_call_osmux.py: using CellId 24563 23:57:12.480137 tst mo_mt_call_osmux.py: using BVCI 24564 23:57:12.595199 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:57:12.606847 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:57:12.618310 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:57:12.629883 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:57:12.641695 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 23:57:12.653587 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:57:12.768513 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 23:57:12.883689 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:57:13.343574 run create_hlr_db(pid=32320): Launched 23:57:13.465314 bus /sierra_2: Setting Powered False 23:57:14.528118 run create_hlr_db(pid=32320): Terminated: ok {rc=0} 23:57:14.952934 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32322): Launched 23:57:15.248488 run osmo-hlr_10.42.42.2(pid=32323): Launched 23:57:15.361427 run osmo-stp_10.42.42.5: Starting osmo-stp 23:57:15.890513 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32325): Launched 23:57:16.242918 run osmo-stp_10.42.42.5(pid=32326): Launched 23:57:16.491607 run osmo-msc_10.42.42.6: Starting osmo-msc 23:57:17.164464 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32328): Launched 23:57:17.490286 run osmo-msc_10.42.42.6(pid=32329): Launched 23:57:17.666857 run osmo-stp_10.42.42.5(pid=32326): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32326)] 23:57:17.800468 run osmo-stp_10.42.42.5(pid=32326): stdout: | (launched: 2022-12-09_23:57:16.174045) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:57:17.934489 run osmo-stp_10.42.42.5(pid=32326): stderr: | 20221209235716476 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235716476 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235716476 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235716477 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235716477 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235716477 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235716477 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:57:18.067702 run osmo-stp_10.42.42.5(pid=32326): stdout: | (launched: 2022-12-09_23:57:16.174045) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:57:18.194353 run osmo-stp_10.42.42.5(pid=32326): stderr: | 20221209235716476 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235716476 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235716476 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235716477 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235716477 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235716477 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235716477 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:57:18.346570 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32326): Process ended prematurely: osmo-stp_10.42.42.5(pid=32326) [trial-2366↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32326)] [trial-2366↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 23:57:18.356133 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 23:57:18.384189 run osmo-hlr_10.42.42.2(pid=32323): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32323)] 23:57:18.434465 run osmo-hlr_10.42.42.2(pid=32323): stdout: | (launched: 2022-12-09_23:57:15.194598) 23:57:18.486314 run osmo-hlr_10.42.42.2(pid=32323): stderr: | 20221209235715369 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209235715369 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209235715369 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209235715369 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209235715369 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209235715369 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209235715381 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209235715390 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209235715391 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209235715391 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:57:18.558483 run osmo-msc_10.42.42.6(pid=32329): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32329)] 23:57:18.608605 run osmo-msc_10.42.42.6(pid=32329): stdout: | (launched: 2022-12-09_23:57:17.431090) 23:57:18.660205 run osmo-msc_10.42.42.6(pid=32329): stderr: | 20221209235717753 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209235717753 DLGLOBAL DEBUG validating counter group 0x7f93b4be1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209235717753 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209235717753 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209235717753 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209235717754 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209235717755 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209235717756 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209235717756 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209235717756 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:57:18.712379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32322): Terminating (SIGTERM) 23:57:18.754147 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32325): Terminating (SIGTERM) 23:57:18.795885 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32328): Terminating (SIGTERM) 23:57:18.837857 --- ParallelTerminationStrategy: PID 32322 died... 23:57:18.857701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32322): Terminated: ok {rc=0} 23:57:18.904105 --- ParallelTerminationStrategy: PID 32325 died... 23:57:18.923625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32325): Terminated: ok {rc=0} 23:57:18.969700 --- ParallelTerminationStrategy: PID 32328 died... 23:57:18.989141 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32328): Terminated: ok {rc=0} 23:57:19.076843 bus /sierra_3: Setting Powered False 23:57:20.175560 bus /sierra_3: Setting Powered False 23:57:21.292298 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 23:57:22.542347 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:57:22.549420 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 23:57:22.585160 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 23:57:22.613068 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 23:57:22.667877 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 23:57:22.702114 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 23:57:22.728681 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 23:57:23.280312 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 23:57:23.329960 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:57:23.341148 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 23:57:23.410681 tst mo_mt_call.py: using LAC 24564 23:57:23.535463 tst mo_mt_call.py: using RAC 84 23:57:23.658654 tst mo_mt_call.py: using CellId 24564 23:57:23.784914 tst mo_mt_call.py: using BVCI 24565 23:57:23.893788 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:57:23.905043 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:57:23.916007 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:57:23.927090 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:57:23.938303 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:57:23.949399 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:57:24.070164 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:57:24.189958 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:57:24.650950 run create_hlr_db(pid=32335): Launched 23:57:24.772656 bus /sierra_2: Setting Powered False 23:57:25.832703 run create_hlr_db(pid=32335): Terminated: ok {rc=0} 23:57:26.268704 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32337): Launched 23:57:26.586052 run osmo-hlr_10.42.42.2(pid=32338): Launched 23:57:26.707564 run osmo-stp_10.42.42.5: Starting osmo-stp 23:57:27.253899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32340): Launched 23:57:27.570290 run osmo-stp_10.42.42.5(pid=32341): Launched 23:57:27.690919 run osmo-msc_10.42.42.6: Starting osmo-msc 23:57:28.263020 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32343): Launched 23:57:28.579097 run osmo-msc_10.42.42.6(pid=32344): Launched 23:57:28.756134 run osmo-stp_10.42.42.5(pid=32341): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32341)] 23:57:28.889542 run osmo-stp_10.42.42.5(pid=32341): stdout: | (launched: 2022-12-09_23:57:27.512916) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:57:29.023518 run osmo-stp_10.42.42.5(pid=32341): stderr: | 20221209235727702 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235727702 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235727702 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235727703 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235727705 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235727705 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235727705 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:57:29.156837 run osmo-stp_10.42.42.5(pid=32341): stdout: | (launched: 2022-12-09_23:57:27.512916) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:57:29.284067 run osmo-stp_10.42.42.5(pid=32341): stderr: | 20221209235727702 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235727702 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235727702 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235727703 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235727705 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235727705 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235727705 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:57:29.435548 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32341): Process ended prematurely: osmo-stp_10.42.42.5(pid=32341) [trial-2366↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32341)] [trial-2366↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 23:57:29.444902 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 23:57:29.472655 run osmo-hlr_10.42.42.2(pid=32338): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32338)] 23:57:29.522922 run osmo-hlr_10.42.42.2(pid=32338): stdout: | (launched: 2022-12-09_23:57:26.528473) 23:57:29.575135 run osmo-hlr_10.42.42.2(pid=32338): stderr: | 20221209235726725 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209235726725 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209235726725 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209235726725 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209235726725 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209235726725 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209235726738 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209235726746 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209235726746 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209235726746 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:57:29.647366 run osmo-msc_10.42.42.6(pid=32344): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32344)] 23:57:29.697460 run osmo-msc_10.42.42.6(pid=32344): stdout: | (launched: 2022-12-09_23:57:28.521836) 23:57:29.749154 run osmo-msc_10.42.42.6(pid=32344): stderr: | 20221209235728843 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209235728843 DLGLOBAL DEBUG validating counter group 0x7f09ca3bdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209235728843 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209235728843 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209235728843 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209235728843 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209235728845 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209235728845 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209235728846 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209235728846 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:57:29.801258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32337): Terminating (SIGTERM) 23:57:29.843002 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32340): Terminating (SIGTERM) 23:57:29.884789 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32343): Terminating (SIGTERM) 23:57:29.927426 --- ParallelTerminationStrategy: PID 32337 died... 23:57:29.947344 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32337): Terminated: ok {rc=0} 23:57:29.994239 --- ParallelTerminationStrategy: PID 32340 died... 23:57:30.013767 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32340): Terminated: ok {rc=0} 23:57:30.060270 --- ParallelTerminationStrategy: PID 32343 died... 23:57:30.079816 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32343): Terminated: ok {rc=0} 23:57:30.166994 bus /sierra_3: Setting Powered False 23:57:31.266084 bus /sierra_3: Setting Powered False 23:57:32.383185 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 23:57:33.531142 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:57:33.543417 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 23:57:33.620611 tst mo_mt_call_osmux.py: using LAC 24565 23:57:33.745051 tst mo_mt_call_osmux.py: using RAC 85 23:57:33.867007 tst mo_mt_call_osmux.py: using CellId 24565 23:57:33.989439 tst mo_mt_call_osmux.py: using BVCI 24566 23:57:34.098075 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:57:34.109119 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:57:34.120170 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:57:34.133178 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:57:34.145452 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 23:57:34.157861 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:57:34.275196 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 23:57:34.391154 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:57:34.851896 run create_hlr_db(pid=32346): Launched 23:57:34.973877 bus /sierra_2: Setting Powered False 23:57:36.036375 run create_hlr_db(pid=32346): Terminated: ok {rc=0} 23:57:36.477709 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32348): Launched 23:57:36.794488 run osmo-hlr_10.42.42.2(pid=32349): Launched 23:57:36.914900 run osmo-stp_10.42.42.5: Starting osmo-stp 23:57:37.462080 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32351): Launched 23:57:37.778493 run osmo-stp_10.42.42.5(pid=32352): Launched 23:57:37.898810 run osmo-msc_10.42.42.6: Starting osmo-msc 23:57:38.473293 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32354): Launched 23:57:38.789981 run osmo-msc_10.42.42.6(pid=32355): Launched 23:57:38.966174 run osmo-stp_10.42.42.5(pid=32352): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32352)] 23:57:39.100313 run osmo-stp_10.42.42.5(pid=32352): stdout: | (launched: 2022-12-09_23:57:37.721075) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:57:39.234846 run osmo-stp_10.42.42.5(pid=32352): stderr: | 20221209235737912 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235737912 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235737912 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235737912 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235737913 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235737913 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235737913 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:57:39.368774 run osmo-stp_10.42.42.5(pid=32352): stdout: | (launched: 2022-12-09_23:57:37.721075) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:57:39.495044 run osmo-stp_10.42.42.5(pid=32352): stderr: | 20221209235737912 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235737912 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235737912 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235737912 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235737913 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235737913 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235737913 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:57:39.646738 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32352): Process ended prematurely: osmo-stp_10.42.42.5(pid=32352) [trial-2366↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32352)] [trial-2366↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 23:57:39.656283 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 23:57:39.684692 run osmo-hlr_10.42.42.2(pid=32349): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32349)] 23:57:39.734791 run osmo-hlr_10.42.42.2(pid=32349): stdout: | (launched: 2022-12-09_23:57:36.737264) 23:57:39.786543 run osmo-hlr_10.42.42.2(pid=32349): stderr: | 20221209235736932 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209235736932 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209235736932 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209235736932 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209235736932 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209235736932 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209235736948 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209235736957 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209235736958 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209235736958 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:57:39.858659 run osmo-msc_10.42.42.6(pid=32355): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32355)] 23:57:39.908502 run osmo-msc_10.42.42.6(pid=32355): stdout: | (launched: 2022-12-09_23:57:38.732245) 23:57:39.959937 run osmo-msc_10.42.42.6(pid=32355): stderr: | 20221209235739053 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209235739053 DLGLOBAL DEBUG validating counter group 0x7f669acecc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209235739053 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209235739053 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209235739053 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209235739053 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209235739055 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209235739055 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209235739056 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209235739056 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:57:40.011899 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32348): Terminating (SIGTERM) 23:57:40.053514 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32351): Terminating (SIGTERM) 23:57:40.095328 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32354): Terminating (SIGTERM) 23:57:40.137283 --- ParallelTerminationStrategy: PID 32348 died... 23:57:40.157172 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32348): Terminated: ok {rc=0} 23:57:40.203718 --- ParallelTerminationStrategy: PID 32351 died... 23:57:40.223402 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32351): Terminated: ok {rc=0} 23:57:40.269562 --- ParallelTerminationStrategy: PID 32354 died... 23:57:40.288914 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32354): Terminated: ok {rc=0} 23:57:40.376366 bus /sierra_3: Setting Powered False 23:57:41.474869 bus /sierra_3: Setting Powered False 23:57:42.588918 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 23:57:43.835144 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:57:43.841723 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 23:57:43.873905 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 23:57:43.900027 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 23:57:43.950381 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 23:57:43.982952 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 23:57:44.009494 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 23:57:44.561103 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 23:57:44.608929 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:57:44.620047 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 23:57:44.688732 tst mo_mt_call.py: using LAC 24566 23:57:44.809399 tst mo_mt_call.py: using RAC 86 23:57:44.924102 tst mo_mt_call.py: using CellId 24566 23:57:45.039115 tst mo_mt_call.py: using BVCI 24567 23:57:45.145954 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:57:45.156998 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:57:45.167875 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:57:45.178690 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:57:45.189651 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:57:45.200496 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:57:45.318122 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:57:45.435085 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:57:45.916843 run create_hlr_db(pid=32360): Launched 23:57:46.070318 bus /sierra_2: Setting Powered False 23:57:47.146443 run create_hlr_db(pid=32360): Terminated: ok {rc=0} 23:57:47.582914 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32362): Launched 23:57:47.879790 run osmo-hlr_10.42.42.2(pid=32363): Launched 23:57:47.991504 run osmo-stp_10.42.42.5: Starting osmo-stp 23:57:48.516632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32365): Launched 23:57:48.811901 run osmo-stp_10.42.42.5(pid=32366): Launched 23:57:48.924476 run osmo-msc_10.42.42.6: Starting osmo-msc 23:57:49.459754 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32368): Launched 23:57:49.755768 run osmo-msc_10.42.42.6(pid=32369): Launched 23:57:49.921752 run osmo-stp_10.42.42.5(pid=32366): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32366)] 23:57:50.047097 run osmo-stp_10.42.42.5(pid=32366): stdout: | (launched: 2022-12-09_23:57:48.758006) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:57:50.172799 run osmo-stp_10.42.42.5(pid=32366): stderr: | 20221209235748926 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235748926 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235748927 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235748927 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235748927 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235748928 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235748928 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:57:50.296417 run osmo-stp_10.42.42.5(pid=32366): stdout: | (launched: 2022-12-09_23:57:48.758006) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:57:50.414138 run osmo-stp_10.42.42.5(pid=32366): stderr: | 20221209235748926 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235748926 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235748927 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235748927 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235748927 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235748928 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235748928 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:57:50.554748 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32366): Process ended prematurely: osmo-stp_10.42.42.5(pid=32366) [trial-2366↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32366)] [trial-2366↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 23:57:50.563502 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 23:57:50.589744 run osmo-hlr_10.42.42.2(pid=32363): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32363)] 23:57:50.636808 run osmo-hlr_10.42.42.2(pid=32363): stdout: | (launched: 2022-12-09_23:57:47.825709) 23:57:50.686062 run osmo-hlr_10.42.42.2(pid=32363): stderr: | 20221209235748002 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209235748002 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209235748002 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209235748002 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209235748002 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209235748002 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209235748015 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209235748023 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209235748024 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209235748024 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:57:50.754145 run osmo-msc_10.42.42.6(pid=32369): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32369)] 23:57:50.801162 run osmo-msc_10.42.42.6(pid=32369): stdout: | (launched: 2022-12-09_23:57:49.701270) 23:57:50.849800 run osmo-msc_10.42.42.6(pid=32369): stderr: | 20221209235749975 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209235749975 DLGLOBAL DEBUG validating counter group 0x7f1b81a6cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209235749975 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209235749975 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209235749975 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209235749975 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209235749977 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209235749977 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209235749978 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209235749978 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:57:50.898838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32362): Terminating (SIGTERM) 23:57:50.937983 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32365): Terminating (SIGTERM) 23:57:50.976898 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32368): Terminating (SIGTERM) 23:57:51.016289 --- ParallelTerminationStrategy: PID 32362 died... 23:57:51.034868 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32362): Terminated: ok {rc=0} 23:57:51.078226 --- ParallelTerminationStrategy: PID 32365 died... 23:57:51.096352 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32365): Terminated: ok {rc=0} 23:57:51.139734 --- ParallelTerminationStrategy: PID 32368 died... 23:57:51.158110 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32368): Terminated: ok {rc=0} 23:57:51.240112 bus /sierra_3: Setting Powered False 23:57:52.334551 bus /sierra_3: Setting Powered False 23:57:53.447411 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 23:57:54.591020 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:57:54.602660 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 23:57:54.670779 tst mo_mt_call_osmux.py: using LAC 24567 23:57:54.796798 tst mo_mt_call_osmux.py: using RAC 87 23:57:54.922751 tst mo_mt_call_osmux.py: using CellId 24567 23:57:55.048695 tst mo_mt_call_osmux.py: using BVCI 24568 23:57:55.164120 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:57:55.175861 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:57:55.187332 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:57:55.199094 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:57:55.211240 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 23:57:55.223390 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:57:55.339153 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 23:57:55.454837 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:57:55.914020 run create_hlr_db(pid=32371): Launched 23:57:56.035731 bus /sierra_2: Setting Powered False 23:57:57.094896 run create_hlr_db(pid=32371): Terminated: ok {rc=0} 23:57:57.529154 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32373): Launched 23:57:57.846501 run osmo-hlr_10.42.42.2(pid=32374): Launched 23:57:57.968534 run osmo-stp_10.42.42.5: Starting osmo-stp 23:57:58.518099 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32376): Launched 23:57:58.834070 run osmo-stp_10.42.42.5(pid=32377): Launched 23:57:58.954814 run osmo-msc_10.42.42.6: Starting osmo-msc 23:57:59.529135 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32379): Launched 23:57:59.846971 run osmo-msc_10.42.42.6(pid=32380): Launched 23:58:00.024491 run osmo-stp_10.42.42.5(pid=32377): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32377)] 23:58:00.159041 run osmo-stp_10.42.42.5(pid=32377): stdout: | (launched: 2022-12-09_23:57:58.776592) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:58:00.294419 run osmo-stp_10.42.42.5(pid=32377): stderr: | 20221209235758968 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235758969 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235758969 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235758970 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235758970 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235758970 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235758970 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:58:00.428642 run osmo-stp_10.42.42.5(pid=32377): stdout: | (launched: 2022-12-09_23:57:58.776592) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:58:00.556068 run osmo-stp_10.42.42.5(pid=32377): stderr: | 20221209235758968 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235758969 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235758969 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235758970 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235758970 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235758970 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235758970 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:58:00.708284 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32377): Process ended prematurely: osmo-stp_10.42.42.5(pid=32377) [trial-2366↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32377)] [trial-2366↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 23:58:00.718109 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 23:58:00.746599 run osmo-hlr_10.42.42.2(pid=32374): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32374)] 23:58:00.796839 run osmo-hlr_10.42.42.2(pid=32374): stdout: | (launched: 2022-12-09_23:57:57.789210) 23:58:00.853578 run osmo-hlr_10.42.42.2(pid=32374): stderr: | 20221209235757985 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209235757985 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209235757985 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209235757985 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209235757985 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209235757985 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209235757995 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209235758004 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209235758004 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209235758004 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:58:00.932473 run osmo-msc_10.42.42.6(pid=32380): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32380)] 23:58:00.984039 run osmo-msc_10.42.42.6(pid=32380): stdout: | (launched: 2022-12-09_23:57:59.789244) 23:58:01.037751 run osmo-msc_10.42.42.6(pid=32380): stderr: | 20221209235800108 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209235800108 DLGLOBAL DEBUG validating counter group 0x7f9dc042ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209235800108 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209235800108 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209235800108 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209235800109 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209235800110 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209235800111 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209235800111 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209235800111 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:58:01.092022 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32373): Terminating (SIGTERM) 23:58:01.135868 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32376): Terminating (SIGTERM) 23:58:01.180002 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32379): Terminating (SIGTERM) 23:58:01.226129 --- ParallelTerminationStrategy: PID 32373 died... 23:58:01.246719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32373): Terminated: ok {rc=0} 23:58:01.297207 --- ParallelTerminationStrategy: PID 32376 died... 23:58:01.317702 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32376): Terminated: ok {rc=0} 23:58:01.366773 --- ParallelTerminationStrategy: PID 32379 died... 23:58:01.387186 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32379): Terminated: ok {rc=0} 23:58:01.478546 bus /sierra_3: Setting Powered False 23:58:02.577344 bus /sierra_3: Setting Powered False 23:58:03.688758 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 23:58:04.942782 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:58:04.949888 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 23:58:04.984543 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 23:58:05.012139 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 23:58:05.066696 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 23:58:05.100471 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 23:58:05.126752 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 23:58:05.677615 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 23:58:05.730447 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:58:05.742042 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 23:58:05.813082 tst mo_mt_call.py: using LAC 24568 23:58:05.938552 tst mo_mt_call.py: using RAC 88 23:58:06.061805 tst mo_mt_call.py: using CellId 24568 23:58:06.185349 tst mo_mt_call.py: using BVCI 24569 23:58:06.302243 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:58:06.313825 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:58:06.325043 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:58:06.336463 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:58:06.348163 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:58:06.360215 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:58:06.475511 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:58:06.594127 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:58:07.083816 run create_hlr_db(pid=32385): Launched 23:58:07.203776 bus /sierra_2: Setting Powered False 23:58:08.267831 run create_hlr_db(pid=32385): Terminated: ok {rc=0} 23:58:08.709671 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32387): Launched 23:58:09.026686 run osmo-hlr_10.42.42.2(pid=32388): Launched 23:58:09.147596 run osmo-stp_10.42.42.5: Starting osmo-stp 23:58:09.665510 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32390): Launched 23:58:09.963300 run osmo-stp_10.42.42.5(pid=32391): Launched 23:58:10.075990 run osmo-msc_10.42.42.6: Starting osmo-msc 23:58:10.612073 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32393): Launched 23:58:10.907185 run osmo-msc_10.42.42.6(pid=32394): Launched 23:58:11.072228 run osmo-stp_10.42.42.5(pid=32391): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32391)] 23:58:11.197753 run osmo-stp_10.42.42.5(pid=32391): stdout: | (launched: 2022-12-09_23:58:09.908671) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:58:11.322688 run osmo-stp_10.42.42.5(pid=32391): stderr: | 20221209235810077 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235810078 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235810078 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235810078 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235810079 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235810079 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235810079 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:58:11.445734 run osmo-stp_10.42.42.5(pid=32391): stdout: | (launched: 2022-12-09_23:58:09.908671) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:58:11.563361 run osmo-stp_10.42.42.5(pid=32391): stderr: | 20221209235810077 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235810078 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235810078 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235810078 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235810079 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235810079 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235810079 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:58:11.704318 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32391): Process ended prematurely: osmo-stp_10.42.42.5(pid=32391) [trial-2366↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32391)] [trial-2366↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 23:58:11.713405 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 23:58:11.739512 run osmo-hlr_10.42.42.2(pid=32388): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32388)] 23:58:11.786524 run osmo-hlr_10.42.42.2(pid=32388): stdout: | (launched: 2022-12-09_23:58:08.969258) 23:58:11.835488 run osmo-hlr_10.42.42.2(pid=32388): stderr: | 20221209235809166 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209235809166 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209235809167 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209235809167 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209235809167 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209235809167 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209235809178 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209235809186 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209235809186 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209235809186 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:58:11.903406 run osmo-msc_10.42.42.6(pid=32394): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32394)] 23:58:11.950525 run osmo-msc_10.42.42.6(pid=32394): stdout: | (launched: 2022-12-09_23:58:10.853480) 23:58:11.999110 run osmo-msc_10.42.42.6(pid=32394): stderr: | 20221209235811125 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209235811125 DLGLOBAL DEBUG validating counter group 0x7ffa23549c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209235811125 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209235811125 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209235811126 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209235811126 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209235811127 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209235811128 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209235811128 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209235811128 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:58:12.048134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32387): Terminating (SIGTERM) 23:58:12.087144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32390): Terminating (SIGTERM) 23:58:12.126255 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32393): Terminating (SIGTERM) 23:58:12.165741 --- ParallelTerminationStrategy: PID 32387 died... 23:58:12.184528 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32387): Terminated: ok {rc=0} 23:58:12.228105 --- ParallelTerminationStrategy: PID 32390 died... 23:58:12.246792 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32390): Terminated: ok {rc=0} 23:58:12.290746 --- ParallelTerminationStrategy: PID 32393 died... 23:58:12.309183 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32393): Terminated: ok {rc=0} 23:58:12.394274 bus /sierra_3: Setting Powered False 23:58:13.494173 bus /sierra_3: Setting Powered False 23:58:14.611851 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 23:58:15.755441 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:58:15.766980 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 23:58:15.843358 tst mo_mt_call_osmux.py: using LAC 24569 23:58:15.987149 tst mo_mt_call_osmux.py: using RAC 89 23:58:16.115055 tst mo_mt_call_osmux.py: using CellId 24569 23:58:16.247674 tst mo_mt_call_osmux.py: using BVCI 24570 23:58:16.359054 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:58:16.371176 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:58:16.384926 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:58:16.396932 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:58:16.408395 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 23:58:16.420558 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:58:16.535735 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 23:58:16.669038 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:58:17.143224 run create_hlr_db(pid=32396): Launched 23:58:17.283458 bus /sierra_2: Setting Powered False 23:58:18.342993 run create_hlr_db(pid=32396): Terminated: ok {rc=0} 23:58:18.777279 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32398): Launched 23:58:19.093859 run osmo-hlr_10.42.42.2(pid=32399): Launched 23:58:19.214408 run osmo-stp_10.42.42.5: Starting osmo-stp 23:58:19.761043 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32401): Launched 23:58:20.078016 run osmo-stp_10.42.42.5(pid=32402): Launched 23:58:20.198822 run osmo-msc_10.42.42.6: Starting osmo-msc 23:58:20.773096 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32404): Launched 23:58:21.089674 run osmo-msc_10.42.42.6(pid=32405): Launched 23:58:21.267668 run osmo-stp_10.42.42.5(pid=32402): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32402)] 23:58:21.402938 run osmo-stp_10.42.42.5(pid=32402): stdout: | (launched: 2022-12-09_23:58:20.020605) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:58:21.537831 run osmo-stp_10.42.42.5(pid=32402): stderr: | 20221209235820211 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235820211 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235820212 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235820212 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235820214 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235820215 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235820215 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:58:21.671950 run osmo-stp_10.42.42.5(pid=32402): stdout: | (launched: 2022-12-09_23:58:20.020605) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:58:21.798667 run osmo-stp_10.42.42.5(pid=32402): stderr: | 20221209235820211 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235820211 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235820212 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235820212 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235820214 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235820215 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235820215 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:58:21.950335 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32402): Process ended prematurely: osmo-stp_10.42.42.5(pid=32402) [trial-2366↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32402)] [trial-2366↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 23:58:21.960079 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 23:58:21.988292 run osmo-hlr_10.42.42.2(pid=32399): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32399)] 23:58:22.038715 run osmo-hlr_10.42.42.2(pid=32399): stdout: | (launched: 2022-12-09_23:58:19.036766) 23:58:22.091034 run osmo-hlr_10.42.42.2(pid=32399): stderr: | 20221209235819234 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209235819234 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209235819234 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209235819234 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209235819234 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209235819235 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209235819248 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209235819256 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209235819256 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209235819256 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:58:22.162931 run osmo-msc_10.42.42.6(pid=32405): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32405)] 23:58:22.212820 run osmo-msc_10.42.42.6(pid=32405): stdout: | (launched: 2022-12-09_23:58:21.032334) 23:58:22.264723 run osmo-msc_10.42.42.6(pid=32405): stderr: | 20221209235821352 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209235821352 DLGLOBAL DEBUG validating counter group 0x7f66d73a5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209235821352 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209235821352 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209235821352 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209235821353 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209235821354 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209235821355 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209235821355 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209235821355 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:58:22.316893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32398): Terminating (SIGTERM) 23:58:22.358419 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32401): Terminating (SIGTERM) 23:58:22.399890 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32404): Terminating (SIGTERM) 23:58:22.441521 --- ParallelTerminationStrategy: PID 32398 died... 23:58:22.461399 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32398): Terminated: ok {rc=0} 23:58:22.507387 --- ParallelTerminationStrategy: PID 32401 died... 23:58:22.526779 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32401): Terminated: ok {rc=0} 23:58:22.573225 --- ParallelTerminationStrategy: PID 32404 died... 23:58:22.592462 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32404): Terminated: ok {rc=0} 23:58:22.680351 bus /sierra_3: Setting Powered False 23:58:23.777356 bus /sierra_3: Setting Powered False 23:58:24.892775 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 23:58:26.140569 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:58:26.146807 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 23:58:26.179386 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 23:58:26.206006 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 23:58:26.257931 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 23:58:26.291047 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 23:58:26.317425 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 23:58:26.872604 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 23:58:26.924856 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:58:26.936610 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 23:58:27.008239 tst mo_mt_call.py: using LAC 24570 23:58:27.137446 tst mo_mt_call.py: using RAC 90 23:58:27.262989 tst mo_mt_call.py: using CellId 24570 23:58:27.379166 tst mo_mt_call.py: using BVCI 24571 23:58:27.486106 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:58:27.497220 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:58:27.508098 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:58:27.518984 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:58:27.529974 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:58:27.540785 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:58:27.657648 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:58:27.774174 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:58:28.266733 run create_hlr_db(pid=32410): Launched 23:58:28.390156 bus /sierra_2: Setting Powered False 23:58:29.452379 run create_hlr_db(pid=32410): Terminated: ok {rc=0} 23:58:29.878864 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32412): Launched 23:58:30.175762 run osmo-hlr_10.42.42.2(pid=32413): Launched 23:58:30.288771 run osmo-stp_10.42.42.5: Starting osmo-stp 23:58:30.799105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32415): Launched 23:58:31.129681 run osmo-stp_10.42.42.5(pid=32416): Launched 23:58:31.364294 run osmo-msc_10.42.42.6: Starting osmo-msc 23:58:32.071400 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32418): Launched 23:58:32.382609 run osmo-msc_10.42.42.6(pid=32419): Launched 23:58:32.547999 run osmo-stp_10.42.42.5(pid=32416): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32416)] 23:58:32.673226 run osmo-stp_10.42.42.5(pid=32416): stdout: | (launched: 2022-12-09_23:58:31.065821) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:58:32.798668 run osmo-stp_10.42.42.5(pid=32416): stderr: | 20221209235831395 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235831395 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235831395 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235831396 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235831396 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235831396 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235831396 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:58:32.921967 run osmo-stp_10.42.42.5(pid=32416): stdout: | (launched: 2022-12-09_23:58:31.065821) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:58:33.040086 run osmo-stp_10.42.42.5(pid=32416): stderr: | 20221209235831395 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235831395 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235831395 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235831396 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235831396 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235831396 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235831396 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:58:33.181074 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32416): Process ended prematurely: osmo-stp_10.42.42.5(pid=32416) [trial-2366↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32416)] [trial-2366↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 23:58:33.189855 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 23:58:33.216001 run osmo-hlr_10.42.42.2(pid=32413): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32413)] 23:58:33.263189 run osmo-hlr_10.42.42.2(pid=32413): stdout: | (launched: 2022-12-09_23:58:30.121543) 23:58:33.311893 run osmo-hlr_10.42.42.2(pid=32413): stderr: | 20221209235830296 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209235830296 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209235830297 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209235830297 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209235830297 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209235830297 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209235830313 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209235830322 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209235830323 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209235830323 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:58:33.380077 run osmo-msc_10.42.42.6(pid=32419): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32419)] 23:58:33.426930 run osmo-msc_10.42.42.6(pid=32419): stdout: | (launched: 2022-12-09_23:58:32.328166) 23:58:33.475570 run osmo-msc_10.42.42.6(pid=32419): stderr: | 20221209235832600 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209235832601 DLGLOBAL DEBUG validating counter group 0x7fa1a2c9ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209235832601 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209235832601 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209235832601 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209235832601 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209235832603 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209235832603 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209235832603 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209235832604 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:58:33.524417 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32412): Terminating (SIGTERM) 23:58:33.563084 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32415): Terminating (SIGTERM) 23:58:33.601867 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32418): Terminating (SIGTERM) 23:58:33.640731 --- ParallelTerminationStrategy: PID 32412 died... 23:58:33.659025 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32412): Terminated: ok {rc=0} 23:58:33.702265 --- ParallelTerminationStrategy: PID 32415 died... 23:58:33.720611 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32415): Terminated: ok {rc=0} 23:58:33.763578 --- ParallelTerminationStrategy: PID 32418 died... 23:58:33.782181 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32418): Terminated: ok {rc=0} 23:58:33.866261 bus /sierra_3: Setting Powered False 23:58:34.964479 bus /sierra_3: Setting Powered False 23:58:36.078508 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 23:58:37.223767 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:58:37.235491 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 23:58:37.306505 tst mo_mt_call_osmux.py: using LAC 24571 23:58:37.427474 tst mo_mt_call_osmux.py: using RAC 91 23:58:37.543789 tst mo_mt_call_osmux.py: using CellId 24571 23:58:37.659340 tst mo_mt_call_osmux.py: using BVCI 24572 23:58:37.766390 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:58:37.777628 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:58:37.788629 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:58:37.799594 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:58:37.810633 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 23:58:37.821580 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:58:37.939805 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 23:58:38.061159 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:58:38.555665 run create_hlr_db(pid=32421): Launched 23:58:38.678597 bus /sierra_2: Setting Powered False 23:58:39.742440 run create_hlr_db(pid=32421): Terminated: ok {rc=0} 23:58:40.171143 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32423): Launched 23:58:40.468567 run osmo-hlr_10.42.42.2(pid=32424): Launched 23:58:40.583205 run osmo-stp_10.42.42.5: Starting osmo-stp 23:58:41.110199 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32426): Launched 23:58:41.406499 run osmo-stp_10.42.42.5(pid=32427): Launched 23:58:41.519489 run osmo-msc_10.42.42.6: Starting osmo-msc 23:58:42.062800 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32429): Launched 23:58:42.361750 run osmo-msc_10.42.42.6(pid=32430): Launched 23:58:42.527945 run osmo-stp_10.42.42.5(pid=32427): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32427)] 23:58:42.654000 run osmo-stp_10.42.42.5(pid=32427): stdout: | (launched: 2022-12-09_23:58:41.352226) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:58:42.780072 run osmo-stp_10.42.42.5(pid=32427): stderr: | 20221209235841519 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235841519 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235841519 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235841519 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235841520 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235841520 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235841520 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:58:42.904476 run osmo-stp_10.42.42.5(pid=32427): stdout: | (launched: 2022-12-09_23:58:41.352226) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:58:43.023159 run osmo-stp_10.42.42.5(pid=32427): stderr: | 20221209235841519 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235841519 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235841519 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235841519 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235841520 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235841520 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235841520 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:58:43.165267 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32427): Process ended prematurely: osmo-stp_10.42.42.5(pid=32427) [trial-2366↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32427)] [trial-2366↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 23:58:43.174107 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 23:58:43.200328 run osmo-hlr_10.42.42.2(pid=32424): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32424)] 23:58:43.247656 run osmo-hlr_10.42.42.2(pid=32424): stdout: | (launched: 2022-12-09_23:58:40.414335) 23:58:43.296705 run osmo-hlr_10.42.42.2(pid=32424): stderr: | 20221209235840590 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209235840590 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209235840590 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209235840590 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209235840590 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209235840590 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209235840602 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209235840611 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209235840612 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209235840612 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:58:43.365242 run osmo-msc_10.42.42.6(pid=32430): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32430)] 23:58:43.412427 run osmo-msc_10.42.42.6(pid=32430): stdout: | (launched: 2022-12-09_23:58:42.306877) 23:58:43.461247 run osmo-msc_10.42.42.6(pid=32430): stderr: | 20221209235842582 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209235842582 DLGLOBAL DEBUG validating counter group 0x7f7643936c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209235842582 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209235842582 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209235842582 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209235842582 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209235842584 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209235842584 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209235842585 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209235842585 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:58:43.510510 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32423): Terminating (SIGTERM) 23:58:43.549699 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32426): Terminating (SIGTERM) 23:58:43.588936 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32429): Terminating (SIGTERM) 23:58:43.628307 --- ParallelTerminationStrategy: PID 32423 died... 23:58:43.647278 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32423): Terminated: ok {rc=0} 23:58:43.690807 --- ParallelTerminationStrategy: PID 32426 died... 23:58:43.709249 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32426): Terminated: ok {rc=0} 23:58:43.752696 --- ParallelTerminationStrategy: PID 32429 died... 23:58:43.771259 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32429): Terminated: ok {rc=0} 23:58:43.854515 bus /sierra_3: Setting Powered False 23:58:44.952126 bus /sierra_3: Setting Powered False 23:58:46.071882 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 voice:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 23:58:47.330534 tst voice:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:58:47.336111 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 23:58:47.368559 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 23:58:47.395219 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 23:58:47.445911 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 23:58:47.478366 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 23:58:47.504858 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 23:58:48.054989 tst voice:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 23:58:48.102855 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:58:48.114016 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:58:48.183996 tst mo_mt_call.py: using LAC 24572 23:58:48.302466 tst mo_mt_call.py: using RAC 92 23:58:48.421276 tst mo_mt_call.py: using CellId 24572 23:58:48.537140 tst mo_mt_call.py: using BVCI 24573 23:58:48.644793 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:58:48.655836 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:58:48.666628 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:58:48.677152 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:58:48.687613 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:58:48.698228 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:58:48.815417 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:58:48.935246 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:58:49.428379 run create_hlr_db(pid=32436): Launched 23:58:49.550325 bus /sierra_2: Setting Powered False 23:58:50.613185 run create_hlr_db(pid=32436): Terminated: ok {rc=0} 23:58:51.038800 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32438): Launched 23:58:51.335371 run osmo-hlr_10.42.42.2(pid=32439): Launched 23:58:51.448733 run osmo-stp_10.42.42.5: Starting osmo-stp 23:58:51.963580 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32441): Launched 23:58:52.259205 run osmo-stp_10.42.42.5(pid=32442): Launched 23:58:52.371881 run osmo-msc_10.42.42.6: Starting osmo-msc 23:58:52.908221 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32444): Launched 23:58:53.205492 run osmo-msc_10.42.42.6(pid=32445): Launched 23:58:53.372037 run osmo-stp_10.42.42.5(pid=32442): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32442)] 23:58:53.498485 run osmo-stp_10.42.42.5(pid=32442): stdout: | (launched: 2022-12-09_23:58:52.204550) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:58:53.625297 run osmo-stp_10.42.42.5(pid=32442): stderr: | 20221209235852376 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235852376 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235852376 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235852377 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235852377 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235852377 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235852377 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:58:53.749762 run osmo-stp_10.42.42.5(pid=32442): stdout: | (launched: 2022-12-09_23:58:52.204550) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:58:53.868370 run osmo-stp_10.42.42.5(pid=32442): stderr: | 20221209235852376 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235852376 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235852376 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235852377 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235852377 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235852377 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235852377 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:58:54.010346 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32442): Process ended prematurely: osmo-stp_10.42.42.5(pid=32442) [trial-2366↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32442)] [trial-2366↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 23:58:54.019228 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 23:58:54.045068 run osmo-hlr_10.42.42.2(pid=32439): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32439)] 23:58:54.092030 run osmo-hlr_10.42.42.2(pid=32439): stdout: | (launched: 2022-12-09_23:58:51.281352) 23:58:54.140729 run osmo-hlr_10.42.42.2(pid=32439): stderr: | 20221209235851456 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209235851456 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209235851456 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209235851456 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209235851456 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209235851456 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209235851469 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209235851479 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209235851479 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209235851479 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:58:54.208516 run osmo-msc_10.42.42.6(pid=32445): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32445)] 23:58:54.256762 run osmo-msc_10.42.42.6(pid=32445): stdout: | (launched: 2022-12-09_23:58:53.150783) 23:58:54.305481 run osmo-msc_10.42.42.6(pid=32445): stderr: | 20221209235853424 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209235853425 DLGLOBAL DEBUG validating counter group 0x7f14ad496c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209235853425 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209235853425 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209235853425 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209235853425 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209235853429 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209235853429 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209235853429 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209235853429 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:58:54.354259 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32438): Terminating (SIGTERM) 23:58:54.392915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32441): Terminating (SIGTERM) 23:58:54.431813 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32444): Terminating (SIGTERM) 23:58:54.471144 --- ParallelTerminationStrategy: PID 32438 died... 23:58:54.490021 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32438): Terminated: ok {rc=0} 23:58:54.533828 --- ParallelTerminationStrategy: PID 32441 died... 23:58:54.552013 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32441): Terminated: ok {rc=0} 23:58:54.595672 --- ParallelTerminationStrategy: PID 32444 died... 23:58:54.614020 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32444): Terminated: ok {rc=0} 23:58:54.696264 bus /sierra_3: Setting Powered False 23:58:55.793519 bus /sierra_3: Setting Powered False 23:58:56.910090 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 23:58:58.058708 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:58:58.070863 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 23:58:58.143800 tst mo_mt_call_osmux.py: using LAC 24573 23:58:58.270107 tst mo_mt_call_osmux.py: using RAC 93 23:58:58.397308 tst mo_mt_call_osmux.py: using CellId 24573 23:58:58.523448 tst mo_mt_call_osmux.py: using BVCI 24574 23:58:58.639253 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:58:58.650817 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:58:58.662117 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:58:58.673813 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:58:58.685685 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 23:58:58.697886 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:58:58.815478 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 23:58:58.933918 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:58:59.425259 run create_hlr_db(pid=32447): Launched 23:58:59.545686 bus /sierra_2: Setting Powered False 23:59:00.608310 run create_hlr_db(pid=32447): Terminated: ok {rc=0} 23:59:01.059389 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32449): Launched 23:59:01.465833 run osmo-hlr_10.42.42.2(pid=32450): Launched 23:59:01.703405 run osmo-stp_10.42.42.5: Starting osmo-stp 23:59:02.479254 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32452): Launched 23:59:02.775291 run osmo-stp_10.42.42.5(pid=32453): Launched 23:59:02.887861 run osmo-msc_10.42.42.6: Starting osmo-msc 23:59:03.423674 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32455): Launched 23:59:03.720151 run osmo-msc_10.42.42.6(pid=32456): Launched 23:59:03.885825 run osmo-stp_10.42.42.5(pid=32453): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32453)] 23:59:04.011250 run osmo-stp_10.42.42.5(pid=32453): stdout: | (launched: 2022-12-09_23:59:02.721820) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:59:04.136896 run osmo-stp_10.42.42.5(pid=32453): stderr: | 20221209235902887 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235902887 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235902888 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235902888 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235902890 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235902890 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235902890 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:59:04.260545 run osmo-stp_10.42.42.5(pid=32453): stdout: | (launched: 2022-12-09_23:59:02.721820) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:59:04.379825 run osmo-stp_10.42.42.5(pid=32453): stderr: | 20221209235902887 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235902887 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235902888 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235902888 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235902890 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235902890 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235902890 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:59:04.521977 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32453): Process ended prematurely: osmo-stp_10.42.42.5(pid=32453) [trial-2366↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32453)] [trial-2366↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 23:59:04.530815 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 23:59:04.557380 run osmo-hlr_10.42.42.2(pid=32450): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32450)] 23:59:04.605042 run osmo-hlr_10.42.42.2(pid=32450): stdout: | (launched: 2022-12-09_23:59:01.407933) 23:59:04.653819 run osmo-hlr_10.42.42.2(pid=32450): stderr: | 20221209235901724 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209235901724 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209235901724 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209235901724 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209235901725 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209235901725 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209235901742 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209235901767 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209235901767 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209235901767 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:59:04.721831 run osmo-msc_10.42.42.6(pid=32456): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32456)] 23:59:04.769128 run osmo-msc_10.42.42.6(pid=32456): stdout: | (launched: 2022-12-09_23:59:03.665909) 23:59:04.817767 run osmo-msc_10.42.42.6(pid=32456): stderr: | 20221209235903937 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209235903937 DLGLOBAL DEBUG validating counter group 0x7f800aa35c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209235903938 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209235903938 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209235903938 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209235903938 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209235903940 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209235903940 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209235903940 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209235903940 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:59:04.867142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32449): Terminating (SIGTERM) 23:59:04.906469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32452): Terminating (SIGTERM) 23:59:04.945698 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32455): Terminating (SIGTERM) 23:59:04.985449 --- ParallelTerminationStrategy: PID 32449 died... 23:59:05.004252 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32449): Terminated: ok {rc=0} 23:59:05.048486 --- ParallelTerminationStrategy: PID 32452 died... 23:59:05.067116 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32452): Terminated: ok {rc=0} 23:59:05.111343 --- ParallelTerminationStrategy: PID 32455 died... 23:59:05.130143 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32455): Terminated: ok {rc=0} 23:59:05.216174 bus /sierra_3: Setting Powered False 23:59:06.315298 bus /sierra_3: Setting Powered False 23:59:07.428345 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 voice:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 emergency:trx-lms --------------------------------------------------------------------- 23:59:08.676325 tst emergency:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:59:08.681186 tst emergency:trx-lms: Verifying 1 x bts (candidates: 11) 23:59:08.715435 tst emergency:trx-lms: Verifying 6 x ip_address (candidates: 9) 23:59:08.742578 tst emergency:trx-lms: Verifying 4 x modem (candidates: 12) 23:59:08.830585 tst emergency:trx-lms: Reserving 1 x bts (candidates: 11) 23:59:08.863536 tst emergency:trx-lms: Reserving 6 x ip_address (candidates: 9) 23:59:08.890156 tst emergency:trx-lms: Reserving 4 x modem (candidates: 12) 23:59:09.474726 tst emergency:trx-lms: RESERVED RESOURCES for emergency: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2366 emergency:trx-lms emergency_mo_mt_call.py ---------------------------------------------- 23:59:09.480342 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 23:59:09.491512 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 23:59:09.544404 tst emergency_mo_mt_call.py: using LAC 24574 23:59:09.667465 tst emergency_mo_mt_call.py: using RAC 94 23:59:09.783350 tst emergency_mo_mt_call.py: using CellId 24574 23:59:09.897883 tst emergency_mo_mt_call.py: using BVCI 24575 23:59:10.012427 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 23:59:10.023685 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 23:59:10.034751 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 23:59:10.046222 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 23:59:10.057671 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 23:59:10.069144 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 23:59:10.186722 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 23:59:10.304646 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:59:10.757474 run create_hlr_db(pid=32462): Launched 23:59:10.876828 bus /sierra_2: Setting Powered False 23:59:11.935620 run create_hlr_db(pid=32462): Terminated: ok {rc=0} 23:59:12.363549 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32464): Launched 23:59:12.656220 run osmo-hlr_10.42.42.2(pid=32465): Launched 23:59:12.766927 run osmo-stp_10.42.42.5: Starting osmo-stp 23:59:13.284152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32467): Launched 23:59:13.574798 run osmo-stp_10.42.42.5(pid=32468): Launched 23:59:13.698651 tst emergency_mo_mt_call.py: using MSISDN 7442 23:59:13.847956 run osmo-msc_10.42.42.6: Starting osmo-msc 23:59:14.373501 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32470): Launched 23:59:14.666001 run osmo-msc_10.42.42.6(pid=32471): Launched 23:59:14.830455 run osmo-stp_10.42.42.5(pid=32468): ERR: Terminated: ERROR {rc=1} [trial-2366↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32468)] 23:59:14.953608 run osmo-stp_10.42.42.5(pid=32468): stdout: | (launched: 2022-12-09_23:59:13.521370) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:59:15.078111 run osmo-stp_10.42.42.5(pid=32468): stderr: | 20221209235913689 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235913689 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235913689 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235913690 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235913690 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235913690 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235913690 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:59:15.200031 run osmo-stp_10.42.42.5(pid=32468): stdout: | (launched: 2022-12-09_23:59:13.521370) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:59:15.316064 run osmo-stp_10.42.42.5(pid=32468): stderr: | 20221209235913689 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235913689 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235913689 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235913690 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235913690 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235913690 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235913690 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:59:15.454773 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=32468): Process ended prematurely: osmo-stp_10.42.42.5(pid=32468) [trial-2366↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32468)] [trial-2366↪emergency:trx-lms↪emergency_mo_mt_call.py:19] 23:59:15.463090 tst emergency_mo_mt_call.py:19: Test FAILED (6.0 sec) 23:59:15.488651 run osmo-hlr_10.42.42.2(pid=32465): ERR: Terminated: ERROR {rc=237} [trial-2366↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32465)] 23:59:15.535659 run osmo-hlr_10.42.42.2(pid=32465): stdout: | (launched: 2022-12-09_23:59:12.603018) 23:59:15.584512 run osmo-hlr_10.42.42.2(pid=32465): stderr: | 20221209235912778 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209235912778 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209235912778 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209235912778 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209235912778 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209235912778 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209235912790 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/emergency:trx-lms/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209235912798 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209235912798 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209235912798 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:59:15.652328 run osmo-msc_10.42.42.6(pid=32471): ERR: Terminated: ERROR {rc=2} [trial-2366↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32471)] 23:59:15.699646 run osmo-msc_10.42.42.6(pid=32471): stdout: | (launched: 2022-12-09_23:59:14.612216) 23:59:15.748274 run osmo-msc_10.42.42.6(pid=32471): stderr: | 20221209235914884 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209235914884 DLGLOBAL DEBUG validating counter group 0x7fa6105afc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209235914884 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209235914884 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209235914884 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209235914884 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209235914886 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209235914887 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209235914887 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209235914887 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:59:15.797416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32464): Terminating (SIGTERM) 23:59:15.836659 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32467): Terminating (SIGTERM) 23:59:15.876427 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32470): Terminating (SIGTERM) 23:59:15.922694 --- ParallelTerminationStrategy: PID 32464 died... 23:59:15.941700 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32464): Terminated: ok {rc=0} 23:59:15.985703 --- ParallelTerminationStrategy: PID 32467 died... 23:59:16.004410 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32467): Terminated: ok {rc=0} 23:59:16.052160 --- ParallelTerminationStrategy: PID 32470 died... 23:59:16.072895 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32470): Terminated: ok {rc=0} 23:59:16.175364 bus /sierra_3: Setting Powered False 23:59:17.294070 bus /sierra_3: Setting Powered False 23:59:18.410902 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 emergency:trx-lms emergency_preemptive_call.py ---------------------------------------------- 23:59:19.498644 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 23:59:19.509746 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 23:59:19.560757 tst emergency_preemptive_call.py: using LAC 24575 23:59:19.682024 tst emergency_preemptive_call.py: using RAC 95 23:59:19.795971 tst emergency_preemptive_call.py: using CellId 24575 23:59:19.910503 tst emergency_preemptive_call.py: using BVCI 24576 23:59:20.015495 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 23:59:20.026099 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 23:59:20.036380 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 23:59:20.046810 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 23:59:20.057176 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 23:59:20.067414 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 23:59:20.184475 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 23:59:20.301770 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 23:59:20.416364 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 23:59:20.534615 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:59:21.021337 run create_hlr_db(pid=32473): Launched 23:59:21.141917 bus /sierra_2: Setting Powered False 23:59:22.200569 run create_hlr_db(pid=32473): Terminated: ok {rc=0} 23:59:22.637495 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32475): Launched 23:59:22.951217 run osmo-hlr_10.42.42.2(pid=32476): Launched 23:59:23.070412 run osmo-stp_10.42.42.5: Starting osmo-stp 23:59:23.612818 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32478): Launched 23:59:23.925106 run osmo-stp_10.42.42.5(pid=32479): Launched 23:59:24.054914 tst emergency_preemptive_call.py: using MSISDN 7443 23:59:24.213709 run osmo-msc_10.42.42.6: Starting osmo-msc 23:59:24.775327 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32481): Launched 23:59:25.087442 run osmo-msc_10.42.42.6(pid=32482): Launched 23:59:25.261649 run osmo-stp_10.42.42.5(pid=32479): ERR: Terminated: ERROR {rc=1} [trial-2366↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32479)] 23:59:25.394693 run osmo-stp_10.42.42.5(pid=32479): stdout: | (launched: 2022-12-09_23:59:23.868275) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:59:25.527253 run osmo-stp_10.42.42.5(pid=32479): stderr: | 20221209235924058 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235924058 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235924058 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235924059 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235924059 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235924059 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235924059 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:59:25.659484 run osmo-stp_10.42.42.5(pid=32479): stdout: | (launched: 2022-12-09_23:59:23.868275) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:59:25.783868 run osmo-stp_10.42.42.5(pid=32479): stderr: | 20221209235924058 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235924058 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235924058 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235924059 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235924059 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235924059 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235924059 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:59:25.932866 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=32479): Process ended prematurely: osmo-stp_10.42.42.5(pid=32479) [trial-2366↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32479)] [trial-2366↪emergency:trx-lms↪emergency_preemptive_call.py:32] 23:59:25.941764 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 23:59:25.969354 run osmo-hlr_10.42.42.2(pid=32476): ERR: Terminated: ERROR {rc=237} [trial-2366↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32476)] 23:59:26.019421 run osmo-hlr_10.42.42.2(pid=32476): stdout: | (launched: 2022-12-09_23:59:22.894156) 23:59:26.071179 run osmo-hlr_10.42.42.2(pid=32476): stderr: | 20221209235923089 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209235923089 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209235923089 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209235923089 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209235923089 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209235923090 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209235923102 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/emergency:trx-lms/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209235923110 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209235923111 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209235923111 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:59:26.143193 run osmo-msc_10.42.42.6(pid=32482): ERR: Terminated: ERROR {rc=2} [trial-2366↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32482)] 23:59:26.193344 run osmo-msc_10.42.42.6(pid=32482): stdout: | (launched: 2022-12-09_23:59:25.030547) 23:59:26.245076 run osmo-msc_10.42.42.6(pid=32482): stderr: | 20221209235925350 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209235925350 DLGLOBAL DEBUG validating counter group 0x7fb350ae7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209235925350 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209235925350 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209235925350 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209235925350 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209235925352 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209235925353 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209235925353 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209235925353 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 23:59:26.297537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32475): Terminating (SIGTERM) 23:59:26.339134 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32478): Terminating (SIGTERM) 23:59:26.380679 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32481): Terminating (SIGTERM) 23:59:26.422469 --- ParallelTerminationStrategy: PID 32475 died... 23:59:26.442038 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32475): Terminated: ok {rc=0} 23:59:26.488863 --- ParallelTerminationStrategy: PID 32478 died... 23:59:26.508359 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32478): Terminated: ok {rc=0} 23:59:26.554647 --- ParallelTerminationStrategy: PID 32481 died... 23:59:26.574014 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32481): Terminated: ok {rc=0} 23:59:26.661716 bus /sierra_9: Setting Powered False 23:59:27.759025 bus /sierra_9: Setting Powered False 23:59:28.873955 bus /sierra_8: Setting Powered False 23:59:29.969711 bus /sierra_8: Setting Powered False 23:59:31.089087 bus /sierra_3: Setting Powered False 23:59:32.214619 bus /sierra_3: Setting Powered False 23:59:33.330562 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 emergency:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 gprs:trx-lms --------------------------------------------------------------------- 23:59:34.600798 tst gprs:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 23:59:34.605193 tst gprs:trx-lms: Verifying 1 x bts (candidates: 11) 23:59:34.637932 tst gprs:trx-lms: Verifying 9 x ip_address (candidates: 9) 23:59:34.676305 tst gprs:trx-lms: Verifying 4 x modem (candidates: 12) 23:59:34.762201 tst gprs:trx-lms: Reserving 1 x bts (candidates: 11) 23:59:34.795032 tst gprs:trx-lms: Reserving 9 x ip_address (candidates: 9) 23:59:34.833792 tst gprs:trx-lms: Reserving 4 x modem (candidates: 12) 23:59:35.423411 tst gprs:trx-lms: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2366 gprs:trx-lms cs_paging_gprs_active.py ---------------------------------------------- 23:59:35.471799 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 23:59:35.482578 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 23:59:35.530977 tst cs_paging_gprs_active.py: using LAC 24576 23:59:35.648429 tst cs_paging_gprs_active.py: using RAC 96 23:59:35.766283 tst cs_paging_gprs_active.py: using CellId 24576 23:59:35.884320 tst cs_paging_gprs_active.py: using BVCI 24577 23:59:35.991171 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 23:59:36.001805 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 23:59:36.012056 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 23:59:36.022328 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 23:59:36.032592 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 23:59:36.042907 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 23:59:36.053312 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 23:59:36.063442 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 23:59:36.074350 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 23:59:36.192193 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 23:59:36.308410 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 23:59:36.508344 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:59:36.806874 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32487): Launched 23:59:37.065992 run iperf3-srv_10.42.42.10(pid=32488): Launched 23:59:37.178102 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 23:59:37.392110 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:59:37.713931 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32489): Launched 23:59:37.990763 run iperf3-srv_10.42.42.10(pid=32490): Launched 23:59:38.110226 tst cs_paging_gprs_active.py:38: start network... 23:59:38.326374 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:59:38.820809 run create_hlr_db(pid=32491): Launched 23:59:38.943024 bus /sierra_2: Setting Powered False 23:59:40.006629 run create_hlr_db(pid=32491): Terminated: ok {rc=0} 23:59:40.433696 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32493): Launched 23:59:40.734371 run osmo-hlr_10.42.42.2(pid=32494): Launched 23:59:40.848113 run osmo-stp_10.42.42.5: Starting osmo-stp 23:59:41.377548 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32496): Launched 23:59:41.676444 run osmo-stp_10.42.42.5(pid=32497): Launched 23:59:41.791100 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:59:42.303800 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32499): Launched 23:59:42.418432 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:59:42.669839 run patchelf(pid=32500): Launched 23:59:42.835511 run osmo-stp_10.42.42.5(pid=32497): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32497)] 23:59:42.961349 run osmo-stp_10.42.42.5(pid=32497): stdout: | (launched: 2022-12-09_23:59:41.621958) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:59:43.089378 run osmo-stp_10.42.42.5(pid=32497): stderr: | 20221209235941793 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235941793 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235941793 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235941794 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235941794 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235941794 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235941794 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:59:43.216942 run osmo-stp_10.42.42.5(pid=32497): stdout: | (launched: 2022-12-09_23:59:41.621958) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:59:43.338846 run osmo-stp_10.42.42.5(pid=32497): stderr: | 20221209235941793 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235941793 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235941793 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235941794 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235941794 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235941794 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235941794 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:59:43.483053 run patchelf(pid=32500): Terminating (SIGINT) 23:59:43.649860 run patchelf(pid=32500): Terminated: ok {rc=0} 23:59:43.770148 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=32497): Process ended prematurely: osmo-stp_10.42.42.5(pid=32497) [trial-2366↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32497)] [trial-2366↪gprs:trx-lms↪cs_paging_gprs_active.py:38] 23:59:43.779537 tst cs_paging_gprs_active.py:38: Test FAILED (8.3 sec) 23:59:43.806293 run osmo-hlr_10.42.42.2(pid=32494): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-lms↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32494)] 23:59:43.853488 run osmo-hlr_10.42.42.2(pid=32494): stdout: | (launched: 2022-12-09_23:59:40.679672) 23:59:43.902107 run osmo-hlr_10.42.42.2(pid=32494): stderr: | 20221209235940857 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209235940857 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209235940857 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209235940857 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209235940857 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209235940857 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209235940869 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-lms/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209235940878 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209235940878 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209235940878 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:59:43.951244 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32487): Terminating (SIGTERM) 23:59:43.990237 run iperf3-srv_10.42.42.10(pid=32488): Terminating (SIGTERM) 23:59:44.029386 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32489): Terminating (SIGTERM) 23:59:44.069165 run iperf3-srv_10.42.42.10(pid=32490): Terminating (SIGTERM) 23:59:44.108364 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32493): Terminating (SIGTERM) 23:59:44.147412 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32496): Terminating (SIGTERM) 23:59:44.186262 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32499): Terminating (SIGTERM) 23:59:44.225313 --- ParallelTerminationStrategy: PID 32487 died... 23:59:44.244042 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32487): Terminated: ok {rc=0} 23:59:44.287622 --- ParallelTerminationStrategy: PID 32488 died... 23:59:44.306124 run iperf3-srv_10.42.42.10(pid=32488): Terminated {rc=256} 23:59:44.349678 --- ParallelTerminationStrategy: PID 32489 died... 23:59:44.368193 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32489): Terminated: ok {rc=0} 23:59:44.411787 --- ParallelTerminationStrategy: PID 32490 died... 23:59:44.430249 run iperf3-srv_10.42.42.10(pid=32490): Terminated {rc=256} 23:59:44.474281 --- ParallelTerminationStrategy: PID 32493 died... 23:59:44.492781 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32493): Terminated: ok {rc=0} 23:59:44.537080 --- ParallelTerminationStrategy: PID 32496 died... 23:59:44.555590 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32496): Terminated: ok {rc=0} 23:59:44.599614 --- ParallelTerminationStrategy: PID 32499 died... 23:59:44.618190 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32499): Terminated: ok {rc=0} 23:59:44.703983 bus /gobi_0: Setting Powered False 23:59:45.803604 bus /gobi_0: Setting Powered False 23:59:46.930484 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-lms iperf3.py ---------------------------------------------- 23:59:48.088689 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 23:59:48.099912 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 23:59:48.151628 tst iperf3.py: using LAC 24577 23:59:48.270052 tst iperf3.py: using RAC 97 23:59:48.387203 tst iperf3.py: using CellId 24577 23:59:48.504332 tst iperf3.py: using BVCI 24578 23:59:48.612573 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 23:59:48.623073 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 23:59:48.633297 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 23:59:48.643684 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 23:59:48.654008 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 23:59:48.664383 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 23:59:48.674683 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 23:59:48.685542 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 23:59:48.696112 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 23:59:48.813354 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 23:59:49.029872 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:59:49.349781 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32501): Launched 23:59:49.627949 run iperf3-srv_10.42.42.10(pid=32502): Launched 23:59:49.747361 tst iperf3.py:8: start network... 23:59:49.962659 run osmo-hlr_10.42.42.2: Starting osmo-hlr 23:59:50.457005 run create_hlr_db(pid=32503): Launched 23:59:50.579271 bus /gobi_6: Setting Powered False 23:59:51.643258 run create_hlr_db(pid=32503): Terminated: ok {rc=0} 23:59:52.088166 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32505): Launched 23:59:52.407383 run osmo-hlr_10.42.42.2(pid=32506): Launched 23:59:52.529908 run osmo-stp_10.42.42.5: Starting osmo-stp 23:59:53.083408 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32508): Launched 23:59:53.402736 run osmo-stp_10.42.42.5(pid=32509): Launched 23:59:53.524429 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 23:59:54.072330 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32511): Launched 23:59:54.194241 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 23:59:54.463083 run patchelf(pid=32512): Launched 23:59:54.639733 run osmo-stp_10.42.42.5(pid=32509): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32509)] 23:59:54.775067 run osmo-stp_10.42.42.5(pid=32509): stdout: | (launched: 2022-12-09_23:59:53.345161) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:59:54.912275 run osmo-stp_10.42.42.5(pid=32509): stderr: | 20221209235953534 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235953534 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235953535 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235953535 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235953535 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235953535 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235953535 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:59:55.049909 run osmo-stp_10.42.42.5(pid=32509): stdout: | (launched: 2022-12-09_23:59:53.345161) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 23:59:55.180612 run osmo-stp_10.42.42.5(pid=32509): stderr: | 20221209235953534 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209235953534 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209235953535 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209235953535 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209235953535 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209235953535 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209235953535 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 23:59:55.336104 run patchelf(pid=32512): Terminating (SIGINT) 23:59:55.515301 run patchelf(pid=32512): Terminated: ok {rc=0} 23:59:55.644615 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32509): Process ended prematurely: osmo-stp_10.42.42.5(pid=32509) [trial-2366↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32509)] [trial-2366↪gprs:trx-lms↪iperf3.py:8] 23:59:55.655026 tst iperf3.py:8: Test FAILED (7.6 sec) 23:59:55.683952 run osmo-hlr_10.42.42.2(pid=32506): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-lms↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32506)] 23:59:55.734210 run osmo-hlr_10.42.42.2(pid=32506): stdout: | (launched: 2022-12-09_23:59:52.349581) 23:59:55.786145 run osmo-hlr_10.42.42.2(pid=32506): stderr: | 20221209235952546 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209235952546 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209235952546 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209235952547 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209235952547 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209235952547 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209235952559 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-lms/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209235952568 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209235952568 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209235952568 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 23:59:55.838343 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32501): Terminating (SIGTERM) 23:59:55.879900 run iperf3-srv_10.42.42.10(pid=32502): Terminating (SIGTERM) 23:59:55.921510 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32505): Terminating (SIGTERM) 23:59:55.963013 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32508): Terminating (SIGTERM) 23:59:56.004495 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32511): Terminating (SIGTERM) 23:59:56.046336 --- ParallelTerminationStrategy: PID 32501 died... 23:59:56.065840 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32501): Terminated: ok {rc=0} 23:59:56.112205 --- ParallelTerminationStrategy: PID 32502 died... 23:59:56.131496 run iperf3-srv_10.42.42.10(pid=32502): Terminated {rc=256} 23:59:56.177568 --- ParallelTerminationStrategy: PID 32505 died... 23:59:56.196802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32505): Terminated: ok {rc=0} 23:59:56.242880 --- ParallelTerminationStrategy: PID 32508 died... 23:59:56.262236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32508): Terminated: ok {rc=0} 23:59:56.308416 --- ParallelTerminationStrategy: PID 32511 died... 23:59:56.327799 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32511): Terminated: ok {rc=0} 23:59:56.414076 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-lms iperf3m4.py ---------------------------------------------- 23:59:57.561623 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 23:59:57.572900 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 23:59:57.619347 tst iperf3m4.py: using LAC 24578 23:59:57.736154 tst iperf3m4.py: using RAC 98 23:59:57.854217 tst iperf3m4.py: using CellId 24578 23:59:57.972774 tst iperf3m4.py: using BVCI 24579 23:59:58.080725 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 23:59:58.091555 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 23:59:58.102105 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 23:59:58.112588 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 23:59:58.123177 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 23:59:58.133838 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 23:59:58.144367 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 23:59:58.155036 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 23:59:58.165875 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 23:59:58.285415 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 23:59:58.410877 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 23:59:58.527036 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 23:59:58.645525 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 23:59:58.861450 run iperf3-srv_10.42.42.10: Starting iperf3-srv 23:59:59.180672 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32513): Launched 23:59:59.456802 run iperf3-srv_10.42.42.10(pid=32514): Launched 23:59:59.576058 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 23:59:59.790597 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:00:00.109699 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32515): Launched 00:00:00.388058 run iperf3-srv_10.42.42.10(pid=32516): Launched 00:00:00.501776 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 00:00:00.701865 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:00:01.053811 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32522): Launched 00:00:01.381707 run iperf3-srv_10.42.42.10(pid=32525): Launched 00:00:01.502642 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 00:00:01.706023 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:00:02.071744 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32533): Launched 00:00:02.393720 run iperf3-srv_10.42.42.10(pid=32534): Launched 00:00:02.545575 tst iperf3m4.py:8: start network... 00:00:02.775060 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:00:03.258815 run create_hlr_db(pid=32546): Launched 00:00:03.455347 bus /gobi_6: Setting Powered False 00:00:04.535727 run create_hlr_db(pid=32546): Terminated: ok {rc=0} 00:00:05.014336 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32559): Launched 00:00:05.376010 run osmo-hlr_10.42.42.2(pid=32560): Launched 00:00:05.576223 run osmo-stp_10.42.42.5: Starting osmo-stp 00:00:06.465773 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32575): Launched 00:00:06.843757 run osmo-stp_10.42.42.5(pid=32578): Launched 00:00:07.119708 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:00:07.680848 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32582): Launched 00:00:07.813900 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:00:08.091289 run patchelf(pid=32588): Launched 00:00:08.268165 run osmo-stp_10.42.42.5(pid=32578): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32578)] 00:00:08.403763 run osmo-stp_10.42.42.5(pid=32578): stdout: | (launched: 2022-12-10_00:00:06.773257) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:00:08.540397 run osmo-stp_10.42.42.5(pid=32578): stderr: | 20221210000007011 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000007011 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000007011 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000007012 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000007012 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000007012 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000007012 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:00:08.677967 run osmo-stp_10.42.42.5(pid=32578): stdout: | (launched: 2022-12-10_00:00:06.773257) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:00:08.808307 run osmo-stp_10.42.42.5(pid=32578): stderr: | 20221210000007011 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000007011 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000007011 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000007012 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000007012 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000007012 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000007012 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:00:08.963475 run patchelf(pid=32588): Terminating (SIGINT) 00:00:09.142211 run patchelf(pid=32588): Terminated: ok {rc=0} 00:00:09.271442 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32578): Process ended prematurely: osmo-stp_10.42.42.5(pid=32578) [trial-2366↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32578)] [trial-2366↪gprs:trx-lms↪iperf3m4.py:8] 00:00:09.281574 tst iperf3m4.py:8: Test FAILED (11.8 sec) 00:00:09.311138 run osmo-hlr_10.42.42.2(pid=32560): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-lms↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32560)] 00:00:09.361085 run osmo-hlr_10.42.42.2(pid=32560): stdout: | (launched: 2022-12-10_00:00:05.314038) 00:00:09.412890 run osmo-hlr_10.42.42.2(pid=32560): stderr: | 20221210000005655 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210000005655 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210000005655 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210000005656 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210000005656 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210000005656 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210000005693 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-lms/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210000005713 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210000005714 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210000005714 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:00:09.465255 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32513): Terminating (SIGTERM) 00:00:09.506923 run iperf3-srv_10.42.42.10(pid=32514): Terminating (SIGTERM) 00:00:09.548114 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32515): Terminating (SIGTERM) 00:00:09.589509 run iperf3-srv_10.42.42.10(pid=32516): Terminating (SIGTERM) 00:00:09.630819 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32522): Terminating (SIGTERM) 00:00:09.672592 run iperf3-srv_10.42.42.10(pid=32525): Terminating (SIGTERM) 00:00:09.714100 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32533): Terminating (SIGTERM) 00:00:09.755362 run iperf3-srv_10.42.42.10(pid=32534): Terminating (SIGTERM) 00:00:09.796553 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32559): Terminating (SIGTERM) 00:00:09.838020 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32575): Terminating (SIGTERM) 00:00:09.879289 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32582): Terminating (SIGTERM) 00:00:09.920801 --- ParallelTerminationStrategy: PID 32513 died... 00:00:09.940469 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32513): Terminated: ok {rc=0} 00:00:09.987105 --- ParallelTerminationStrategy: PID 32514 died... 00:00:10.006551 run iperf3-srv_10.42.42.10(pid=32514): Terminated {rc=256} 00:00:10.052742 --- ParallelTerminationStrategy: PID 32515 died... 00:00:10.071916 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32515): Terminated: ok {rc=0} 00:00:10.118521 --- ParallelTerminationStrategy: PID 32516 died... 00:00:10.137970 run iperf3-srv_10.42.42.10(pid=32516): Terminated {rc=256} 00:00:10.184831 --- ParallelTerminationStrategy: PID 32522 died... 00:00:10.204502 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32522): Terminated: ok {rc=0} 00:00:10.250976 --- ParallelTerminationStrategy: PID 32525 died... 00:00:10.270440 run iperf3-srv_10.42.42.10(pid=32525): Terminated {rc=256} 00:00:10.317478 --- ParallelTerminationStrategy: PID 32533 died... 00:00:10.336746 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32533): Terminated: ok {rc=0} 00:00:10.383260 --- ParallelTerminationStrategy: PID 32534 died... 00:00:10.402712 run iperf3-srv_10.42.42.10(pid=32534): Terminated {rc=256} 00:00:10.449266 --- ParallelTerminationStrategy: PID 32559 died... 00:00:10.468443 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32559): Terminated: ok {rc=0} 00:00:10.514511 --- ParallelTerminationStrategy: PID 32575 died... 00:00:10.533860 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32575): Terminated: ok {rc=0} 00:00:10.579862 --- ParallelTerminationStrategy: PID 32582 died... 00:00:10.599078 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32582): Terminated: ok {rc=0} 00:00:10.686387 bus /gobi_4: Setting Powered False 00:00:11.782789 bus /gobi_4: Setting Powered False 00:00:12.896613 bus /gobi_1: Setting Powered False 00:00:13.995242 bus /gobi_1: Setting Powered False 00:00:15.108476 bus /gobi_0: Setting Powered False 00:00:16.210375 bus /gobi_0: Setting Powered False 00:00:17.341705 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-lms ping.py ---------------------------------------------- 00:00:18.443836 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:18.454993 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 00:00:18.504404 tst ping.py: using LAC 24579 00:00:18.624015 tst ping.py: using RAC 99 00:00:18.739264 tst ping.py: using CellId 24579 00:00:18.853079 tst ping.py: using BVCI 24580 00:00:18.959748 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:18.970372 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:18.980634 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:18.990934 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:19.001237 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:19.011423 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:19.021824 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:19.032330 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 00:00:19.149258 tst ping.py:19: start network... 00:00:19.360718 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:00:19.851629 run create_hlr_db(pid=32591): Launched 00:00:19.970150 bus /gobi_6: Setting Powered False 00:00:21.032903 run create_hlr_db(pid=32591): Terminated: ok {rc=0} 00:00:21.470433 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32593): Launched 00:00:21.781559 run osmo-hlr_10.42.42.2(pid=32594): Launched 00:00:21.902129 run osmo-stp_10.42.42.5: Starting osmo-stp 00:00:22.446418 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32596): Launched 00:00:22.757587 run osmo-stp_10.42.42.5(pid=32597): Launched 00:00:22.877791 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:00:23.419496 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32599): Launched 00:00:23.538545 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:00:23.802908 run patchelf(pid=32600): Launched 00:00:23.976831 run osmo-stp_10.42.42.5(pid=32597): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32597)] 00:00:24.109175 run osmo-stp_10.42.42.5(pid=32597): stdout: | (launched: 2022-12-10_00:00:22.700854) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:00:24.243292 run osmo-stp_10.42.42.5(pid=32597): stderr: | 20221210000022891 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000022891 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000022891 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000022892 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000022892 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000022892 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000022892 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:00:24.378465 run osmo-stp_10.42.42.5(pid=32597): stdout: | (launched: 2022-12-10_00:00:22.700854) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:00:24.506772 run osmo-stp_10.42.42.5(pid=32597): stderr: | 20221210000022891 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000022891 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000022891 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000022892 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000022892 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000022892 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000022892 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:00:24.658643 run patchelf(pid=32600): Terminating (SIGINT) 00:00:24.834117 run patchelf(pid=32600): Terminated: ok {rc=0} 00:00:24.960466 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=32597): Process ended prematurely: osmo-stp_10.42.42.5(pid=32597) [trial-2366↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32597)] [trial-2366↪gprs:trx-lms↪ping.py:22] 00:00:24.970010 tst ping.py:22: Test FAILED (6.5 sec) 00:00:24.998550 run osmo-hlr_10.42.42.2(pid=32594): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-lms↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32594)] 00:00:25.048450 run osmo-hlr_10.42.42.2(pid=32594): stdout: | (launched: 2022-12-10_00:00:21.724794) 00:00:25.100019 run osmo-hlr_10.42.42.2(pid=32594): stderr: | 20221210000021921 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210000021922 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210000021922 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210000021922 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210000021922 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210000021922 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210000021935 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-lms/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210000021943 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210000021944 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210000021944 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:00:25.151886 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32593): Terminating (SIGTERM) 00:00:25.193421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32596): Terminating (SIGTERM) 00:00:25.234910 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32599): Terminating (SIGTERM) 00:00:25.276575 --- ParallelTerminationStrategy: PID 32593 died... 00:00:25.296724 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32593): Terminated: ok {rc=0} 00:00:25.342973 --- ParallelTerminationStrategy: PID 32596 died... 00:00:25.362442 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32596): Terminated: ok {rc=0} 00:00:25.408461 --- ParallelTerminationStrategy: PID 32599 died... 00:00:25.427848 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32599): Terminated: ok {rc=0} 00:00:25.515121 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-lms ping_idle_ping.py ---------------------------------------------- 00:00:26.600039 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:26.611193 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 00:00:26.660616 tst ping_idle_ping.py: using LAC 24580 00:00:26.783111 tst ping_idle_ping.py: using RAC 100 00:00:26.899618 tst ping_idle_ping.py: using CellId 24580 00:00:27.014490 tst ping_idle_ping.py: using BVCI 24581 00:00:27.122186 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:27.132827 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:27.143268 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:27.153608 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:27.163868 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:27.174094 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:27.184410 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 00:00:27.194768 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 00:00:27.311831 tst ping_idle_ping.py:24: start network... 00:00:27.508880 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:00:27.965464 run create_hlr_db(pid=32601): Launched 00:00:28.085813 bus /gobi_6: Setting Powered False 00:00:29.145084 run create_hlr_db(pid=32601): Terminated: ok {rc=0} 00:00:29.554619 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32603): Launched 00:00:29.848550 run osmo-hlr_10.42.42.2(pid=32604): Launched 00:00:29.960318 run osmo-stp_10.42.42.5: Starting osmo-stp 00:00:30.464407 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32606): Launched 00:00:30.756665 run osmo-stp_10.42.42.5(pid=32607): Launched 00:00:30.922874 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:00:31.513740 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32609): Launched 00:00:31.635999 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:00:31.891651 run patchelf(pid=32610): Launched 00:00:32.068476 run osmo-stp_10.42.42.5(pid=32607): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32607)] 00:00:32.194900 run osmo-stp_10.42.42.5(pid=32607): stdout: | (launched: 2022-12-10_00:00:30.703048) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:00:32.322116 run osmo-stp_10.42.42.5(pid=32607): stderr: | 20221210000030907 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000030907 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000030908 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000030908 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000030912 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000030912 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000030912 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:00:32.447953 run osmo-stp_10.42.42.5(pid=32607): stdout: | (launched: 2022-12-10_00:00:30.703048) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:00:32.567593 run osmo-stp_10.42.42.5(pid=32607): stderr: | 20221210000030907 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000030907 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000030908 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000030908 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000030912 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000030912 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000030912 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:00:32.709637 run patchelf(pid=32610): Terminating (SIGINT) 00:00:32.873580 run patchelf(pid=32610): Terminated: ok {rc=0} 00:00:32.992239 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=32607): Process ended prematurely: osmo-stp_10.42.42.5(pid=32607) [trial-2366↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32607)] [trial-2366↪gprs:trx-lms↪ping_idle_ping.py:27] 00:00:33.001504 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 00:00:33.028028 run osmo-hlr_10.42.42.2(pid=32604): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-lms↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32604)] 00:00:33.075477 run osmo-hlr_10.42.42.2(pid=32604): stdout: | (launched: 2022-12-10_00:00:29.794539) 00:00:33.124180 run osmo-hlr_10.42.42.2(pid=32604): stderr: | 20221210000029970 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210000029970 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210000029970 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210000029970 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210000029970 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210000029970 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210000029983 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-lms/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210000029991 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210000029991 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210000029991 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:00:33.173439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32603): Terminating (SIGTERM) 00:00:33.212572 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32606): Terminating (SIGTERM) 00:00:33.251568 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32609): Terminating (SIGTERM) 00:00:33.290922 --- ParallelTerminationStrategy: PID 32603 died... 00:00:33.309456 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32603): Terminated: ok {rc=0} 00:00:33.352728 --- ParallelTerminationStrategy: PID 32606 died... 00:00:33.371226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32606): Terminated: ok {rc=0} 00:00:33.414431 --- ParallelTerminationStrategy: PID 32609 died... 00:00:33.432644 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32609): Terminated: ok {rc=0} 00:00:33.516932 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2366 gprs:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 gprs:trx-lms+mod-bts0-egprs --------------------------------------------------------------------- 00:00:34.808939 tst gprs:trx-lms+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:00:34.814102 tst gprs:trx-lms+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 00:00:34.846850 tst gprs:trx-lms+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 00:00:34.885232 tst gprs:trx-lms+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 00:00:34.970292 tst gprs:trx-lms+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 00:00:35.003006 tst gprs:trx-lms+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 00:00:35.041336 tst gprs:trx-lms+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 00:00:35.640131 tst gprs:trx-lms+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2366 gprs:trx-lms+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 00:00:35.692176 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:00:35.703457 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:00:35.757442 tst cs_paging_gprs_active.py: using LAC 24581 00:00:35.875099 tst cs_paging_gprs_active.py: using RAC 101 00:00:35.991598 tst cs_paging_gprs_active.py: using CellId 24581 00:00:36.117579 tst cs_paging_gprs_active.py: using BVCI 24582 00:00:36.233843 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:00:36.245165 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:00:36.256147 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:00:36.267424 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:00:36.278648 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:00:36.289849 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:00:36.301239 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:00:36.312597 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:00:36.324065 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:00:36.442767 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:00:36.557562 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 00:00:36.771094 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:00:37.093273 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32615): Launched 00:00:37.372347 run iperf3-srv_10.42.42.10(pid=32616): Launched 00:00:37.492278 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 00:00:37.708889 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:00:38.030637 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32617): Launched 00:00:38.310107 run iperf3-srv_10.42.42.10(pid=32618): Launched 00:00:38.430481 tst cs_paging_gprs_active.py:38: start network... 00:00:38.647385 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:00:39.143393 run create_hlr_db(pid=32619): Launched 00:00:39.264551 bus /gobi_6: Setting Powered False 00:00:40.328649 run create_hlr_db(pid=32619): Terminated: ok {rc=0} 00:00:40.756304 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32621): Launched 00:00:41.055148 run osmo-hlr_10.42.42.2(pid=32622): Launched 00:00:41.169176 run osmo-stp_10.42.42.5: Starting osmo-stp 00:00:41.696314 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32624): Launched 00:00:41.995488 run osmo-stp_10.42.42.5(pid=32625): Launched 00:00:42.109135 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:00:42.623095 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32627): Launched 00:00:42.737256 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:00:42.989554 run patchelf(pid=32628): Launched 00:00:43.158097 run osmo-stp_10.42.42.5(pid=32625): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32625)] 00:00:43.284723 run osmo-stp_10.42.42.5(pid=32625): stdout: | (launched: 2022-12-10_00:00:41.940706) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:00:43.413473 run osmo-stp_10.42.42.5(pid=32625): stderr: | 20221210000042111 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000042112 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000042112 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000042112 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000042113 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000042113 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000042113 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:00:43.542294 run osmo-stp_10.42.42.5(pid=32625): stdout: | (launched: 2022-12-10_00:00:41.940706) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:00:43.664704 run osmo-stp_10.42.42.5(pid=32625): stderr: | 20221210000042111 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000042112 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000042112 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000042112 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000042113 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000042113 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000042113 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:00:43.810316 run patchelf(pid=32628): Terminating (SIGINT) 00:00:43.978264 run patchelf(pid=32628): Terminated: ok {rc=0} 00:00:44.099528 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=32625): Process ended prematurely: osmo-stp_10.42.42.5(pid=32625) [trial-2366↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32625)] [trial-2366↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 00:00:44.109250 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 00:00:44.136023 run osmo-hlr_10.42.42.2(pid=32622): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32622)] 00:00:44.183010 run osmo-hlr_10.42.42.2(pid=32622): stdout: | (launched: 2022-12-10_00:00:41.000251) 00:00:44.231615 run osmo-hlr_10.42.42.2(pid=32622): stderr: | 20221210000041176 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210000041176 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210000041176 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210000041176 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210000041176 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210000041176 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210000041188 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-lms+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210000041197 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210000041197 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210000041197 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:00:44.280732 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32615): Terminating (SIGTERM) 00:00:44.319979 run iperf3-srv_10.42.42.10(pid=32616): Terminating (SIGTERM) 00:00:44.359946 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32617): Terminating (SIGTERM) 00:00:44.403044 run iperf3-srv_10.42.42.10(pid=32618): Terminating (SIGTERM) 00:00:44.444447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32621): Terminating (SIGTERM) 00:00:44.486041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32624): Terminating (SIGTERM) 00:00:44.527526 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32627): Terminating (SIGTERM) 00:00:44.569535 --- ParallelTerminationStrategy: PID 32615 died... 00:00:44.589349 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32615): Terminated: ok {rc=0} 00:00:44.636240 --- ParallelTerminationStrategy: PID 32616 died... 00:00:44.655624 run iperf3-srv_10.42.42.10(pid=32616): Terminated {rc=256} 00:00:44.701766 --- ParallelTerminationStrategy: PID 32617 died... 00:00:44.721334 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32617): Terminated: ok {rc=0} 00:00:44.767447 --- ParallelTerminationStrategy: PID 32618 died... 00:00:44.786980 run iperf3-srv_10.42.42.10(pid=32618): Terminated {rc=256} 00:00:44.832893 --- ParallelTerminationStrategy: PID 32621 died... 00:00:44.852593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32621): Terminated: ok {rc=0} 00:00:44.898983 --- ParallelTerminationStrategy: PID 32624 died... 00:00:44.918381 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32624): Terminated: ok {rc=0} 00:00:44.964673 --- ParallelTerminationStrategy: PID 32627 died... 00:00:44.984003 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32627): Terminated: ok {rc=0} 00:00:45.071139 bus /gobi_0: Setting Powered False 00:00:46.170663 bus /gobi_0: Setting Powered False 00:00:47.289408 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-lms+mod-bts0-egprs iperf3.py ---------------------------------------------- 00:00:48.437929 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:00:48.449803 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:00:48.501356 tst iperf3.py: using LAC 24582 00:00:48.627535 tst iperf3.py: using RAC 102 00:00:48.752342 tst iperf3.py: using CellId 24582 00:00:48.877287 tst iperf3.py: using BVCI 24583 00:00:48.993023 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:00:49.004308 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:00:49.015428 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:00:49.026831 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:00:49.038152 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:00:49.049375 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:00:49.060808 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:00:49.071992 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:00:49.083453 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:00:49.203011 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 00:00:49.419127 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:00:49.738634 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32629): Launched 00:00:50.015367 run iperf3-srv_10.42.42.10(pid=32630): Launched 00:00:50.135280 tst iperf3.py:8: start network... 00:00:50.351471 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:00:50.845213 run create_hlr_db(pid=32631): Launched 00:00:50.966014 bus /gobi_6: Setting Powered False 00:00:52.030243 run create_hlr_db(pid=32631): Terminated: ok {rc=0} 00:00:52.456214 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32633): Launched 00:00:52.753650 run osmo-hlr_10.42.42.2(pid=32634): Launched 00:00:52.867517 run osmo-stp_10.42.42.5: Starting osmo-stp 00:00:53.396173 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32636): Launched 00:00:53.692826 run osmo-stp_10.42.42.5(pid=32637): Launched 00:00:53.805704 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:00:54.318649 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32639): Launched 00:00:54.431945 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:00:54.683072 run patchelf(pid=32640): Launched 00:00:54.848433 run osmo-stp_10.42.42.5(pid=32637): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32637)] 00:00:54.973919 run osmo-stp_10.42.42.5(pid=32637): stdout: | (launched: 2022-12-10_00:00:53.638525) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:00:55.101523 run osmo-stp_10.42.42.5(pid=32637): stderr: | 20221210000053808 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000053808 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000053808 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000053808 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000053811 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000053811 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000053811 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:00:55.230531 run osmo-stp_10.42.42.5(pid=32637): stdout: | (launched: 2022-12-10_00:00:53.638525) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:00:55.352529 run osmo-stp_10.42.42.5(pid=32637): stderr: | 20221210000053808 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000053808 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000053808 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000053808 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000053811 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000053811 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000053811 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:00:55.496706 run patchelf(pid=32640): Terminating (SIGINT) 00:00:55.663292 run patchelf(pid=32640): Terminated: ok {rc=0} 00:00:55.783865 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32637): Process ended prematurely: osmo-stp_10.42.42.5(pid=32637) [trial-2366↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32637)] [trial-2366↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8] 00:00:55.793342 tst iperf3.py:8: Test FAILED (7.4 sec) 00:00:55.820259 run osmo-hlr_10.42.42.2(pid=32634): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32634)] 00:00:55.867259 run osmo-hlr_10.42.42.2(pid=32634): stdout: | (launched: 2022-12-10_00:00:52.699103) 00:00:55.916202 run osmo-hlr_10.42.42.2(pid=32634): stderr: | 20221210000052876 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210000052876 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210000052876 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210000052876 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210000052876 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210000052876 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210000052889 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-lms+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210000052897 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210000052898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210000052898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:00:55.965665 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32629): Terminating (SIGTERM) 00:00:56.004848 run iperf3-srv_10.42.42.10(pid=32630): Terminating (SIGTERM) 00:00:56.044174 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32633): Terminating (SIGTERM) 00:00:56.083549 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32636): Terminating (SIGTERM) 00:00:56.123080 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32639): Terminating (SIGTERM) 00:00:56.162653 --- ParallelTerminationStrategy: PID 32629 died... 00:00:56.181265 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32629): Terminated: ok {rc=0} 00:00:56.225366 --- ParallelTerminationStrategy: PID 32630 died... 00:00:56.244009 run iperf3-srv_10.42.42.10(pid=32630): Terminated {rc=256} 00:00:56.287554 --- ParallelTerminationStrategy: PID 32633 died... 00:00:56.306258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32633): Terminated: ok {rc=0} 00:00:56.350007 --- ParallelTerminationStrategy: PID 32636 died... 00:00:56.368383 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32636): Terminated: ok {rc=0} 00:00:56.412091 --- ParallelTerminationStrategy: PID 32639 died... 00:00:56.430696 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32639): Terminated: ok {rc=0} 00:00:56.516293 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-lms+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 00:00:57.663257 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:00:57.674726 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:00:57.725355 tst iperf3m4.py: using LAC 24583 00:00:57.844542 tst iperf3m4.py: using RAC 103 00:00:57.963509 tst iperf3m4.py: using CellId 24583 00:00:58.082319 tst iperf3m4.py: using BVCI 24584 00:00:58.189753 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:00:58.200410 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:00:58.211000 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:00:58.221466 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:00:58.231840 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:00:58.242382 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:00:58.253012 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:00:58.263376 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:00:58.273973 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:00:58.389208 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:00:58.510752 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:00:58.631655 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:00:58.749142 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 00:00:58.951572 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:00:59.251771 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32641): Launched 00:00:59.512618 run iperf3-srv_10.42.42.10(pid=32642): Launched 00:00:59.624787 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 00:00:59.825381 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:01:00.124707 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32643): Launched 00:01:00.383890 run iperf3-srv_10.42.42.10(pid=32644): Launched 00:01:00.495171 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 00:01:00.694367 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:01:01.015834 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32645): Launched 00:01:01.295953 run iperf3-srv_10.42.42.10(pid=32646): Launched 00:01:01.418788 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 00:01:01.622066 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:01:01.937714 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32647): Launched 00:01:02.210806 run iperf3-srv_10.42.42.10(pid=32648): Launched 00:01:02.339266 tst iperf3m4.py:8: start network... 00:01:02.539086 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:01:03.001913 run create_hlr_db(pid=32649): Launched 00:01:03.123609 bus /gobi_6: Setting Powered False 00:01:04.183086 run create_hlr_db(pid=32649): Terminated: ok {rc=0} 00:01:04.619775 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32651): Launched 00:01:04.940438 run osmo-hlr_10.42.42.2(pid=32652): Launched 00:01:05.062453 run osmo-stp_10.42.42.5: Starting osmo-stp 00:01:05.619682 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32654): Launched 00:01:05.939099 run osmo-stp_10.42.42.5(pid=32655): Launched 00:01:06.061683 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:01:06.612272 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32657): Launched 00:01:06.734738 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:01:07.004264 run patchelf(pid=32658): Launched 00:01:07.182368 run osmo-stp_10.42.42.5(pid=32655): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32655)] 00:01:07.318293 run osmo-stp_10.42.42.5(pid=32655): stdout: | (launched: 2022-12-10_00:01:05.881156) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:01:07.456629 run osmo-stp_10.42.42.5(pid=32655): stderr: | 20221210000106072 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000106072 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000106072 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000106073 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000106073 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000106073 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000106073 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:01:07.594910 run osmo-stp_10.42.42.5(pid=32655): stdout: | (launched: 2022-12-10_00:01:05.881156) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:01:07.726335 run osmo-stp_10.42.42.5(pid=32655): stderr: | 20221210000106072 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000106072 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000106072 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000106073 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000106073 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000106073 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000106073 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:01:07.881979 run patchelf(pid=32658): Terminating (SIGINT) 00:01:08.061905 run patchelf(pid=32658): Terminated: ok {rc=0} 00:01:08.191569 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32655): Process ended prematurely: osmo-stp_10.42.42.5(pid=32655) [trial-2366↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32655)] [trial-2366↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8] 00:01:08.201706 tst iperf3m4.py:8: Test FAILED (10.6 sec) 00:01:08.231205 run osmo-hlr_10.42.42.2(pid=32652): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32652)] 00:01:08.281920 run osmo-hlr_10.42.42.2(pid=32652): stdout: | (launched: 2022-12-10_00:01:04.882314) 00:01:08.334854 run osmo-hlr_10.42.42.2(pid=32652): stderr: | 20221210000105080 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210000105080 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210000105080 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210000105080 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210000105080 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210000105080 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210000105092 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-lms+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210000105101 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210000105101 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210000105101 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:01:08.387770 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32641): Terminating (SIGTERM) 00:01:08.430059 run iperf3-srv_10.42.42.10(pid=32642): Terminating (SIGTERM) 00:01:08.472136 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32643): Terminating (SIGTERM) 00:01:08.514576 run iperf3-srv_10.42.42.10(pid=32644): Terminating (SIGTERM) 00:01:08.556616 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32645): Terminating (SIGTERM) 00:01:08.598747 run iperf3-srv_10.42.42.10(pid=32646): Terminating (SIGTERM) 00:01:08.640650 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32647): Terminating (SIGTERM) 00:01:08.682872 run iperf3-srv_10.42.42.10(pid=32648): Terminating (SIGTERM) 00:01:08.724805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32651): Terminating (SIGTERM) 00:01:08.766981 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32654): Terminating (SIGTERM) 00:01:08.809038 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32657): Terminating (SIGTERM) 00:01:08.851282 --- ParallelTerminationStrategy: PID 32641 died... 00:01:08.871349 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32641): Terminated: ok {rc=0} 00:01:08.918523 --- ParallelTerminationStrategy: PID 32642 died... 00:01:08.938158 run iperf3-srv_10.42.42.10(pid=32642): Terminated {rc=256} 00:01:08.984727 --- ParallelTerminationStrategy: PID 32643 died... 00:01:09.004371 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32643): Terminated: ok {rc=0} 00:01:09.050988 --- ParallelTerminationStrategy: PID 32644 died... 00:01:09.070496 run iperf3-srv_10.42.42.10(pid=32644): Terminated {rc=256} 00:01:09.117491 --- ParallelTerminationStrategy: PID 32645 died... 00:01:09.136762 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32645): Terminated: ok {rc=0} 00:01:09.183563 --- ParallelTerminationStrategy: PID 32646 died... 00:01:09.202929 run iperf3-srv_10.42.42.10(pid=32646): Terminated {rc=256} 00:01:09.249352 --- ParallelTerminationStrategy: PID 32647 died... 00:01:09.268743 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32647): Terminated: ok {rc=0} 00:01:09.315179 --- ParallelTerminationStrategy: PID 32648 died... 00:01:09.334976 run iperf3-srv_10.42.42.10(pid=32648): Terminated {rc=256} 00:01:09.381532 --- ParallelTerminationStrategy: PID 32651 died... 00:01:09.401128 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32651): Terminated: ok {rc=0} 00:01:09.447602 --- ParallelTerminationStrategy: PID 32654 died... 00:01:09.467108 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32654): Terminated: ok {rc=0} 00:01:09.513672 --- ParallelTerminationStrategy: PID 32657 died... 00:01:09.533250 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32657): Terminated: ok {rc=0} 00:01:09.621097 bus /gobi_4: Setting Powered False 00:01:10.720160 bus /gobi_4: Setting Powered False 00:01:11.838346 bus /gobi_1: Setting Powered False 00:01:12.938410 bus /gobi_1: Setting Powered False 00:01:14.055273 bus /gobi_0: Setting Powered False 00:01:15.153183 bus /gobi_0: Setting Powered False 00:01:16.274560 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-lms+mod-bts0-egprs ping.py ---------------------------------------------- 00:01:17.386575 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:17.397980 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:01:17.447869 tst ping.py: using LAC 24584 00:01:17.565935 tst ping.py: using RAC 104 00:01:17.691057 tst ping.py: using CellId 24584 00:01:17.817456 tst ping.py: using BVCI 24585 00:01:17.932826 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:17.944193 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:17.955381 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:17.966714 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:17.978471 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:17.989788 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:18.001324 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:18.012562 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:01:18.130822 tst ping.py:19: start network... 00:01:18.343804 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:01:18.829965 run create_hlr_db(pid=32659): Launched 00:01:18.949333 bus /gobi_6: Setting Powered False 00:01:20.012173 run create_hlr_db(pid=32659): Terminated: ok {rc=0} 00:01:20.434367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32661): Launched 00:01:20.748272 run osmo-hlr_10.42.42.2(pid=32662): Launched 00:01:20.868480 run osmo-stp_10.42.42.5: Starting osmo-stp 00:01:21.415265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32664): Launched 00:01:21.728348 run osmo-stp_10.42.42.5(pid=32665): Launched 00:01:21.848434 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:01:22.391350 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32667): Launched 00:01:22.511268 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:01:22.775887 run patchelf(pid=32668): Launched 00:01:22.939491 run osmo-stp_10.42.42.5(pid=32665): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32665)] 00:01:23.064038 run osmo-stp_10.42.42.5(pid=32665): stdout: | (launched: 2022-12-10_00:01:21.671498) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:01:23.190869 run osmo-stp_10.42.42.5(pid=32665): stderr: | 20221210000121862 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000121862 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000121863 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000121863 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000121865 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000121865 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000121865 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:01:23.317407 run osmo-stp_10.42.42.5(pid=32665): stdout: | (launched: 2022-12-10_00:01:21.671498) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:01:23.438836 run osmo-stp_10.42.42.5(pid=32665): stderr: | 20221210000121862 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000121862 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000121863 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000121863 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000121865 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000121865 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000121865 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:01:23.582177 run patchelf(pid=32668): Terminating (SIGINT) 00:01:23.746870 run patchelf(pid=32668): Terminated: ok {rc=0} 00:01:23.865995 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=32665): Process ended prematurely: osmo-stp_10.42.42.5(pid=32665) [trial-2366↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32665)] [trial-2366↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22] 00:01:23.874809 tst ping.py:22: Test FAILED (6.5 sec) 00:01:23.901765 run osmo-hlr_10.42.42.2(pid=32662): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-lms+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32662)] 00:01:23.949428 run osmo-hlr_10.42.42.2(pid=32662): stdout: | (launched: 2022-12-10_00:01:20.691277) 00:01:23.998567 run osmo-hlr_10.42.42.2(pid=32662): stderr: | 20221210000120887 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210000120887 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210000120887 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210000120887 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210000120887 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210000120887 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210000120899 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-lms+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210000120907 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210000120908 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210000120908 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:01:24.048141 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32661): Terminating (SIGTERM) 00:01:24.087705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32664): Terminating (SIGTERM) 00:01:24.127366 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32667): Terminating (SIGTERM) 00:01:24.167148 --- ParallelTerminationStrategy: PID 32661 died... 00:01:24.186150 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32661): Terminated: ok {rc=0} 00:01:24.229942 --- ParallelTerminationStrategy: PID 32664 died... 00:01:24.248597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32664): Terminated: ok {rc=0} 00:01:24.292583 --- ParallelTerminationStrategy: PID 32667 died... 00:01:24.311404 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32667): Terminated: ok {rc=0} 00:01:24.394918 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-lms+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 00:01:25.481548 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:25.493643 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:01:25.550179 tst ping_idle_ping.py: using LAC 24585 00:01:25.666213 tst ping_idle_ping.py: using RAC 105 00:01:25.791753 tst ping_idle_ping.py: using CellId 24585 00:01:25.917423 tst ping_idle_ping.py: using BVCI 24586 00:01:26.032315 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:26.043866 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:26.055161 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:26.066755 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:26.078256 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:26.090030 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:26.101693 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:01:26.112881 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:01:26.227838 tst ping_idle_ping.py:24: start network... 00:01:26.426640 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:01:26.885199 run create_hlr_db(pid=32669): Launched 00:01:27.005475 bus /gobi_6: Setting Powered False 00:01:28.065067 run create_hlr_db(pid=32669): Terminated: ok {rc=0} 00:01:28.495175 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32671): Launched 00:01:28.810762 run osmo-hlr_10.42.42.2(pid=32672): Launched 00:01:28.932185 run osmo-stp_10.42.42.5: Starting osmo-stp 00:01:29.477878 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32674): Launched 00:01:29.792396 run osmo-stp_10.42.42.5(pid=32675): Launched 00:01:29.913222 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:01:30.458045 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32677): Launched 00:01:30.578723 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:01:30.861084 run patchelf(pid=32678): Launched 00:01:31.057986 run osmo-stp_10.42.42.5(pid=32675): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32675)] 00:01:31.195008 run osmo-stp_10.42.42.5(pid=32675): stdout: | (launched: 2022-12-10_00:01:29.735108) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:01:31.334850 run osmo-stp_10.42.42.5(pid=32675): stderr: | 20221210000129924 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000129924 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000129924 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000129925 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000129927 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000129927 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000129927 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:01:31.474290 run osmo-stp_10.42.42.5(pid=32675): stdout: | (launched: 2022-12-10_00:01:29.735108) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:01:31.607136 run osmo-stp_10.42.42.5(pid=32675): stderr: | 20221210000129924 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000129924 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000129924 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000129925 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000129927 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000129927 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000129927 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:01:31.764402 run patchelf(pid=32678): Terminating (SIGINT) 00:01:31.945654 run patchelf(pid=32678): Terminated: ok {rc=0} 00:01:32.076459 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=32675): Process ended prematurely: osmo-stp_10.42.42.5(pid=32675) [trial-2366↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32675)] [trial-2366↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27] 00:01:32.087224 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 00:01:32.118959 run osmo-hlr_10.42.42.2(pid=32672): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32672)] 00:01:32.171379 run osmo-hlr_10.42.42.2(pid=32672): stdout: | (launched: 2022-12-10_00:01:28.753590) 00:01:32.223927 run osmo-hlr_10.42.42.2(pid=32672): stderr: | 20221210000128948 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210000128948 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210000128948 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210000128948 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210000128948 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210000128948 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210000128959 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-lms+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210000128968 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210000128969 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210000128969 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:01:32.276783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32671): Terminating (SIGTERM) 00:01:32.319145 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32674): Terminating (SIGTERM) 00:01:32.361957 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32677): Terminating (SIGTERM) 00:01:32.404674 --- ParallelTerminationStrategy: PID 32671 died... 00:01:32.424848 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32671): Terminated: ok {rc=0} 00:01:32.472161 --- ParallelTerminationStrategy: PID 32674 died... 00:01:32.492036 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32674): Terminated: ok {rc=0} 00:01:32.539004 --- ParallelTerminationStrategy: PID 32677 died... 00:01:32.558770 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32677): Terminated: ok {rc=0} 00:01:32.646961 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2366 gprs:trx-lms+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 gprs:trx-lms+mod-bts0-dynts-ipa --------------------------------------------------------------------- 00:01:33.953875 tst gprs:trx-lms+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:01:33.960365 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 00:01:33.993118 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 00:01:34.031239 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 00:01:34.115352 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 00:01:34.147821 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 00:01:34.186002 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 00:01:34.781584 tst gprs:trx-lms+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2366 gprs:trx-lms+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 00:01:34.829972 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:01:34.840750 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:01:34.907889 tst cs_paging_gprs_active.py: using LAC 24586 00:01:35.034040 tst cs_paging_gprs_active.py: using RAC 106 00:01:35.159607 tst cs_paging_gprs_active.py: using CellId 24586 00:01:35.283583 tst cs_paging_gprs_active.py: using BVCI 24587 00:01:35.402605 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:01:35.414192 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:01:35.425496 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:01:35.436711 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:01:35.447950 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:01:35.459284 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:01:35.470723 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:01:35.481852 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:01:35.493454 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:01:35.612801 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:01:35.728437 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 00:01:35.930091 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:01:36.230530 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32683): Launched 00:01:36.491045 run iperf3-srv_10.42.42.10(pid=32684): Launched 00:01:36.602621 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 00:01:36.802433 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:01:37.101767 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32685): Launched 00:01:37.361802 run iperf3-srv_10.42.42.10(pid=32686): Launched 00:01:37.472886 tst cs_paging_gprs_active.py:38: start network... 00:01:37.674431 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:01:38.136449 run create_hlr_db(pid=32687): Launched 00:01:38.258274 bus /gobi_6: Setting Powered False 00:01:39.318626 run create_hlr_db(pid=32687): Terminated: ok {rc=0} 00:01:39.755707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32689): Launched 00:01:40.076836 run osmo-hlr_10.42.42.2(pid=32690): Launched 00:01:40.199603 run osmo-stp_10.42.42.5: Starting osmo-stp 00:01:40.749182 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32692): Launched 00:01:41.068623 run osmo-stp_10.42.42.5(pid=32693): Launched 00:01:41.190417 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:01:41.741991 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32695): Launched 00:01:41.864828 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:01:42.141901 run patchelf(pid=32696): Launched 00:01:42.320018 run osmo-stp_10.42.42.5(pid=32693): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32693)] 00:01:42.455781 run osmo-stp_10.42.42.5(pid=32693): stdout: | (launched: 2022-12-10_00:01:41.010506) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:01:42.593403 run osmo-stp_10.42.42.5(pid=32693): stderr: | 20221210000141204 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000141204 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000141204 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000141205 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000141205 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000141205 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000141205 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:01:42.730751 run osmo-stp_10.42.42.5(pid=32693): stdout: | (launched: 2022-12-10_00:01:41.010506) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:01:42.861947 run osmo-stp_10.42.42.5(pid=32693): stderr: | 20221210000141204 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000141204 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000141204 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000141205 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000141205 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000141205 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000141205 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:01:43.017658 run patchelf(pid=32696): Terminating (SIGINT) 00:01:43.198089 run patchelf(pid=32696): Terminated: ok {rc=0} 00:01:43.327905 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=32693): Process ended prematurely: osmo-stp_10.42.42.5(pid=32693) [trial-2366↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32693)] [trial-2366↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 00:01:43.338712 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 00:01:43.368065 run osmo-hlr_10.42.42.2(pid=32690): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32690)] 00:01:43.418876 run osmo-hlr_10.42.42.2(pid=32690): stdout: | (launched: 2022-12-10_00:01:40.018493) 00:01:43.471069 run osmo-hlr_10.42.42.2(pid=32690): stderr: | 20221210000140218 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210000140218 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210000140219 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210000140219 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210000140219 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210000140219 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210000140231 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-lms+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210000140241 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210000140241 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210000140241 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:01:43.523198 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32683): Terminating (SIGTERM) 00:01:43.564858 run iperf3-srv_10.42.42.10(pid=32684): Terminating (SIGTERM) 00:01:43.607007 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32685): Terminating (SIGTERM) 00:01:43.649240 run iperf3-srv_10.42.42.10(pid=32686): Terminating (SIGTERM) 00:01:43.690955 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32689): Terminating (SIGTERM) 00:01:43.732592 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32692): Terminating (SIGTERM) 00:01:43.774266 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32695): Terminating (SIGTERM) 00:01:43.816200 --- ParallelTerminationStrategy: PID 32683 died... 00:01:43.835933 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32683): Terminated: ok {rc=0} 00:01:43.882664 --- ParallelTerminationStrategy: PID 32684 died... 00:01:43.902148 run iperf3-srv_10.42.42.10(pid=32684): Terminated {rc=256} 00:01:43.948764 --- ParallelTerminationStrategy: PID 32685 died... 00:01:43.968178 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32685): Terminated: ok {rc=0} 00:01:44.014394 --- ParallelTerminationStrategy: PID 32686 died... 00:01:44.033843 run iperf3-srv_10.42.42.10(pid=32686): Terminated {rc=256} 00:01:44.079942 --- ParallelTerminationStrategy: PID 32689 died... 00:01:44.099614 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32689): Terminated: ok {rc=0} 00:01:44.145734 --- ParallelTerminationStrategy: PID 32692 died... 00:01:44.165178 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32692): Terminated: ok {rc=0} 00:01:44.211421 --- ParallelTerminationStrategy: PID 32695 died... 00:01:44.230883 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32695): Terminated: ok {rc=0} 00:01:44.318445 bus /gobi_0: Setting Powered False 00:01:45.417753 bus /gobi_0: Setting Powered False 00:01:46.537277 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-lms+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 00:01:47.690337 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:01:47.702206 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:01:47.776255 tst iperf3.py: using LAC 24587 00:01:47.901737 tst iperf3.py: using RAC 107 00:01:48.025346 tst iperf3.py: using CellId 24587 00:01:48.148837 tst iperf3.py: using BVCI 24588 00:01:48.264449 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:01:48.275802 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:01:48.286915 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:01:48.298161 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:01:48.309453 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:01:48.320654 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:01:48.332197 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:01:48.344348 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:01:48.355938 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:01:48.472569 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 00:01:48.675638 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:01:48.976495 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32697): Launched 00:01:49.237529 run iperf3-srv_10.42.42.10(pid=32698): Launched 00:01:49.350553 tst iperf3.py:8: start network... 00:01:49.552653 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:01:50.018549 run create_hlr_db(pid=32699): Launched 00:01:50.141406 bus /gobi_6: Setting Powered False 00:01:51.201350 run create_hlr_db(pid=32699): Terminated: ok {rc=0} 00:01:51.617593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32701): Launched 00:01:51.917634 run osmo-hlr_10.42.42.2(pid=32702): Launched 00:01:52.032333 run osmo-stp_10.42.42.5: Starting osmo-stp 00:01:52.571250 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32704): Launched 00:01:52.869485 run osmo-stp_10.42.42.5(pid=32705): Launched 00:01:52.983715 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:01:53.500649 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32707): Launched 00:01:53.614621 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:01:53.867809 run patchelf(pid=32708): Launched 00:01:54.033896 run osmo-stp_10.42.42.5(pid=32705): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32705)] 00:01:54.159920 run osmo-stp_10.42.42.5(pid=32705): stdout: | (launched: 2022-12-10_00:01:52.814706) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:01:54.288160 run osmo-stp_10.42.42.5(pid=32705): stderr: | 20221210000152984 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000152984 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000152984 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000152985 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000152987 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000152987 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000152987 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:01:54.416370 run osmo-stp_10.42.42.5(pid=32705): stdout: | (launched: 2022-12-10_00:01:52.814706) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:01:54.538493 run osmo-stp_10.42.42.5(pid=32705): stderr: | 20221210000152984 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000152984 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000152984 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000152985 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000152987 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000152987 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000152987 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:01:54.683235 run patchelf(pid=32708): Terminating (SIGINT) 00:01:54.851222 run patchelf(pid=32708): Terminated: ok {rc=0} 00:01:54.972173 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32705): Process ended prematurely: osmo-stp_10.42.42.5(pid=32705) [trial-2366↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32705)] [trial-2366↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8] 00:01:54.981613 tst iperf3.py:8: Test FAILED (7.3 sec) 00:01:55.008710 run osmo-hlr_10.42.42.2(pid=32702): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32702)] 00:01:55.055939 run osmo-hlr_10.42.42.2(pid=32702): stdout: | (launched: 2022-12-10_00:01:51.863019) 00:01:55.105089 run osmo-hlr_10.42.42.2(pid=32702): stderr: | 20221210000152040 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210000152040 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210000152040 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210000152041 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210000152041 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210000152041 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210000152054 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210000152062 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210000152063 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210000152063 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:01:55.154707 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32697): Terminating (SIGTERM) 00:01:55.194452 run iperf3-srv_10.42.42.10(pid=32698): Terminating (SIGTERM) 00:01:55.234139 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32701): Terminating (SIGTERM) 00:01:55.273852 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32704): Terminating (SIGTERM) 00:01:55.313377 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32707): Terminating (SIGTERM) 00:01:55.353276 --- ParallelTerminationStrategy: PID 32697 died... 00:01:55.372057 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32697): Terminated: ok {rc=0} 00:01:55.415915 --- ParallelTerminationStrategy: PID 32698 died... 00:01:55.434603 run iperf3-srv_10.42.42.10(pid=32698): Terminated {rc=256} 00:01:55.478067 --- ParallelTerminationStrategy: PID 32701 died... 00:01:55.496543 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32701): Terminated: ok {rc=0} 00:01:55.539846 --- ParallelTerminationStrategy: PID 32704 died... 00:01:55.558347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32704): Terminated: ok {rc=0} 00:01:55.601471 --- ParallelTerminationStrategy: PID 32707 died... 00:01:55.619944 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32707): Terminated: ok {rc=0} 00:01:55.704438 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-lms+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 00:01:56.851504 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:01:56.862823 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:01:56.932440 tst iperf3m4.py: using LAC 24588 00:01:57.051448 tst iperf3m4.py: using RAC 108 00:01:57.169991 tst iperf3m4.py: using CellId 24588 00:01:57.297136 tst iperf3m4.py: using BVCI 24589 00:01:57.413916 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:01:57.425381 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:01:57.436549 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:01:57.448116 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:01:57.459598 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:01:57.471045 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:01:57.482677 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:01:57.494098 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:01:57.505682 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:01:57.621583 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:01:57.744025 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:01:57.860085 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:01:57.977270 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 00:01:58.179157 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:01:58.478235 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32709): Launched 00:01:58.737442 run iperf3-srv_10.42.42.10(pid=32710): Launched 00:01:58.849266 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 00:01:59.049406 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:01:59.349645 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32711): Launched 00:01:59.608794 run iperf3-srv_10.42.42.10(pid=32712): Launched 00:01:59.720077 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 00:01:59.920139 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:02:00.219496 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32713): Launched 00:02:00.478688 run iperf3-srv_10.42.42.10(pid=32714): Launched 00:02:00.589926 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 00:02:00.789651 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:02:01.130132 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32715): Launched 00:02:01.428003 run iperf3-srv_10.42.42.10(pid=32716): Launched 00:02:01.565467 tst iperf3m4.py:8: start network... 00:02:01.789120 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:02:02.294274 run create_hlr_db(pid=32717): Launched 00:02:02.418308 bus /gobi_6: Setting Powered False 00:02:03.482026 run create_hlr_db(pid=32717): Terminated: ok {rc=0} 00:02:03.910611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32719): Launched 00:02:04.208204 run osmo-hlr_10.42.42.2(pid=32720): Launched 00:02:04.321167 run osmo-stp_10.42.42.5: Starting osmo-stp 00:02:04.834657 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32722): Launched 00:02:05.131554 run osmo-stp_10.42.42.5(pid=32723): Launched 00:02:05.244875 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:02:05.758427 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32725): Launched 00:02:05.872440 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:02:06.124209 run patchelf(pid=32726): Launched 00:02:06.290453 run osmo-stp_10.42.42.5(pid=32723): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32723)] 00:02:06.416123 run osmo-stp_10.42.42.5(pid=32723): stdout: | (launched: 2022-12-10_00:02:05.076707) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:02:06.544031 run osmo-stp_10.42.42.5(pid=32723): stderr: | 20221210000205249 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000205250 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000205250 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000205250 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000205251 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000205251 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000205251 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:02:06.671894 run osmo-stp_10.42.42.5(pid=32723): stdout: | (launched: 2022-12-10_00:02:05.076707) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:02:06.793730 run osmo-stp_10.42.42.5(pid=32723): stderr: | 20221210000205249 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000205250 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000205250 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000205250 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000205251 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000205251 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000205251 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:02:06.938250 run patchelf(pid=32726): Terminating (SIGINT) 00:02:07.105867 run patchelf(pid=32726): Terminated: ok {rc=0} 00:02:07.226530 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32723): Process ended prematurely: osmo-stp_10.42.42.5(pid=32723) [trial-2366↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32723)] [trial-2366↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8] 00:02:07.235775 tst iperf3m4.py:8: Test FAILED (10.4 sec) 00:02:07.262853 run osmo-hlr_10.42.42.2(pid=32720): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32720)] 00:02:07.309929 run osmo-hlr_10.42.42.2(pid=32720): stdout: | (launched: 2022-12-10_00:02:04.153371) 00:02:07.358801 run osmo-hlr_10.42.42.2(pid=32720): stderr: | 20221210000204330 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210000204330 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210000204330 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210000204331 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210000204331 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210000204331 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210000204343 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210000204352 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210000204352 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210000204352 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:02:07.407961 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32709): Terminating (SIGTERM) 00:02:07.447245 run iperf3-srv_10.42.42.10(pid=32710): Terminating (SIGTERM) 00:02:07.486512 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32711): Terminating (SIGTERM) 00:02:07.525665 run iperf3-srv_10.42.42.10(pid=32712): Terminating (SIGTERM) 00:02:07.564725 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32713): Terminating (SIGTERM) 00:02:07.603882 run iperf3-srv_10.42.42.10(pid=32714): Terminating (SIGTERM) 00:02:07.642898 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32715): Terminating (SIGTERM) 00:02:07.682042 run iperf3-srv_10.42.42.10(pid=32716): Terminating (SIGTERM) 00:02:07.721065 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32719): Terminating (SIGTERM) 00:02:07.760210 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32722): Terminating (SIGTERM) 00:02:07.799872 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32725): Terminating (SIGTERM) 00:02:07.839569 --- ParallelTerminationStrategy: PID 32709 died... 00:02:07.858692 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32709): Terminated: ok {rc=0} 00:02:07.902598 --- ParallelTerminationStrategy: PID 32710 died... 00:02:07.921217 run iperf3-srv_10.42.42.10(pid=32710): Terminated {rc=256} 00:02:07.964667 --- ParallelTerminationStrategy: PID 32711 died... 00:02:07.983438 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32711): Terminated: ok {rc=0} 00:02:08.026917 --- ParallelTerminationStrategy: PID 32712 died... 00:02:08.045460 run iperf3-srv_10.42.42.10(pid=32712): Terminated {rc=256} 00:02:08.088905 --- ParallelTerminationStrategy: PID 32713 died... 00:02:08.107550 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32713): Terminated: ok {rc=0} 00:02:08.151248 --- ParallelTerminationStrategy: PID 32714 died... 00:02:08.169749 run iperf3-srv_10.42.42.10(pid=32714): Terminated {rc=256} 00:02:08.213100 --- ParallelTerminationStrategy: PID 32715 died... 00:02:08.231628 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32715): Terminated: ok {rc=0} 00:02:08.275165 --- ParallelTerminationStrategy: PID 32716 died... 00:02:08.293760 run iperf3-srv_10.42.42.10(pid=32716): Terminated {rc=256} 00:02:08.337679 --- ParallelTerminationStrategy: PID 32719 died... 00:02:08.356232 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32719): Terminated: ok {rc=0} 00:02:08.400019 --- ParallelTerminationStrategy: PID 32722 died... 00:02:08.418610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32722): Terminated: ok {rc=0} 00:02:08.462250 --- ParallelTerminationStrategy: PID 32725 died... 00:02:08.480927 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32725): Terminated: ok {rc=0} 00:02:08.565826 bus /gobi_4: Setting Powered False 00:02:09.665695 bus /gobi_4: Setting Powered False 00:02:10.780287 bus /gobi_1: Setting Powered False 00:02:11.879530 bus /gobi_1: Setting Powered False 00:02:12.999186 bus /gobi_0: Setting Powered False 00:02:14.093389 bus /gobi_0: Setting Powered False 00:02:15.207516 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-lms+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 00:02:16.314036 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:16.326489 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:02:16.397824 tst ping.py: using LAC 24589 00:02:16.548148 tst ping.py: using RAC 109 00:02:16.666751 tst ping.py: using CellId 24589 00:02:16.793498 tst ping.py: using BVCI 24590 00:02:16.910627 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:16.922193 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:16.933944 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:16.948380 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:16.961826 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:16.975408 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:16.988400 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:17.003126 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:02:17.124333 tst ping.py:19: start network... 00:02:17.345686 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:02:17.833511 run create_hlr_db(pid=32727): Launched 00:02:17.954152 bus /gobi_6: Setting Powered False 00:02:19.017291 run create_hlr_db(pid=32727): Terminated: ok {rc=0} 00:02:19.456122 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32729): Launched 00:02:19.768840 run osmo-hlr_10.42.42.2(pid=32730): Launched 00:02:19.888703 run osmo-stp_10.42.42.5: Starting osmo-stp 00:02:20.432002 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32732): Launched 00:02:20.746079 run osmo-stp_10.42.42.5(pid=32733): Launched 00:02:20.866091 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:02:21.407982 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32735): Launched 00:02:21.528167 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:02:21.793314 run patchelf(pid=32736): Launched 00:02:21.968487 run osmo-stp_10.42.42.5(pid=32733): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32733)] 00:02:22.101392 run osmo-stp_10.42.42.5(pid=32733): stdout: | (launched: 2022-12-10_00:02:20.688921) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:02:22.236179 run osmo-stp_10.42.42.5(pid=32733): stderr: | 20221210000220881 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000220881 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000220881 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000220882 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000220882 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000220882 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000220882 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:02:22.371530 run osmo-stp_10.42.42.5(pid=32733): stdout: | (launched: 2022-12-10_00:02:20.688921) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:02:22.500332 run osmo-stp_10.42.42.5(pid=32733): stderr: | 20221210000220881 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000220881 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000220881 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000220882 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000220882 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000220882 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000220882 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:02:22.653213 run patchelf(pid=32736): Terminating (SIGINT) 00:02:22.829096 run patchelf(pid=32736): Terminated: ok {rc=0} 00:02:22.955882 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=32733): Process ended prematurely: osmo-stp_10.42.42.5(pid=32733) [trial-2366↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32733)] [trial-2366↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22] 00:02:22.965373 tst ping.py:22: Test FAILED (6.6 sec) 00:02:22.994403 run osmo-hlr_10.42.42.2(pid=32730): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32730)] 00:02:23.044404 run osmo-hlr_10.42.42.2(pid=32730): stdout: | (launched: 2022-12-10_00:02:19.711692) 00:02:23.096153 run osmo-hlr_10.42.42.2(pid=32730): stderr: | 20221210000219910 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210000219910 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210000219910 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210000219910 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210000219910 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210000219910 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210000219922 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-lms+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210000219931 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210000219931 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210000219931 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:02:23.148372 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32729): Terminating (SIGTERM) 00:02:23.189927 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32732): Terminating (SIGTERM) 00:02:23.231589 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32735): Terminating (SIGTERM) 00:02:23.273597 --- ParallelTerminationStrategy: PID 32729 died... 00:02:23.293426 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32729): Terminated: ok {rc=0} 00:02:23.339807 --- ParallelTerminationStrategy: PID 32732 died... 00:02:23.359503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32732): Terminated: ok {rc=0} 00:02:23.405855 --- ParallelTerminationStrategy: PID 32735 died... 00:02:23.425323 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32735): Terminated: ok {rc=0} 00:02:23.512504 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-lms+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 00:02:24.599315 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:24.611688 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:02:24.689144 tst ping_idle_ping.py: using LAC 24590 00:02:24.812890 tst ping_idle_ping.py: using RAC 110 00:02:24.935494 tst ping_idle_ping.py: using CellId 24590 00:02:25.058273 tst ping_idle_ping.py: using BVCI 24591 00:02:25.173458 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:25.184750 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:25.195967 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:25.207348 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:25.218745 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:25.230203 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:25.241685 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:02:25.253017 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:02:25.368519 tst ping_idle_ping.py:24: start network... 00:02:25.568146 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:02:26.028336 run create_hlr_db(pid=32737): Launched 00:02:26.150354 bus /gobi_6: Setting Powered False 00:02:27.211220 run create_hlr_db(pid=32737): Terminated: ok {rc=0} 00:02:27.622473 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32739): Launched 00:02:27.915723 run osmo-hlr_10.42.42.2(pid=32740): Launched 00:02:28.028502 run osmo-stp_10.42.42.5: Starting osmo-stp 00:02:28.533397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32742): Launched 00:02:28.827995 run osmo-stp_10.42.42.5(pid=32743): Launched 00:02:28.939792 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:02:29.448145 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32745): Launched 00:02:29.559956 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:02:29.808419 run patchelf(pid=32746): Launched 00:02:29.972233 run osmo-stp_10.42.42.5(pid=32743): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32743)] 00:02:30.097287 run osmo-stp_10.42.42.5(pid=32743): stdout: | (launched: 2022-12-10_00:02:28.773976) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:02:30.223641 run osmo-stp_10.42.42.5(pid=32743): stderr: | 20221210000228943 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000228943 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000228943 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000228944 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000228944 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000228944 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000228944 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:02:30.350078 run osmo-stp_10.42.42.5(pid=32743): stdout: | (launched: 2022-12-10_00:02:28.773976) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:02:30.470788 run osmo-stp_10.42.42.5(pid=32743): stderr: | 20221210000228943 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000228943 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000228943 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000228944 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000228944 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000228944 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000228944 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:02:30.613941 run patchelf(pid=32746): Terminating (SIGINT) 00:02:30.779272 run patchelf(pid=32746): Terminated: ok {rc=0} 00:02:30.918653 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=32743): Process ended prematurely: osmo-stp_10.42.42.5(pid=32743) [trial-2366↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32743)] [trial-2366↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 00:02:30.927959 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 00:02:30.955147 run osmo-hlr_10.42.42.2(pid=32740): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32740)] 00:02:31.003881 run osmo-hlr_10.42.42.2(pid=32740): stdout: | (launched: 2022-12-10_00:02:27.861775) 00:02:31.054017 run osmo-hlr_10.42.42.2(pid=32740): stderr: | 20221210000228039 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210000228039 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210000228039 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210000228039 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210000228039 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210000228039 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210000228051 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-lms+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210000228060 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210000228060 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210000228060 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:02:31.104452 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32739): Terminating (SIGTERM) 00:02:31.145475 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32742): Terminating (SIGTERM) 00:02:31.186216 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32745): Terminating (SIGTERM) 00:02:31.227166 --- ParallelTerminationStrategy: PID 32739 died... 00:02:31.246462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32739): Terminated: ok {rc=0} 00:02:31.291693 --- ParallelTerminationStrategy: PID 32742 died... 00:02:31.311128 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32742): Terminated: ok {rc=0} 00:02:31.356207 --- ParallelTerminationStrategy: PID 32745 died... 00:02:31.375552 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32745): Terminated: ok {rc=0} 00:02:31.465843 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2366 gprs:trx-lms+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 gprs:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 00:02:32.781775 tst gprs:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:02:32.787599 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 00:02:32.820455 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 00:02:32.858864 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 00:02:32.943190 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 00:02:32.975742 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 00:02:33.014073 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 00:02:33.614243 tst gprs:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2366 gprs:trx-lms+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 00:02:33.668656 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:02:33.680305 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:02:33.753080 tst cs_paging_gprs_active.py: using LAC 24591 00:02:33.869366 tst cs_paging_gprs_active.py: using RAC 111 00:02:33.988224 tst cs_paging_gprs_active.py: using CellId 24591 00:02:34.105674 tst cs_paging_gprs_active.py: using BVCI 24592 00:02:34.214047 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:02:34.225124 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:02:34.235749 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:02:34.246417 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:02:34.257242 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:02:34.267881 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:02:34.278655 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:02:34.289206 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:02:34.299945 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:02:34.418578 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:02:34.542365 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 00:02:34.759435 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:02:35.080434 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32751): Launched 00:02:35.358407 run iperf3-srv_10.42.42.10(pid=32752): Launched 00:02:35.478983 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 00:02:35.695277 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:02:36.017738 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32757): Launched 00:02:36.295812 run iperf3-srv_10.42.42.10(pid=32758): Launched 00:02:36.416065 tst cs_paging_gprs_active.py:38: start network... 00:02:36.632043 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:02:37.126592 run create_hlr_db(pid=32759): Launched 00:02:37.250368 bus /gobi_6: Setting Powered False 00:02:38.314039 run create_hlr_db(pid=32759): Terminated: ok {rc=0} 00:02:38.741890 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32761): Launched 00:02:39.062217 run osmo-hlr_10.42.42.2(pid=32762): Launched 00:02:39.184568 run osmo-stp_10.42.42.5: Starting osmo-stp 00:02:39.732295 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32764): Launched 00:02:40.051292 run osmo-stp_10.42.42.5(pid=32765): Launched 00:02:40.173222 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:02:40.724306 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32767): Launched 00:02:40.846582 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:02:41.116285 run patchelf(pid=300): Launched 00:02:41.295662 run osmo-stp_10.42.42.5(pid=32765): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32765)] 00:02:41.432161 run osmo-stp_10.42.42.5(pid=32765): stdout: | (launched: 2022-12-10_00:02:39.993612) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:02:41.570064 run osmo-stp_10.42.42.5(pid=32765): stderr: | 20221210000240183 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000240183 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000240183 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000240184 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000240184 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000240184 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000240184 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:02:41.707985 run osmo-stp_10.42.42.5(pid=32765): stdout: | (launched: 2022-12-10_00:02:39.993612) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:02:41.839476 run osmo-stp_10.42.42.5(pid=32765): stderr: | 20221210000240183 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000240183 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000240183 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000240184 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000240184 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000240184 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000240184 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:02:41.995655 run patchelf(pid=300): Terminating (SIGINT) 00:02:42.176250 run patchelf(pid=300): Terminated: ok {rc=0} 00:02:42.306673 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=32765): Process ended prematurely: osmo-stp_10.42.42.5(pid=32765) [trial-2366↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32765)] [trial-2366↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 00:02:42.316794 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 00:02:42.345710 run osmo-hlr_10.42.42.2(pid=32762): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32762)] 00:02:42.396320 run osmo-hlr_10.42.42.2(pid=32762): stdout: | (launched: 2022-12-10_00:02:39.004467) 00:02:42.448351 run osmo-hlr_10.42.42.2(pid=32762): stderr: | 20221210000239200 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210000239200 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210000239200 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210000239200 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210000239200 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210000239200 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210000239212 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-lms+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210000239221 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210000239221 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210000239221 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:02:42.500621 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32751): Terminating (SIGTERM) 00:02:42.542368 run iperf3-srv_10.42.42.10(pid=32752): Terminating (SIGTERM) 00:02:42.583811 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32757): Terminating (SIGTERM) 00:02:42.625260 run iperf3-srv_10.42.42.10(pid=32758): Terminating (SIGTERM) 00:02:42.666701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32761): Terminating (SIGTERM) 00:02:42.708291 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32764): Terminating (SIGTERM) 00:02:42.749908 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32767): Terminating (SIGTERM) 00:02:42.791717 --- ParallelTerminationStrategy: PID 32751 died... 00:02:42.811635 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32751): Terminated: ok {rc=0} 00:02:42.858035 --- ParallelTerminationStrategy: PID 32752 died... 00:02:42.877421 run iperf3-srv_10.42.42.10(pid=32752): Terminated {rc=256} 00:02:42.923866 --- ParallelTerminationStrategy: PID 32757 died... 00:02:42.943376 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32757): Terminated: ok {rc=0} 00:02:42.989740 --- ParallelTerminationStrategy: PID 32758 died... 00:02:43.009212 run iperf3-srv_10.42.42.10(pid=32758): Terminated {rc=256} 00:02:43.055396 --- ParallelTerminationStrategy: PID 32761 died... 00:02:43.074884 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32761): Terminated: ok {rc=0} 00:02:43.121236 --- ParallelTerminationStrategy: PID 32764 died... 00:02:43.140650 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32764): Terminated: ok {rc=0} 00:02:43.187046 --- ParallelTerminationStrategy: PID 32767 died... 00:02:43.206482 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32767): Terminated: ok {rc=0} 00:02:43.294276 bus /gobi_0: Setting Powered False 00:02:44.392383 bus /gobi_0: Setting Powered False 00:02:45.508404 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-lms+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 00:02:46.671857 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:02:46.686671 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:02:46.769376 tst iperf3.py: using LAC 24592 00:02:46.918722 tst iperf3.py: using RAC 112 00:02:47.077451 tst iperf3.py: using CellId 24592 00:02:47.205514 tst iperf3.py: using BVCI 24593 00:02:47.316379 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:02:47.327314 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:02:47.338110 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:02:47.349097 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:02:47.359649 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:02:47.370395 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:02:47.381176 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:02:47.392217 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:02:47.402969 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:02:47.519434 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 00:02:47.722555 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:02:48.023852 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=301): Launched 00:02:48.286242 run iperf3-srv_10.42.42.10(pid=302): Launched 00:02:48.398252 tst iperf3.py:8: start network... 00:02:48.598941 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:02:49.063464 run create_hlr_db(pid=303): Launched 00:02:49.185969 bus /gobi_6: Setting Powered False 00:02:50.246171 run create_hlr_db(pid=303): Terminated: ok {rc=0} 00:02:50.683403 run pcap-recorder_any(filters='host 10.42.42.2')(pid=305): Launched 00:02:50.987899 run osmo-hlr_10.42.42.2(pid=306): Launched 00:02:51.100899 run osmo-stp_10.42.42.5: Starting osmo-stp 00:02:51.615878 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=308): Launched 00:02:51.913578 run osmo-stp_10.42.42.5(pid=309): Launched 00:02:52.027065 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:02:52.543877 run pcap-recorder_any(filters='host 10.42.42.6')(pid=311): Launched 00:02:52.657372 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:02:52.909628 run patchelf(pid=312): Launched 00:02:53.076026 run osmo-stp_10.42.42.5(pid=309): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=309)] 00:02:53.202702 run osmo-stp_10.42.42.5(pid=309): stdout: | (launched: 2022-12-10_00:02:51.858652) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:02:53.331162 run osmo-stp_10.42.42.5(pid=309): stderr: | 20221210000252029 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000252029 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000252030 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000252030 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000252031 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000252031 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000252031 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:02:53.459980 run osmo-stp_10.42.42.5(pid=309): stdout: | (launched: 2022-12-10_00:02:51.858652) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:02:53.582155 run osmo-stp_10.42.42.5(pid=309): stderr: | 20221210000252029 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000252029 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000252030 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000252030 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000252031 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000252031 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000252031 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:02:53.727078 run patchelf(pid=312): Terminating (SIGINT) 00:02:53.895301 run patchelf(pid=312): Terminated: ok {rc=0} 00:02:54.016436 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=309): Process ended prematurely: osmo-stp_10.42.42.5(pid=309) [trial-2366↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=309)] [trial-2366↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8] 00:02:54.025791 tst iperf3.py:8: Test FAILED (7.4 sec) 00:02:54.052487 run osmo-hlr_10.42.42.2(pid=306): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=306)] 00:02:54.099919 run osmo-hlr_10.42.42.2(pid=306): stdout: | (launched: 2022-12-10_00:02:50.932821) 00:02:54.148897 run osmo-hlr_10.42.42.2(pid=306): stderr: | 20221210000251107 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210000251108 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210000251108 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210000251108 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210000251108 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210000251108 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210000251120 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210000251131 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210000251131 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210000251131 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:02:54.199012 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=301): Terminating (SIGTERM) 00:02:54.238190 run iperf3-srv_10.42.42.10(pid=302): Terminating (SIGTERM) 00:02:54.277416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=305): Terminating (SIGTERM) 00:02:54.316711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=308): Terminating (SIGTERM) 00:02:54.356058 run pcap-recorder_any(filters='host 10.42.42.6')(pid=311): Terminating (SIGTERM) 00:02:54.395812 --- ParallelTerminationStrategy: PID 301 died... 00:02:54.414775 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=301): Terminated: ok {rc=0} 00:02:54.458527 --- ParallelTerminationStrategy: PID 302 died... 00:02:54.476930 run iperf3-srv_10.42.42.10(pid=302): Terminated {rc=256} 00:02:54.520750 --- ParallelTerminationStrategy: PID 305 died... 00:02:54.539405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=305): Terminated: ok {rc=0} 00:02:54.582975 --- ParallelTerminationStrategy: PID 308 died... 00:02:54.601560 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=308): Terminated: ok {rc=0} 00:02:54.645087 --- ParallelTerminationStrategy: PID 311 died... 00:02:54.663490 run pcap-recorder_any(filters='host 10.42.42.6')(pid=311): Terminated: ok {rc=0} 00:02:54.748040 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-lms+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 00:02:55.895730 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:02:55.907285 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:02:55.978890 tst iperf3m4.py: using LAC 24593 00:02:56.096901 tst iperf3m4.py: using RAC 113 00:02:56.215317 tst iperf3m4.py: using CellId 24593 00:02:56.334187 tst iperf3m4.py: using BVCI 24594 00:02:56.444411 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:02:56.455410 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:02:56.466189 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:02:56.476803 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:02:56.487453 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:02:56.498197 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:02:56.509015 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:02:56.519639 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:02:56.530416 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:02:56.649210 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:02:56.771020 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:02:56.890840 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:02:57.008428 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 00:02:57.210433 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:02:57.512309 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=313): Launched 00:02:57.774674 run iperf3-srv_10.42.42.10(pid=314): Launched 00:02:57.886398 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 00:02:58.086663 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:02:58.388036 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=315): Launched 00:02:58.648732 run iperf3-srv_10.42.42.10(pid=316): Launched 00:02:58.760563 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 00:02:58.961414 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:02:59.262432 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=317): Launched 00:02:59.523345 run iperf3-srv_10.42.42.10(pid=318): Launched 00:02:59.635285 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 00:02:59.835563 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:03:00.136873 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=319): Launched 00:03:00.398963 run iperf3-srv_10.42.42.10(pid=320): Launched 00:03:00.510912 tst iperf3m4.py:8: start network... 00:03:00.711715 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:03:01.204840 run create_hlr_db(pid=322): Launched 00:03:01.354474 bus /gobi_6: Setting Powered False 00:03:02.418121 run create_hlr_db(pid=322): Terminated: ok {rc=0} 00:03:02.873472 run pcap-recorder_any(filters='host 10.42.42.2')(pid=324): Launched 00:03:03.193715 run osmo-hlr_10.42.42.2(pid=325): Launched 00:03:03.315098 run osmo-stp_10.42.42.5: Starting osmo-stp 00:03:03.866009 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=327): Launched 00:03:04.185125 run osmo-stp_10.42.42.5(pid=328): Launched 00:03:04.306947 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:03:04.858447 run pcap-recorder_any(filters='host 10.42.42.6')(pid=330): Launched 00:03:04.980863 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:03:05.251703 run patchelf(pid=331): Launched 00:03:05.430113 run osmo-stp_10.42.42.5(pid=328): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=328)] 00:03:05.566482 run osmo-stp_10.42.42.5(pid=328): stdout: | (launched: 2022-12-10_00:03:04.126832) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:03:05.704844 run osmo-stp_10.42.42.5(pid=328): stderr: | 20221210000304320 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000304320 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000304321 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000304321 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000304321 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000304322 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000304322 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:03:05.842928 run osmo-stp_10.42.42.5(pid=328): stdout: | (launched: 2022-12-10_00:03:04.126832) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:03:05.974869 run osmo-stp_10.42.42.5(pid=328): stderr: | 20221210000304320 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000304320 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000304321 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000304321 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000304321 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000304322 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000304322 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:03:06.130752 run patchelf(pid=331): Terminating (SIGINT) 00:03:06.311984 run patchelf(pid=331): Terminated: ok {rc=0} 00:03:06.442809 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=328): Process ended prematurely: osmo-stp_10.42.42.5(pid=328) [trial-2366↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=328)] [trial-2366↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8] 00:03:06.453098 tst iperf3m4.py:8: Test FAILED (10.6 sec) 00:03:06.482441 run osmo-hlr_10.42.42.2(pid=325): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=325)] 00:03:06.532626 run osmo-hlr_10.42.42.2(pid=325): stdout: | (launched: 2022-12-10_00:03:03.135241) 00:03:06.584507 run osmo-hlr_10.42.42.2(pid=325): stderr: | 20221210000303332 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210000303332 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210000303332 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210000303332 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210000303332 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210000303332 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210000303344 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210000303353 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210000303353 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210000303353 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:03:06.636694 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=313): Terminating (SIGTERM) 00:03:06.678650 run iperf3-srv_10.42.42.10(pid=314): Terminating (SIGTERM) 00:03:06.720552 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=315): Terminating (SIGTERM) 00:03:06.762455 run iperf3-srv_10.42.42.10(pid=316): Terminating (SIGTERM) 00:03:06.804397 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=317): Terminating (SIGTERM) 00:03:06.846294 run iperf3-srv_10.42.42.10(pid=318): Terminating (SIGTERM) 00:03:06.887982 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=319): Terminating (SIGTERM) 00:03:06.929760 run iperf3-srv_10.42.42.10(pid=320): Terminating (SIGTERM) 00:03:06.971390 run pcap-recorder_any(filters='host 10.42.42.2')(pid=324): Terminating (SIGTERM) 00:03:07.013118 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=327): Terminating (SIGTERM) 00:03:07.054879 run pcap-recorder_any(filters='host 10.42.42.6')(pid=330): Terminating (SIGTERM) 00:03:07.096897 --- ParallelTerminationStrategy: PID 313 died... 00:03:07.116662 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=313): Terminated: ok {rc=0} 00:03:07.163592 --- ParallelTerminationStrategy: PID 314 died... 00:03:07.183168 run iperf3-srv_10.42.42.10(pid=314): Terminated {rc=256} 00:03:07.229750 --- ParallelTerminationStrategy: PID 315 died... 00:03:07.249396 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=315): Terminated: ok {rc=0} 00:03:07.296109 --- ParallelTerminationStrategy: PID 316 died... 00:03:07.315948 run iperf3-srv_10.42.42.10(pid=316): Terminated {rc=256} 00:03:07.362486 --- ParallelTerminationStrategy: PID 317 died... 00:03:07.382603 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=317): Terminated: ok {rc=0} 00:03:07.429504 --- ParallelTerminationStrategy: PID 318 died... 00:03:07.449187 run iperf3-srv_10.42.42.10(pid=318): Terminated {rc=256} 00:03:07.495953 --- ParallelTerminationStrategy: PID 319 died... 00:03:07.515759 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=319): Terminated: ok {rc=0} 00:03:07.562622 --- ParallelTerminationStrategy: PID 320 died... 00:03:07.582491 run iperf3-srv_10.42.42.10(pid=320): Terminated {rc=256} 00:03:07.629354 --- ParallelTerminationStrategy: PID 324 died... 00:03:07.648740 run pcap-recorder_any(filters='host 10.42.42.2')(pid=324): Terminated: ok {rc=0} 00:03:07.696050 --- ParallelTerminationStrategy: PID 327 died... 00:03:07.715812 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=327): Terminated: ok {rc=0} 00:03:07.762889 --- ParallelTerminationStrategy: PID 330 died... 00:03:07.782699 run pcap-recorder_any(filters='host 10.42.42.6')(pid=330): Terminated: ok {rc=0} 00:03:07.870139 bus /gobi_4: Setting Powered False 00:03:08.969174 bus /gobi_4: Setting Powered False 00:03:10.083283 bus /gobi_1: Setting Powered False 00:03:11.181726 bus /gobi_1: Setting Powered False 00:03:12.295869 bus /gobi_0: Setting Powered False 00:03:13.394750 bus /gobi_0: Setting Powered False 00:03:14.511081 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-lms+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 00:03:15.614703 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:15.626574 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:03:15.696659 tst ping.py: using LAC 24594 00:03:15.818679 tst ping.py: using RAC 114 00:03:15.970641 tst ping.py: using CellId 24594 00:03:16.104791 tst ping.py: using BVCI 24595 00:03:16.257866 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:16.269712 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:16.281469 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:16.292676 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:16.304341 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:16.316515 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:16.328385 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:16.341162 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:03:16.460176 tst ping.py:19: start network... 00:03:16.707759 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:03:17.298664 run create_hlr_db(pid=332): Launched 00:03:17.431782 bus /gobi_6: Setting Powered False 00:03:18.492153 run create_hlr_db(pid=332): Terminated: ok {rc=0} 00:03:18.922982 run pcap-recorder_any(filters='host 10.42.42.2')(pid=334): Launched 00:03:19.238113 run osmo-hlr_10.42.42.2(pid=335): Launched 00:03:19.359633 run osmo-stp_10.42.42.5: Starting osmo-stp 00:03:19.909692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=337): Launched 00:03:20.225877 run osmo-stp_10.42.42.5(pid=338): Launched 00:03:20.347419 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:03:20.894251 run pcap-recorder_any(filters='host 10.42.42.6')(pid=340): Launched 00:03:21.014080 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:03:21.280056 run patchelf(pid=341): Launched 00:03:21.455889 run osmo-stp_10.42.42.5(pid=338): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=338)] 00:03:21.589408 run osmo-stp_10.42.42.5(pid=338): stdout: | (launched: 2022-12-10_00:03:20.167937) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:03:21.724327 run osmo-stp_10.42.42.5(pid=338): stderr: | 20221210000320358 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000320358 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000320358 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000320359 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000320359 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000320359 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000320359 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:03:21.859604 run osmo-stp_10.42.42.5(pid=338): stdout: | (launched: 2022-12-10_00:03:20.167937) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:03:21.989161 run osmo-stp_10.42.42.5(pid=338): stderr: | 20221210000320358 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000320358 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000320358 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000320359 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000320359 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000320359 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000320359 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:03:22.142448 run patchelf(pid=341): Terminating (SIGINT) 00:03:22.319693 run patchelf(pid=341): Terminated: ok {rc=0} 00:03:22.448210 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=338): Process ended prematurely: osmo-stp_10.42.42.5(pid=338) [trial-2366↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=338)] [trial-2366↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22] 00:03:22.457999 tst ping.py:22: Test FAILED (6.8 sec) 00:03:22.487066 run osmo-hlr_10.42.42.2(pid=335): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=335)] 00:03:22.537616 run osmo-hlr_10.42.42.2(pid=335): stdout: | (launched: 2022-12-10_00:03:19.180477) 00:03:22.590113 run osmo-hlr_10.42.42.2(pid=335): stderr: | 20221210000319379 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210000319379 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210000319379 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210000319379 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210000319379 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210000319379 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210000319398 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-lms+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210000319408 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210000319408 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210000319408 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:03:22.643209 run pcap-recorder_any(filters='host 10.42.42.2')(pid=334): Terminating (SIGTERM) 00:03:22.685649 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=337): Terminating (SIGTERM) 00:03:22.728129 run pcap-recorder_any(filters='host 10.42.42.6')(pid=340): Terminating (SIGTERM) 00:03:22.770882 --- ParallelTerminationStrategy: PID 334 died... 00:03:22.790994 run pcap-recorder_any(filters='host 10.42.42.2')(pid=334): Terminated: ok {rc=0} 00:03:22.838423 --- ParallelTerminationStrategy: PID 337 died... 00:03:22.858286 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=337): Terminated: ok {rc=0} 00:03:22.905524 --- ParallelTerminationStrategy: PID 340 died... 00:03:22.925377 run pcap-recorder_any(filters='host 10.42.42.6')(pid=340): Terminated: ok {rc=0} 00:03:23.013609 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-lms+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 00:03:24.102441 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:24.114628 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:03:24.187995 tst ping_idle_ping.py: using LAC 24595 00:03:24.312231 tst ping_idle_ping.py: using RAC 115 00:03:24.438699 tst ping_idle_ping.py: using CellId 24595 00:03:24.563568 tst ping_idle_ping.py: using BVCI 24596 00:03:24.680781 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:24.692247 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:24.703402 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:24.715003 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:24.726500 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:24.737975 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:24.749570 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:03:24.761250 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:03:24.877346 tst ping_idle_ping.py:24: start network... 00:03:25.076480 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:03:25.538776 run create_hlr_db(pid=342): Launched 00:03:25.660392 bus /gobi_6: Setting Powered False 00:03:26.720225 run create_hlr_db(pid=342): Terminated: ok {rc=0} 00:03:27.153742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=344): Launched 00:03:27.470384 run osmo-hlr_10.42.42.2(pid=345): Launched 00:03:27.594540 run osmo-stp_10.42.42.5: Starting osmo-stp 00:03:28.106243 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=349): Launched 00:03:28.402003 run osmo-stp_10.42.42.5(pid=355): Launched 00:03:28.515004 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:03:29.025400 run pcap-recorder_any(filters='host 10.42.42.6')(pid=358): Launched 00:03:29.138531 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:03:29.389739 run patchelf(pid=359): Launched 00:03:29.553421 run osmo-stp_10.42.42.5(pid=355): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=355)] 00:03:29.678320 run osmo-stp_10.42.42.5(pid=355): stdout: | (launched: 2022-12-10_00:03:28.347067) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:03:29.804447 run osmo-stp_10.42.42.5(pid=355): stderr: | 20221210000328516 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000328516 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000328516 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000328517 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000328519 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000328519 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000328519 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:03:29.931091 run osmo-stp_10.42.42.5(pid=355): stdout: | (launched: 2022-12-10_00:03:28.347067) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:03:30.051905 run osmo-stp_10.42.42.5(pid=355): stderr: | 20221210000328516 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000328516 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000328516 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000328517 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000328519 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000328519 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000328519 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:03:30.195578 run patchelf(pid=359): Terminating (SIGINT) 00:03:30.361163 run patchelf(pid=359): Terminated: ok {rc=0} 00:03:30.481004 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=355): Process ended prematurely: osmo-stp_10.42.42.5(pid=355) [trial-2366↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=355)] [trial-2366↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 00:03:30.489873 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 00:03:30.516337 run osmo-hlr_10.42.42.2(pid=345): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=345)] 00:03:30.563558 run osmo-hlr_10.42.42.2(pid=345): stdout: | (launched: 2022-12-10_00:03:27.412571) 00:03:30.612684 run osmo-hlr_10.42.42.2(pid=345): stderr: | 20221210000327611 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210000327611 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210000327611 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210000327611 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210000327611 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210000327612 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210000327626 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-lms+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210000327634 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210000327634 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210000327634 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:03:30.662374 run pcap-recorder_any(filters='host 10.42.42.2')(pid=344): Terminating (SIGTERM) 00:03:30.702377 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=349): Terminating (SIGTERM) 00:03:30.743623 run pcap-recorder_any(filters='host 10.42.42.6')(pid=358): Terminating (SIGTERM) 00:03:30.783999 --- ParallelTerminationStrategy: PID 344 died... 00:03:30.803384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=344): Terminated: ok {rc=0} 00:03:30.847887 --- ParallelTerminationStrategy: PID 349 died... 00:03:30.867012 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=349): Terminated: ok {rc=0} 00:03:30.912133 --- ParallelTerminationStrategy: PID 358 died... 00:03:30.931637 run pcap-recorder_any(filters='host 10.42.42.6')(pid=358): Terminated: ok {rc=0} 00:03:31.017644 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2366 gprs:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 00:03:32.356024 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:03:32.363711 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 00:03:32.400221 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 00:03:32.436322 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 00:03:32.490637 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 00:03:32.524939 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 00:03:32.560286 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 00:03:33.119657 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2366 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 00:03:33.125280 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:03:33.136738 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 00:03:33.210136 tst switch_tch_pdch.py: using LAC 24596 00:03:33.335950 tst switch_tch_pdch.py: using RAC 116 00:03:33.452584 tst switch_tch_pdch.py: using CellId 24596 00:03:33.569561 tst switch_tch_pdch.py: using BVCI 24597 00:03:33.676027 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:03:33.687323 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:03:33.698491 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:03:33.709597 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:03:33.720454 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:03:33.731385 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:03:33.742434 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:03:33.753291 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:03:33.870498 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:03:33.996563 tst switch_tch_pdch.py:51: start network... 00:03:34.210917 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:03:34.700545 run create_hlr_db(pid=368): Launched 00:03:34.821455 bus /gobi_6: Setting Powered False 00:03:35.884412 run create_hlr_db(pid=368): Terminated: ok {rc=0} 00:03:36.323430 run pcap-recorder_any(filters='host 10.42.42.2')(pid=370): Launched 00:03:36.639298 run osmo-hlr_10.42.42.2(pid=371): Launched 00:03:36.760071 run osmo-stp_10.42.42.5: Starting osmo-stp 00:03:37.305539 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=373): Launched 00:03:37.621286 run osmo-stp_10.42.42.5(pid=374): Launched 00:03:37.742197 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:03:38.285013 run pcap-recorder_any(filters='host 10.42.42.6')(pid=376): Launched 00:03:38.405275 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:03:38.671229 run patchelf(pid=377): Launched 00:03:38.845792 run osmo-stp_10.42.42.5(pid=374): ERR: Terminated: ERROR {rc=1} [trial-2366↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=374)] 00:03:38.979062 run osmo-stp_10.42.42.5(pid=374): stdout: | (launched: 2022-12-10_00:03:37.563913) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:03:39.114244 run osmo-stp_10.42.42.5(pid=374): stderr: | 20221210000337755 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000337756 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000337756 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000337756 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000337757 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000337757 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000337757 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:03:39.249564 run osmo-stp_10.42.42.5(pid=374): stdout: | (launched: 2022-12-10_00:03:37.563913) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:03:39.378641 run osmo-stp_10.42.42.5(pid=374): stderr: | 20221210000337755 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000337756 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000337756 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000337756 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000337757 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000337757 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000337757 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:03:39.531812 run patchelf(pid=377): Terminating (SIGINT) 00:03:39.708366 run patchelf(pid=377): Terminated: ok {rc=0} 00:03:39.835704 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=374): Process ended prematurely: osmo-stp_10.42.42.5(pid=374) [trial-2366↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=374)] [trial-2366↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 00:03:39.845241 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 00:03:39.873711 run osmo-hlr_10.42.42.2(pid=371): ERR: Terminated: ERROR {rc=237} [trial-2366↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=371)] 00:03:39.923437 run osmo-hlr_10.42.42.2(pid=371): stdout: | (launched: 2022-12-10_00:03:36.582163) 00:03:39.975144 run osmo-hlr_10.42.42.2(pid=371): stderr: | 20221210000336778 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210000336778 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210000336778 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210000336778 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210000336778 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210000336778 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210000336791 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210000336799 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210000336799 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210000336799 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:03:40.027184 run pcap-recorder_any(filters='host 10.42.42.2')(pid=370): Terminating (SIGTERM) 00:03:40.069035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=373): Terminating (SIGTERM) 00:03:40.111007 run pcap-recorder_any(filters='host 10.42.42.6')(pid=376): Terminating (SIGTERM) 00:03:40.153087 --- ParallelTerminationStrategy: PID 370 died... 00:03:40.172904 run pcap-recorder_any(filters='host 10.42.42.2')(pid=370): Terminated: ok {rc=0} 00:03:40.219574 --- ParallelTerminationStrategy: PID 373 died... 00:03:40.238976 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=373): Terminated: ok {rc=0} 00:03:40.285152 --- ParallelTerminationStrategy: PID 376 died... 00:03:40.304586 run pcap-recorder_any(filters='host 10.42.42.6')(pid=376): Terminated: ok {rc=0} 00:03:40.391413 bus /gobi_0: Setting Powered False 00:03:41.491402 bus /gobi_0: Setting Powered False 00:03:42.607017 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2366 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 dynts:trx-lms+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 00:03:43.854499 tst dynts:trx-lms+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:03:43.860226 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 00:03:43.892821 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 00:03:43.927024 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 00:03:43.978909 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 00:03:44.011427 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 00:03:44.045447 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 00:03:44.602764 tst dynts:trx-lms+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2366 dynts:trx-lms+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 00:03:44.607851 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:03:44.618724 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 00:03:44.690372 tst switch_tch_pdch.py: using LAC 24597 00:03:44.814790 tst switch_tch_pdch.py: using RAC 117 00:03:44.937378 tst switch_tch_pdch.py: using CellId 24597 00:03:45.059290 tst switch_tch_pdch.py: using BVCI 24598 00:03:45.176096 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:03:45.187715 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:03:45.199062 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:03:45.210958 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:03:45.222643 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:03:45.234571 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:03:45.246616 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:03:45.258444 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 00:03:45.374591 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 00:03:45.488749 tst switch_tch_pdch.py:51: start network... 00:03:45.686741 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:03:46.170324 run create_hlr_db(pid=381): Launched 00:03:46.327502 bus /gobi_6: Setting Powered False 00:03:47.386967 run create_hlr_db(pid=381): Terminated: ok {rc=0} 00:03:47.773386 run pcap-recorder_any(filters='host 10.42.42.2')(pid=383): Launched 00:03:48.066625 run osmo-hlr_10.42.42.2(pid=384): Launched 00:03:48.177476 run osmo-stp_10.42.42.5: Starting osmo-stp 00:03:48.655834 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=386): Launched 00:03:48.947417 run osmo-stp_10.42.42.5(pid=387): Launched 00:03:49.058674 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:03:49.538987 run pcap-recorder_any(filters='host 10.42.42.6')(pid=389): Launched 00:03:49.650532 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:03:49.897633 run patchelf(pid=390): Launched 00:03:50.060235 run osmo-stp_10.42.42.5(pid=387): ERR: Terminated: ERROR {rc=1} [trial-2366↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=387)] 00:03:50.184020 run osmo-stp_10.42.42.5(pid=387): stdout: | (launched: 2022-12-10_00:03:48.893773) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:03:50.309832 run osmo-stp_10.42.42.5(pid=387): stderr: | 20221210000349063 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000349063 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000349064 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000349064 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000349066 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000349066 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000349066 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:03:50.435459 run osmo-stp_10.42.42.5(pid=387): stdout: | (launched: 2022-12-10_00:03:48.893773) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:03:50.555528 run osmo-stp_10.42.42.5(pid=387): stderr: | 20221210000349063 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000349063 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000349064 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000349064 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000349066 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000349066 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000349066 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:03:50.698231 run patchelf(pid=390): Terminating (SIGINT) 00:03:50.863490 run patchelf(pid=390): Terminated: ok {rc=0} 00:03:50.982807 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=387): Process ended prematurely: osmo-stp_10.42.42.5(pid=387) [trial-2366↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=387)] [trial-2366↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 00:03:50.991613 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 00:03:51.017805 run osmo-hlr_10.42.42.2(pid=384): ERR: Terminated: ERROR {rc=237} [trial-2366↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=384)] 00:03:51.064735 run osmo-hlr_10.42.42.2(pid=384): stdout: | (launched: 2022-12-10_00:03:48.012566) 00:03:51.113303 run osmo-hlr_10.42.42.2(pid=384): stderr: | 20221210000348189 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210000348189 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210000348189 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210000348189 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210000348189 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210000348189 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210000348201 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/dynts:trx-lms+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210000348210 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210000348210 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210000348210 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:03:51.162058 run pcap-recorder_any(filters='host 10.42.42.2')(pid=383): Terminating (SIGTERM) 00:03:51.200985 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=386): Terminating (SIGTERM) 00:03:51.245649 run pcap-recorder_any(filters='host 10.42.42.6')(pid=389): Terminating (SIGTERM) 00:03:51.288181 --- ParallelTerminationStrategy: PID 383 died... 00:03:51.308115 run pcap-recorder_any(filters='host 10.42.42.2')(pid=383): Terminated: ok {rc=0} 00:03:51.355542 --- ParallelTerminationStrategy: PID 386 died... 00:03:51.375053 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=386): Terminated: ok {rc=0} 00:03:51.423430 --- ParallelTerminationStrategy: PID 389 died... 00:03:51.443359 run pcap-recorder_any(filters='host 10.42.42.6')(pid=389): Terminated: ok {rc=0} 00:03:51.533751 bus /gobi_0: Setting Powered False 00:03:52.634793 bus /gobi_0: Setting Powered False 00:03:53.748694 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2366 dynts:trx-lms+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 nitb_sms:trx-lms-limenet-micro --------------------------------------------------------------------- 00:03:54.995070 tst nitb_sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:03:54.998779 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 00:03:55.027656 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 00:03:55.034329 tst nitb_sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 00:03:55.085992 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 00:03:55.115169 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 00:03:55.121755 tst nitb_sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 00:03:55.658786 tst nitb_sms:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_sms: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 nitb_sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 00:03:55.663652 tst nitb_sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 00:03:55.674542 tst nitb_sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 00:03:55.716912 tst mo_mt_sms.py: using LAC 24598 00:03:55.832861 tst mo_mt_sms.py: using RAC 118 00:03:55.952163 tst mo_mt_sms.py: using CellId 24598 00:03:56.067195 tst mo_mt_sms.py: using BVCI 24599 00:03:56.172825 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 00:03:56.289580 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 00:03:56.408653 tst mo_mt_sms.py:9: start nitb and bts... 00:03:56.623243 run osmo-nitb_10.42.42.2: Starting osmo-nitb 00:03:57.263071 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=394): Launched 00:03:57.583665 run osmo-nitb_10.42.42.2(pid=395): Launched 00:03:57.758479 run osmo-nitb_10.42.42.2(pid=395): ERR: Terminated: ERROR {rc=2} [trial-2366↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=395)] 00:03:57.899776 run osmo-nitb_10.42.42.2(pid=395): stdout: | (launched: 2022-12-10_00:03:57.526437) 00:03:58.042216 run osmo-nitb_10.42.42.2(pid=395): stderr: | (launched: 2022-12-10_00:03:57.573109) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:03:58.184577 run osmo-nitb_10.42.42.2(pid=395): stdout: | (launched: 2022-12-10_00:03:57.526437) 00:03:58.321331 run osmo-nitb_10.42.42.2(pid=395): stderr: | (launched: 2022-12-10_00:03:57.573109) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=395): Process ended prematurely: osmo-nitb_10.42.42.2(pid=395) [trial-2366↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=395)] 00:03:58.702485 tst osmo-nitb_10.42.42.2(pid=395): stdout: | (launched: 2022-12-10_00:03:57.526437) 00:03:58.831102 tst osmo-nitb_10.42.42.2(pid=395): stderr: | (launched: 2022-12-10_00:03:57.573109) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:03:58.981589 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=395): Process ended prematurely: osmo-nitb_10.42.42.2(pid=395) [trial-2366↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=395)] [trial-2366↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11] 00:03:58.990852 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 00:03:58.998093 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=394): Terminating (SIGTERM) 00:03:59.211226 --- ParallelTerminationStrategy: PID 394 died... 00:03:59.232635 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=394): Terminated: ok {rc=0} 00:03:59.322186 bus /sierra_3: Setting Powered False 00:04:00.419503 bus /sierra_3: Setting Powered False 00:04:01.537212 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 nitb_sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 sms:trx-lms-limenet-micro --------------------------------------------------------------------- 00:04:02.732387 tst sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:04:02.736186 tst sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 00:04:02.764909 tst sms:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 00:04:02.791903 tst sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 00:04:02.842593 tst sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 00:04:02.870991 tst sms:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 00:04:02.897373 tst sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 00:04:03.446717 tst sms:trx-lms-limenet-micro: RESERVED RESOURCES for sms: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 00:04:03.451580 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:04:03.462374 tst sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 00:04:03.508123 tst mo_mt_sms.py: using LAC 24599 00:04:03.634009 tst mo_mt_sms.py: using RAC 119 00:04:03.767374 tst mo_mt_sms.py: using CellId 24599 00:04:03.897056 tst mo_mt_sms.py: using BVCI 24600 00:04:04.012228 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:04:04.023563 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:04:04.034796 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:04:04.046034 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:04:04.057292 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:04:04.068495 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 00:04:04.188546 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 00:04:04.307205 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:04:04.796714 run create_hlr_db(pid=401): Launched 00:04:04.916795 bus /sierra_2: Setting Powered False 00:04:05.979466 run create_hlr_db(pid=401): Terminated: ok {rc=0} 00:04:06.399946 run pcap-recorder_any(filters='host 10.42.42.2')(pid=403): Launched 00:04:06.695340 run osmo-hlr_10.42.42.2(pid=404): Launched 00:04:06.807975 run osmo-stp_10.42.42.5: Starting osmo-stp 00:04:07.313748 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=406): Launched 00:04:07.606662 run osmo-stp_10.42.42.5(pid=407): Launched 00:04:07.718885 run osmo-msc_10.42.42.6: Starting osmo-msc 00:04:08.253678 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=409): Launched 00:04:08.548431 run osmo-msc_10.42.42.6(pid=410): Launched 00:04:08.713475 run osmo-stp_10.42.42.5(pid=407): ERR: Terminated: ERROR {rc=1} [trial-2366↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=407)] 00:04:08.838906 run osmo-stp_10.42.42.5(pid=407): stdout: | (launched: 2022-12-10_00:04:07.552560) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:04:08.963718 run osmo-stp_10.42.42.5(pid=407): stderr: | 20221210000407719 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000407719 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000407720 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000407720 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000407722 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000407723 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000407723 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:04:09.086024 run osmo-stp_10.42.42.5(pid=407): stdout: | (launched: 2022-12-10_00:04:07.552560) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:04:09.203785 run osmo-stp_10.42.42.5(pid=407): stderr: | 20221210000407719 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000407719 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000407720 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000407720 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000407722 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000407723 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000407723 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:04:09.343806 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=407): Process ended prematurely: osmo-stp_10.42.42.5(pid=407) [trial-2366↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=407)] [trial-2366↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16] 00:04:09.351980 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 00:04:09.377784 run osmo-hlr_10.42.42.2(pid=404): ERR: Terminated: ERROR {rc=237} [trial-2366↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=404)] 00:04:09.425364 run osmo-hlr_10.42.42.2(pid=404): stdout: | (launched: 2022-12-10_00:04:06.641406) 00:04:09.474163 run osmo-hlr_10.42.42.2(pid=404): stderr: | 20221210000406816 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210000406816 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210000406816 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210000406817 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210000406817 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210000406817 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210000406829 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/sms:trx-lms-limenet-micro/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210000406839 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210000406840 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210000406840 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:04:09.542655 run osmo-msc_10.42.42.6(pid=410): ERR: Terminated: ERROR {rc=2} [trial-2366↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=410)] 00:04:09.589809 run osmo-msc_10.42.42.6(pid=410): stdout: | (launched: 2022-12-10_00:04:08.493569) 00:04:09.638758 run osmo-msc_10.42.42.6(pid=410): stderr: | 20221210000408766 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210000408767 DLGLOBAL DEBUG validating counter group 0x7f70a50e1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210000408767 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210000408767 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210000408767 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210000408767 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210000408770 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210000408770 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210000408770 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210000408771 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:04:09.688088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=403): Terminating (SIGTERM) 00:04:09.727456 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=406): Terminating (SIGTERM) 00:04:09.766961 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=409): Terminating (SIGTERM) 00:04:09.806800 --- ParallelTerminationStrategy: PID 403 died... 00:04:09.825799 run pcap-recorder_any(filters='host 10.42.42.2')(pid=403): Terminated: ok {rc=0} 00:04:09.869836 --- ParallelTerminationStrategy: PID 406 died... 00:04:09.888152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=406): Terminated: ok {rc=0} 00:04:09.931698 --- ParallelTerminationStrategy: PID 409 died... 00:04:09.950133 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=409): Terminated: ok {rc=0} 00:04:10.032699 bus /sierra_3: Setting Powered False 00:04:11.129022 bus /sierra_3: Setting Powered False 00:04:12.243860 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 nitb_ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 00:04:13.472307 tst nitb_ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:04:13.476307 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 00:04:13.506537 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 00:04:13.513517 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 00:04:13.548873 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 00:04:13.579953 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 00:04:13.586972 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 00:04:14.106858 tst nitb_ussd:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_ussd: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2366 nitb_ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 00:04:14.111942 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 00:04:14.123215 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 00:04:14.167885 tst assert_extension.py: using LAC 24600 00:04:14.294052 tst assert_extension.py: using RAC 120 00:04:14.409109 tst assert_extension.py: using CellId 24600 00:04:14.523343 tst assert_extension.py: using BVCI 24601 00:04:14.630285 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 00:04:14.748420 tst assert_extension.py:10: start nitb and bts... 00:04:14.960713 run osmo-nitb_10.42.42.2: Starting osmo-nitb 00:04:15.604661 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=415): Launched 00:04:15.928110 run osmo-nitb_10.42.42.2(pid=416): Launched 00:04:16.123333 run osmo-nitb_10.42.42.2(pid=416): ERR: Terminated: ERROR {rc=2} [trial-2366↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=416)] 00:04:16.261401 run osmo-nitb_10.42.42.2(pid=416): stdout: | (launched: 2022-12-10_00:04:15.862730) 00:04:16.399720 run osmo-nitb_10.42.42.2(pid=416): stderr: | (launched: 2022-12-10_00:04:15.912693) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:04:16.538175 run osmo-nitb_10.42.42.2(pid=416): stdout: | (launched: 2022-12-10_00:04:15.862730) 00:04:16.672646 run osmo-nitb_10.42.42.2(pid=416): stderr: | (launched: 2022-12-10_00:04:15.912693) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=416): Process ended prematurely: osmo-nitb_10.42.42.2(pid=416) [trial-2366↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=416)] 00:04:17.069693 tst osmo-nitb_10.42.42.2(pid=416): stdout: | (launched: 2022-12-10_00:04:15.862730) 00:04:17.200912 tst osmo-nitb_10.42.42.2(pid=416): stderr: | (launched: 2022-12-10_00:04:15.912693) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:04:17.353674 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=416): Process ended prematurely: osmo-nitb_10.42.42.2(pid=416) [trial-2366↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=416)] [trial-2366↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12] 00:04:17.362923 tst assert_extension.py:12: Test FAILED (3.2 sec) 00:04:17.370319 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=415): Terminating (SIGTERM) 00:04:17.584025 --- ParallelTerminationStrategy: PID 415 died... 00:04:17.604916 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=415): Terminated: ok {rc=0} 00:04:17.694602 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 nitb_ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 00:04:18.869864 tst ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:04:18.874207 tst ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 00:04:18.903134 tst ussd:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 00:04:18.929801 tst ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 00:04:18.964454 tst ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 00:04:18.994195 tst ussd:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 00:04:19.021198 tst ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 00:04:19.552940 tst ussd:trx-lms-limenet-micro: RESERVED RESOURCES for ussd: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2366 ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 00:04:19.559110 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:04:19.570976 tst ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 00:04:19.616462 tst assert_extension.py: using LAC 24601 00:04:19.741572 tst assert_extension.py: using RAC 121 00:04:19.864352 tst assert_extension.py: using CellId 24601 00:04:19.981236 tst assert_extension.py: using BVCI 24602 00:04:20.087963 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:04:20.098971 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:04:20.109775 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:04:20.121120 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:04:20.132271 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:04:20.143313 tst ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 00:04:20.262718 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:04:20.719571 run create_hlr_db(pid=433): Launched 00:04:20.840456 bus /sierra_2: Setting Powered False 00:04:21.916512 run create_hlr_db(pid=433): Terminated: ok {rc=0} 00:04:22.362158 run pcap-recorder_any(filters='host 10.42.42.2')(pid=435): Launched 00:04:22.677421 run osmo-hlr_10.42.42.2(pid=436): Launched 00:04:22.798349 run osmo-stp_10.42.42.5: Starting osmo-stp 00:04:23.344833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=438): Launched 00:04:23.660464 run osmo-stp_10.42.42.5(pid=439): Launched 00:04:23.781366 run osmo-msc_10.42.42.6: Starting osmo-msc 00:04:24.349483 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=441): Launched 00:04:24.665641 run osmo-msc_10.42.42.6(pid=442): Launched 00:04:24.842043 run osmo-stp_10.42.42.5(pid=439): ERR: Terminated: ERROR {rc=1} [trial-2366↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=439)] 00:04:24.976102 run osmo-stp_10.42.42.5(pid=439): stdout: | (launched: 2022-12-10_00:04:23.602854) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:04:25.111380 run osmo-stp_10.42.42.5(pid=439): stderr: | 20221210000423795 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000423795 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000423795 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000423795 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000423796 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000423796 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000423796 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:04:25.245140 run osmo-stp_10.42.42.5(pid=439): stdout: | (launched: 2022-12-10_00:04:23.602854) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:04:25.371913 run osmo-stp_10.42.42.5(pid=439): stderr: | 20221210000423795 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000423795 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000423795 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000423795 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000423796 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000423796 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000423796 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:04:25.523659 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=439): Process ended prematurely: osmo-stp_10.42.42.5(pid=439) [trial-2366↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=439)] [trial-2366↪ussd:trx-lms-limenet-micro↪assert_extension.py:17] 00:04:25.532803 tst assert_extension.py:17: Test FAILED (6.0 sec) 00:04:25.561634 run osmo-hlr_10.42.42.2(pid=436): ERR: Terminated: ERROR {rc=237} [trial-2366↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=436)] 00:04:25.612230 run osmo-hlr_10.42.42.2(pid=436): stdout: | (launched: 2022-12-10_00:04:22.620052) 00:04:25.664248 run osmo-hlr_10.42.42.2(pid=436): stderr: | 20221210000422818 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210000422818 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210000422818 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210000422818 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210000422819 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210000422819 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210000422832 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/ussd:trx-lms-limenet-micro/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210000422842 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210000422842 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210000422842 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:04:25.736621 run osmo-msc_10.42.42.6(pid=442): ERR: Terminated: ERROR {rc=2} [trial-2366↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=442)] 00:04:25.786735 run osmo-msc_10.42.42.6(pid=442): stdout: | (launched: 2022-12-10_00:04:24.608090) 00:04:25.838742 run osmo-msc_10.42.42.6(pid=442): stderr: | 20221210000424926 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210000424926 DLGLOBAL DEBUG validating counter group 0x7fc2a63cac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210000424927 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210000424927 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210000424927 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210000424927 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210000424929 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210000424929 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210000424929 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210000424929 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:04:25.891039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=435): Terminating (SIGTERM) 00:04:25.933021 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=438): Terminating (SIGTERM) 00:04:25.975432 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=441): Terminating (SIGTERM) 00:04:26.017865 --- ParallelTerminationStrategy: PID 435 died... 00:04:26.037664 run pcap-recorder_any(filters='host 10.42.42.2')(pid=435): Terminated: ok {rc=0} 00:04:26.084510 --- ParallelTerminationStrategy: PID 438 died... 00:04:26.104239 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=438): Terminated: ok {rc=0} 00:04:26.150601 --- ParallelTerminationStrategy: PID 441 died... 00:04:26.169985 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=441): Terminated: ok {rc=0} 00:04:26.257779 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 00:04:27.463308 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:04:27.470738 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 00:04:27.501813 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 00:04:27.529601 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 00:04:27.583383 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 00:04:27.614706 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 00:04:27.642393 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 00:04:28.193390 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 00:04:28.245871 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:04:28.257632 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 00:04:28.324470 tst mo_mt_call.py: using LAC 24602 00:04:28.450314 tst mo_mt_call.py: using RAC 122 00:04:28.577360 tst mo_mt_call.py: using CellId 24602 00:04:28.702220 tst mo_mt_call.py: using BVCI 24603 00:04:28.818826 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:04:28.830539 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:04:28.842087 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:04:28.853900 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:04:28.865694 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:04:28.877453 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 00:04:28.993653 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 00:04:29.116236 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:04:29.614096 run create_hlr_db(pid=447): Launched 00:04:29.735099 bus /sierra_2: Setting Powered False 00:04:30.798328 run create_hlr_db(pid=447): Terminated: ok {rc=0} 00:04:31.260098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=449): Launched 00:04:31.589344 run osmo-hlr_10.42.42.2(pid=450): Launched 00:04:31.851099 run osmo-stp_10.42.42.5: Starting osmo-stp 00:04:32.521989 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=452): Launched 00:04:32.841875 run osmo-stp_10.42.42.5(pid=453): Launched 00:04:32.963971 run osmo-msc_10.42.42.6: Starting osmo-msc 00:04:33.541805 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=455): Launched 00:04:33.862729 run osmo-msc_10.42.42.6(pid=456): Launched 00:04:34.040883 run osmo-stp_10.42.42.5(pid=453): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=453)] 00:04:34.175736 run osmo-stp_10.42.42.5(pid=453): stdout: | (launched: 2022-12-10_00:04:32.783634) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:04:34.311261 run osmo-stp_10.42.42.5(pid=453): stderr: | 20221210000432974 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000432974 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000432974 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000432975 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000432977 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000432977 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000432977 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:04:34.446572 run osmo-stp_10.42.42.5(pid=453): stdout: | (launched: 2022-12-10_00:04:32.783634) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:04:34.574628 run osmo-stp_10.42.42.5(pid=453): stderr: | 20221210000432974 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000432974 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000432974 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000432975 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000432977 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000432977 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000432977 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:04:34.727843 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=453): Process ended prematurely: osmo-stp_10.42.42.5(pid=453) [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=453)] [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 00:04:34.737311 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 00:04:34.765716 run osmo-hlr_10.42.42.2(pid=450): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=450)] 00:04:34.815943 run osmo-hlr_10.42.42.2(pid=450): stdout: | (launched: 2022-12-10_00:04:31.525163) 00:04:34.868148 run osmo-hlr_10.42.42.2(pid=450): stderr: | 20221210000431896 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210000431896 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210000431896 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210000431896 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210000431896 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210000431896 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210000431914 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210000431928 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210000431928 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210000431928 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:04:34.940636 run osmo-msc_10.42.42.6(pid=456): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=456)] 00:04:34.991340 run osmo-msc_10.42.42.6(pid=456): stdout: | (launched: 2022-12-10_00:04:33.804434) 00:04:35.043198 run osmo-msc_10.42.42.6(pid=456): stderr: | 20221210000434127 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210000434127 DLGLOBAL DEBUG validating counter group 0x7f6d6a318c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210000434127 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210000434128 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210000434128 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210000434128 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210000434130 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210000434130 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210000434130 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210000434130 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:04:35.095447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=449): Terminating (SIGTERM) 00:04:35.137272 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=452): Terminating (SIGTERM) 00:04:35.179078 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=455): Terminating (SIGTERM) 00:04:35.221086 --- ParallelTerminationStrategy: PID 449 died... 00:04:35.240723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=449): Terminated: ok {rc=0} 00:04:35.287624 --- ParallelTerminationStrategy: PID 452 died... 00:04:35.307246 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=452): Terminated: ok {rc=0} 00:04:35.353339 --- ParallelTerminationStrategy: PID 455 died... 00:04:35.372611 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=455): Terminated: ok {rc=0} 00:04:35.460216 bus /sierra_3: Setting Powered False 00:04:36.559003 bus /sierra_3: Setting Powered False 00:04:37.674789 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 00:04:38.823730 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:04:38.836288 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 00:04:38.905069 tst mo_mt_call_osmux.py: using LAC 24603 00:04:39.032712 tst mo_mt_call_osmux.py: using RAC 123 00:04:39.158284 tst mo_mt_call_osmux.py: using CellId 24603 00:04:39.283973 tst mo_mt_call_osmux.py: using BVCI 24604 00:04:39.400498 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:04:39.412296 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:04:39.424210 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:04:39.435820 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:04:39.447606 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:04:39.459883 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 00:04:39.582570 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 00:04:39.702256 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:04:40.199866 run create_hlr_db(pid=458): Launched 00:04:40.321854 bus /sierra_2: Setting Powered False 00:04:41.385621 run create_hlr_db(pid=458): Terminated: ok {rc=0} 00:04:41.815642 run pcap-recorder_any(filters='host 10.42.42.2')(pid=460): Launched 00:04:42.116405 run osmo-hlr_10.42.42.2(pid=461): Launched 00:04:42.230730 run osmo-stp_10.42.42.5: Starting osmo-stp 00:04:42.745559 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=463): Launched 00:04:43.044830 run osmo-stp_10.42.42.5(pid=464): Launched 00:04:43.159055 run osmo-msc_10.42.42.6: Starting osmo-msc 00:04:43.703417 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=466): Launched 00:04:44.002867 run osmo-msc_10.42.42.6(pid=467): Launched 00:04:44.169444 run osmo-stp_10.42.42.5(pid=464): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=464)] 00:04:44.295595 run osmo-stp_10.42.42.5(pid=464): stdout: | (launched: 2022-12-10_00:04:42.989555) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:04:44.422122 run osmo-stp_10.42.42.5(pid=464): stderr: | 20221210000443161 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000443161 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000443162 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000443162 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000443163 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000443163 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000443163 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:04:44.546520 run osmo-stp_10.42.42.5(pid=464): stdout: | (launched: 2022-12-10_00:04:42.989555) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:04:44.665308 run osmo-stp_10.42.42.5(pid=464): stderr: | 20221210000443161 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000443161 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000443162 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000443162 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000443163 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000443163 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000443163 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:04:44.807329 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=464): Process ended prematurely: osmo-stp_10.42.42.5(pid=464) [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=464)] [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 00:04:44.816344 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 00:04:44.842928 run osmo-hlr_10.42.42.2(pid=461): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=461)] 00:04:44.890229 run osmo-hlr_10.42.42.2(pid=461): stdout: | (launched: 2022-12-10_00:04:42.061426) 00:04:44.938769 run osmo-hlr_10.42.42.2(pid=461): stderr: | 20221210000442238 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210000442238 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210000442238 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210000442238 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210000442238 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210000442238 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210000442254 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210000442263 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210000442263 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210000442263 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:04:45.007095 run osmo-msc_10.42.42.6(pid=467): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=467)] 00:04:45.054655 run osmo-msc_10.42.42.6(pid=467): stdout: | (launched: 2022-12-10_00:04:43.946976) 00:04:45.103601 run osmo-msc_10.42.42.6(pid=467): stderr: | 20221210000444221 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210000444222 DLGLOBAL DEBUG validating counter group 0x7fa1c83bcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210000444222 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210000444222 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210000444222 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210000444222 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210000444224 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210000444224 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210000444224 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210000444224 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:04:45.152863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=460): Terminating (SIGTERM) 00:04:45.191945 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=463): Terminating (SIGTERM) 00:04:45.231155 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=466): Terminating (SIGTERM) 00:04:45.270883 --- ParallelTerminationStrategy: PID 460 died... 00:04:45.290023 run pcap-recorder_any(filters='host 10.42.42.2')(pid=460): Terminated: ok {rc=0} 00:04:45.333996 --- ParallelTerminationStrategy: PID 463 died... 00:04:45.352433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=463): Terminated: ok {rc=0} 00:04:45.396243 --- ParallelTerminationStrategy: PID 466 died... 00:04:45.414978 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=466): Terminated: ok {rc=0} 00:04:45.496821 bus /sierra_3: Setting Powered False 00:04:46.592318 bus /sierra_3: Setting Powered False 00:04:47.708305 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 00:04:48.955284 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:04:48.962541 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 00:04:48.993121 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 00:04:49.020820 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 00:04:49.074543 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 00:04:49.106129 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 00:04:49.133906 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 00:04:49.684502 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 00:04:49.736565 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:04:49.748342 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 00:04:49.818105 tst mo_mt_call.py: using LAC 24604 00:04:49.944537 tst mo_mt_call.py: using RAC 124 00:04:50.069125 tst mo_mt_call.py: using CellId 24604 00:04:50.194085 tst mo_mt_call.py: using BVCI 24605 00:04:50.303728 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:04:50.315105 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:04:50.326422 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:04:50.338236 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:04:50.350022 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:04:50.361832 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 00:04:50.477280 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 00:04:50.592128 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:04:51.056352 run create_hlr_db(pid=472): Launched 00:04:51.179396 bus /sierra_2: Setting Powered False 00:04:52.239445 run create_hlr_db(pid=472): Terminated: ok {rc=0} 00:04:52.678650 run pcap-recorder_any(filters='host 10.42.42.2')(pid=474): Launched 00:04:52.999586 run osmo-hlr_10.42.42.2(pid=475): Launched 00:04:53.121786 run osmo-stp_10.42.42.5: Starting osmo-stp 00:04:53.678101 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=477): Launched 00:04:54.000262 run osmo-stp_10.42.42.5(pid=478): Launched 00:04:54.122932 run osmo-msc_10.42.42.6: Starting osmo-msc 00:04:54.706431 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=480): Launched 00:04:55.027672 run osmo-msc_10.42.42.6(pid=481): Launched 00:04:55.206885 run osmo-stp_10.42.42.5(pid=478): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=478)] 00:04:55.343140 run osmo-stp_10.42.42.5(pid=478): stdout: | (launched: 2022-12-10_00:04:53.941575) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:04:55.480284 run osmo-stp_10.42.42.5(pid=478): stderr: | 20221210000454132 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000454132 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000454132 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000454133 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000454135 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000454135 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000454135 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:04:55.616040 run osmo-stp_10.42.42.5(pid=478): stdout: | (launched: 2022-12-10_00:04:53.941575) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:04:55.744073 run osmo-stp_10.42.42.5(pid=478): stderr: | 20221210000454132 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000454132 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000454132 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000454133 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000454135 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000454135 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000454135 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:04:55.897377 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=478): Process ended prematurely: osmo-stp_10.42.42.5(pid=478) [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=478)] [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 00:04:55.906954 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 00:04:55.935292 run osmo-hlr_10.42.42.2(pid=475): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=475)] 00:04:55.985417 run osmo-hlr_10.42.42.2(pid=475): stdout: | (launched: 2022-12-10_00:04:52.941448) 00:04:56.037193 run osmo-hlr_10.42.42.2(pid=475): stderr: | 20221210000453138 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210000453138 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210000453138 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210000453138 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210000453138 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210000453139 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210000453150 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210000453158 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210000453159 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210000453159 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:04:56.109656 run osmo-msc_10.42.42.6(pid=481): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=481)] 00:04:56.159599 run osmo-msc_10.42.42.6(pid=481): stdout: | (launched: 2022-12-10_00:04:54.969278) 00:04:56.210998 run osmo-msc_10.42.42.6(pid=481): stderr: | 20221210000455292 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210000455292 DLGLOBAL DEBUG validating counter group 0x7f59df2a1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210000455292 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210000455292 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210000455293 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210000455293 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210000455294 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210000455295 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210000455295 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210000455295 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:04:56.262764 run pcap-recorder_any(filters='host 10.42.42.2')(pid=474): Terminating (SIGTERM) 00:04:56.304272 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=477): Terminating (SIGTERM) 00:04:56.346154 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=480): Terminating (SIGTERM) 00:04:56.388329 --- ParallelTerminationStrategy: PID 474 died... 00:04:56.408368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=474): Terminated: ok {rc=0} 00:04:56.455300 --- ParallelTerminationStrategy: PID 477 died... 00:04:56.474798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=477): Terminated: ok {rc=0} 00:04:56.521254 --- ParallelTerminationStrategy: PID 480 died... 00:04:56.540563 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=480): Terminated: ok {rc=0} 00:04:56.629766 bus /sierra_3: Setting Powered False 00:04:57.729289 bus /sierra_3: Setting Powered False 00:04:58.846841 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 00:04:59.997201 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:05:00.009844 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 00:05:00.079965 tst mo_mt_call_osmux.py: using LAC 24605 00:05:00.205483 tst mo_mt_call_osmux.py: using RAC 125 00:05:00.330642 tst mo_mt_call_osmux.py: using CellId 24605 00:05:00.455378 tst mo_mt_call_osmux.py: using BVCI 24606 00:05:00.572495 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:05:00.584299 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:05:00.595887 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:05:00.607681 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:05:00.619443 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:05:00.631159 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 00:05:00.748017 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 00:05:00.894742 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:05:01.419519 run create_hlr_db(pid=486): Launched 00:05:01.610157 bus /sierra_2: Setting Powered False 00:05:02.674086 run create_hlr_db(pid=486): Terminated: ok {rc=0} 00:05:03.105197 run pcap-recorder_any(filters='host 10.42.42.2')(pid=488): Launched 00:05:03.406082 run osmo-hlr_10.42.42.2(pid=489): Launched 00:05:03.520205 run osmo-stp_10.42.42.5: Starting osmo-stp 00:05:04.035439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=491): Launched 00:05:04.333912 run osmo-stp_10.42.42.5(pid=492): Launched 00:05:04.447451 run osmo-msc_10.42.42.6: Starting osmo-msc 00:05:04.988459 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=494): Launched 00:05:05.289004 run osmo-msc_10.42.42.6(pid=495): Launched 00:05:05.456752 run osmo-stp_10.42.42.5(pid=492): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=492)] 00:05:05.583912 run osmo-stp_10.42.42.5(pid=492): stdout: | (launched: 2022-12-10_00:05:04.278860) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:05:05.710851 run osmo-stp_10.42.42.5(pid=492): stderr: | 20221210000504450 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000504451 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000504451 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000504451 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000504452 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000504452 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000504452 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:05:05.835622 run osmo-stp_10.42.42.5(pid=492): stdout: | (launched: 2022-12-10_00:05:04.278860) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:05:05.955019 run osmo-stp_10.42.42.5(pid=492): stderr: | 20221210000504450 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000504451 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000504451 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000504451 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000504452 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000504452 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000504452 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:05:06.097992 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=492): Process ended prematurely: osmo-stp_10.42.42.5(pid=492) [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=492)] [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 00:05:06.106745 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 00:05:06.133060 run osmo-hlr_10.42.42.2(pid=489): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=489)] 00:05:06.180095 run osmo-hlr_10.42.42.2(pid=489): stdout: | (launched: 2022-12-10_00:05:03.350917) 00:05:06.228927 run osmo-hlr_10.42.42.2(pid=489): stderr: | 20221210000503527 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210000503527 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210000503527 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210000503527 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210000503527 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210000503528 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210000503540 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210000503548 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210000503549 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210000503549 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:05:06.297317 run osmo-msc_10.42.42.6(pid=495): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=495)] 00:05:06.344456 run osmo-msc_10.42.42.6(pid=495): stdout: | (launched: 2022-12-10_00:05:05.234041) 00:05:06.393478 run osmo-msc_10.42.42.6(pid=495): stderr: | 20221210000505504 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210000505504 DLGLOBAL DEBUG validating counter group 0x7f2aed538c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210000505504 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210000505504 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210000505504 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210000505504 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210000505506 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210000505507 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210000505507 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210000505507 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:05:06.442683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=488): Terminating (SIGTERM) 00:05:06.482019 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=491): Terminating (SIGTERM) 00:05:06.521395 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=494): Terminating (SIGTERM) 00:05:06.561429 --- ParallelTerminationStrategy: PID 488 died... 00:05:06.580312 run pcap-recorder_any(filters='host 10.42.42.2')(pid=488): Terminated: ok {rc=0} 00:05:06.624369 --- ParallelTerminationStrategy: PID 491 died... 00:05:06.643168 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=491): Terminated: ok {rc=0} 00:05:06.686858 --- ParallelTerminationStrategy: PID 494 died... 00:05:06.705612 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=494): Terminated: ok {rc=0} 00:05:06.791131 bus /sierra_3: Setting Powered False 00:05:07.890528 bus /sierra_3: Setting Powered False 00:05:09.003408 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 00:05:10.255434 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:05:10.262680 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 00:05:10.291143 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 00:05:10.317491 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 00:05:10.368388 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 00:05:10.398876 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 00:05:10.426956 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 00:05:10.977308 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 00:05:11.025346 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:05:11.036436 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 00:05:11.100066 tst mo_mt_call.py: using LAC 24606 00:05:11.226259 tst mo_mt_call.py: using RAC 126 00:05:11.352734 tst mo_mt_call.py: using CellId 24606 00:05:11.480140 tst mo_mt_call.py: using BVCI 24607 00:05:11.598297 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:05:11.610157 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:05:11.621898 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:05:11.633708 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:05:11.645526 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:05:11.657204 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 00:05:11.773971 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 00:05:11.888863 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:05:12.354960 run create_hlr_db(pid=500): Launched 00:05:12.478048 bus /sierra_2: Setting Powered False 00:05:13.539104 run create_hlr_db(pid=500): Terminated: ok {rc=0} 00:05:13.980656 run pcap-recorder_any(filters='host 10.42.42.2')(pid=502): Launched 00:05:14.303138 run osmo-hlr_10.42.42.2(pid=503): Launched 00:05:14.426628 run osmo-stp_10.42.42.5: Starting osmo-stp 00:05:14.980650 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=505): Launched 00:05:15.300709 run osmo-stp_10.42.42.5(pid=506): Launched 00:05:15.423266 run osmo-msc_10.42.42.6: Starting osmo-msc 00:05:16.027347 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=508): Launched 00:05:16.368295 run osmo-msc_10.42.42.6(pid=509): Launched 00:05:16.576166 run osmo-stp_10.42.42.5(pid=506): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=506)] 00:05:16.771221 run osmo-stp_10.42.42.5(pid=506): stdout: | (launched: 2022-12-10_00:05:15.242229) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:05:16.941890 run osmo-stp_10.42.42.5(pid=506): stderr: | 20221210000515437 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000515437 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000515437 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000515438 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000515438 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000515438 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000515438 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:05:17.236190 run osmo-stp_10.42.42.5(pid=506): stdout: | (launched: 2022-12-10_00:05:15.242229) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:05:17.368067 run osmo-stp_10.42.42.5(pid=506): stderr: | 20221210000515437 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000515437 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000515437 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000515438 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000515438 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000515438 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000515438 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:05:17.524218 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=506): Process ended prematurely: osmo-stp_10.42.42.5(pid=506) [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=506)] [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 00:05:17.534091 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 00:05:17.563852 run osmo-hlr_10.42.42.2(pid=503): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=503)] 00:05:17.614436 run osmo-hlr_10.42.42.2(pid=503): stdout: | (launched: 2022-12-10_00:05:14.244478) 00:05:17.666588 run osmo-hlr_10.42.42.2(pid=503): stderr: | 20221210000514443 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210000514443 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210000514443 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210000514443 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210000514443 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210000514443 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210000514455 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210000514463 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210000514463 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210000514464 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:05:17.739201 run osmo-msc_10.42.42.6(pid=509): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=509)] 00:05:17.789743 run osmo-msc_10.42.42.6(pid=509): stdout: | (launched: 2022-12-10_00:05:16.303176) 00:05:17.841632 run osmo-msc_10.42.42.6(pid=509): stderr: | 20221210000517050 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210000517050 DLGLOBAL DEBUG validating counter group 0x7f61ee1eec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210000517050 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210000517050 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210000517050 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210000517050 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210000517052 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210000517052 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210000517053 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210000517053 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:05:17.893924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=502): Terminating (SIGTERM) 00:05:17.936172 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=505): Terminating (SIGTERM) 00:05:17.978293 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=508): Terminating (SIGTERM) 00:05:18.020840 --- ParallelTerminationStrategy: PID 502 died... 00:05:18.040887 run pcap-recorder_any(filters='host 10.42.42.2')(pid=502): Terminated: ok {rc=0} 00:05:18.088368 --- ParallelTerminationStrategy: PID 505 died... 00:05:18.107933 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=505): Terminated: ok {rc=0} 00:05:18.155323 --- ParallelTerminationStrategy: PID 508 died... 00:05:18.174753 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=508): Terminated: ok {rc=0} 00:05:18.263247 bus /sierra_3: Setting Powered False 00:05:19.361385 bus /sierra_3: Setting Powered False 00:05:20.476931 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 00:05:21.624808 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:05:21.637108 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 00:05:21.703899 tst mo_mt_call_osmux.py: using LAC 24607 00:05:21.828668 tst mo_mt_call_osmux.py: using RAC 127 00:05:21.953638 tst mo_mt_call_osmux.py: using CellId 24607 00:05:22.071068 tst mo_mt_call_osmux.py: using BVCI 24608 00:05:22.181942 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:05:22.193259 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:05:22.204291 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:05:22.215443 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:05:22.226750 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:05:22.237868 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 00:05:22.356027 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 00:05:22.476298 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:05:22.973284 run create_hlr_db(pid=511): Launched 00:05:23.096732 bus /sierra_2: Setting Powered False 00:05:24.160537 run create_hlr_db(pid=511): Terminated: ok {rc=0} 00:05:24.588289 run pcap-recorder_any(filters='host 10.42.42.2')(pid=513): Launched 00:05:24.887355 run osmo-hlr_10.42.42.2(pid=514): Launched 00:05:25.001356 run osmo-stp_10.42.42.5: Starting osmo-stp 00:05:25.530571 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=516): Launched 00:05:25.829092 run osmo-stp_10.42.42.5(pid=517): Launched 00:05:25.942718 run osmo-msc_10.42.42.6: Starting osmo-msc 00:05:26.482145 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=519): Launched 00:05:26.780732 run osmo-msc_10.42.42.6(pid=520): Launched 00:05:26.947985 run osmo-stp_10.42.42.5(pid=517): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=517)] 00:05:27.074428 run osmo-stp_10.42.42.5(pid=517): stdout: | (launched: 2022-12-10_00:05:25.773996) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:05:27.200637 run osmo-stp_10.42.42.5(pid=517): stderr: | 20221210000525943 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000525943 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000525943 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000525944 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000525946 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000525946 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000525946 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:05:27.324885 run osmo-stp_10.42.42.5(pid=517): stdout: | (launched: 2022-12-10_00:05:25.773996) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:05:27.444091 run osmo-stp_10.42.42.5(pid=517): stderr: | 20221210000525943 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000525943 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000525943 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000525944 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000525946 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000525946 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000525946 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:05:27.586405 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=517): Process ended prematurely: osmo-stp_10.42.42.5(pid=517) [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=517)] [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 00:05:27.595128 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 00:05:27.621469 run osmo-hlr_10.42.42.2(pid=514): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=514)] 00:05:27.668700 run osmo-hlr_10.42.42.2(pid=514): stdout: | (launched: 2022-12-10_00:05:24.832507) 00:05:27.717451 run osmo-hlr_10.42.42.2(pid=514): stderr: | 20221210000525007 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210000525007 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210000525008 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210000525008 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210000525008 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210000525008 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210000525020 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210000525028 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210000525029 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210000525029 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:05:27.785546 run osmo-msc_10.42.42.6(pid=520): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=520)] 00:05:27.832322 run osmo-msc_10.42.42.6(pid=520): stdout: | (launched: 2022-12-10_00:05:26.725691) 00:05:27.880557 run osmo-msc_10.42.42.6(pid=520): stderr: | 20221210000527001 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210000527001 DLGLOBAL DEBUG validating counter group 0x7f7cedf17c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210000527001 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210000527001 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210000527001 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210000527002 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210000527003 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210000527004 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210000527004 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210000527004 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:05:27.929572 run pcap-recorder_any(filters='host 10.42.42.2')(pid=513): Terminating (SIGTERM) 00:05:27.968437 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=516): Terminating (SIGTERM) 00:05:28.007213 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=519): Terminating (SIGTERM) 00:05:28.046683 --- ParallelTerminationStrategy: PID 513 died... 00:05:28.065550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=513): Terminated: ok {rc=0} 00:05:28.108903 --- ParallelTerminationStrategy: PID 516 died... 00:05:28.127561 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=516): Terminated: ok {rc=0} 00:05:28.171008 --- ParallelTerminationStrategy: PID 519 died... 00:05:28.189685 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=519): Terminated: ok {rc=0} 00:05:28.272722 bus /sierra_3: Setting Powered False 00:05:29.368791 bus /sierra_3: Setting Powered False 00:05:30.484436 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 00:05:31.738630 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:05:31.746274 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 00:05:31.778910 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 00:05:31.809157 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 00:05:31.865700 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 00:05:31.926409 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 00:05:31.954583 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 00:05:32.472165 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 00:05:32.520353 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:05:32.531811 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 00:05:32.596775 tst mo_mt_call.py: using LAC 24608 00:05:32.713808 tst mo_mt_call.py: using RAC 128 00:05:32.831346 tst mo_mt_call.py: using CellId 24608 00:05:32.948788 tst mo_mt_call.py: using BVCI 24609 00:05:33.057318 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:05:33.068506 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:05:33.079531 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:05:33.090610 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:05:33.101830 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:05:33.112777 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 00:05:33.228726 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 00:05:33.347156 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:05:33.813930 run create_hlr_db(pid=525): Launched 00:05:33.935523 bus /sierra_2: Setting Powered False 00:05:34.996628 run create_hlr_db(pid=525): Terminated: ok {rc=0} 00:05:35.415587 run pcap-recorder_any(filters='host 10.42.42.2')(pid=527): Launched 00:05:35.715985 run osmo-hlr_10.42.42.2(pid=528): Launched 00:05:35.829845 run osmo-stp_10.42.42.5: Starting osmo-stp 00:05:36.345315 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=530): Launched 00:05:36.643848 run osmo-stp_10.42.42.5(pid=531): Launched 00:05:36.757804 run osmo-msc_10.42.42.6: Starting osmo-msc 00:05:37.300384 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=533): Launched 00:05:37.602213 run osmo-msc_10.42.42.6(pid=534): Launched 00:05:37.786068 run osmo-stp_10.42.42.5(pid=531): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=531)] 00:05:37.924838 run osmo-stp_10.42.42.5(pid=531): stdout: | (launched: 2022-12-10_00:05:36.589183) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:05:38.063818 run osmo-stp_10.42.42.5(pid=531): stderr: | 20221210000536758 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000536758 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000536758 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000536759 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000536759 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000536759 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000536759 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:05:38.199818 run osmo-stp_10.42.42.5(pid=531): stdout: | (launched: 2022-12-10_00:05:36.589183) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:05:38.329323 run osmo-stp_10.42.42.5(pid=531): stderr: | 20221210000536758 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000536758 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000536758 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000536759 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000536759 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000536759 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000536759 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:05:38.484477 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=531): Process ended prematurely: osmo-stp_10.42.42.5(pid=531) [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=531)] [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 00:05:38.494412 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 00:05:38.524430 run osmo-hlr_10.42.42.2(pid=528): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=528)] 00:05:38.575696 run osmo-hlr_10.42.42.2(pid=528): stdout: | (launched: 2022-12-10_00:05:35.661124) 00:05:38.628017 run osmo-hlr_10.42.42.2(pid=528): stderr: | 20221210000535842 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210000535842 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210000535842 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210000535842 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210000535842 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210000535842 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210000535880 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210000535889 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210000535890 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210000535890 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:05:38.700200 run osmo-msc_10.42.42.6(pid=534): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=534)] 00:05:38.750214 run osmo-msc_10.42.42.6(pid=534): stdout: | (launched: 2022-12-10_00:05:37.546021) 00:05:38.801922 run osmo-msc_10.42.42.6(pid=534): stderr: | 20221210000537861 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210000537861 DLGLOBAL DEBUG validating counter group 0x7fcbf578dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210000537861 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210000537862 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210000537862 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210000537862 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210000537864 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210000537864 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210000537864 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210000537864 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:05:38.854010 run pcap-recorder_any(filters='host 10.42.42.2')(pid=527): Terminating (SIGTERM) 00:05:38.895723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=530): Terminating (SIGTERM) 00:05:38.937463 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=533): Terminating (SIGTERM) 00:05:38.979616 --- ParallelTerminationStrategy: PID 527 died... 00:05:38.999433 run pcap-recorder_any(filters='host 10.42.42.2')(pid=527): Terminated: ok {rc=0} 00:05:39.046503 --- ParallelTerminationStrategy: PID 530 died... 00:05:39.066004 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=530): Terminated: ok {rc=0} 00:05:39.112246 --- ParallelTerminationStrategy: PID 533 died... 00:05:39.131918 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=533): Terminated: ok {rc=0} 00:05:39.219109 bus /sierra_3: Setting Powered False 00:05:40.318403 bus /sierra_3: Setting Powered False 00:05:41.433182 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 00:05:42.582750 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:05:42.595715 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 00:05:42.667406 tst mo_mt_call_osmux.py: using LAC 24609 00:05:42.793613 tst mo_mt_call_osmux.py: using RAC 129 00:05:42.918138 tst mo_mt_call_osmux.py: using CellId 24609 00:05:43.043012 tst mo_mt_call_osmux.py: using BVCI 24610 00:05:43.160358 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:05:43.172131 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:05:43.183782 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:05:43.195489 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:05:43.209250 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 00:05:43.220615 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 00:05:43.335596 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 00:05:43.456810 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:05:43.954470 run create_hlr_db(pid=536): Launched 00:05:44.077230 bus /sierra_2: Setting Powered False 00:05:45.141233 run create_hlr_db(pid=536): Terminated: ok {rc=0} 00:05:45.571649 run pcap-recorder_any(filters='host 10.42.42.2')(pid=538): Launched 00:05:45.880527 run osmo-hlr_10.42.42.2(pid=539): Launched 00:05:46.112407 run osmo-stp_10.42.42.5: Starting osmo-stp 00:05:46.749770 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=541): Launched 00:05:47.074756 run osmo-stp_10.42.42.5(pid=542): Launched 00:05:47.296137 run osmo-msc_10.42.42.6: Starting osmo-msc 00:05:47.916266 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=544): Launched 00:05:48.237600 run osmo-msc_10.42.42.6(pid=545): Launched 00:05:48.418621 run osmo-stp_10.42.42.5(pid=542): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=542)] 00:05:48.555528 run osmo-stp_10.42.42.5(pid=542): stdout: | (launched: 2022-12-10_00:05:47.005662) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:05:48.692717 run osmo-stp_10.42.42.5(pid=542): stderr: | 20221210000547228 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000547228 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000547228 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000547229 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000547229 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000547229 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000547229 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:05:48.828645 run osmo-stp_10.42.42.5(pid=542): stdout: | (launched: 2022-12-10_00:05:47.005662) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:05:48.957213 run osmo-stp_10.42.42.5(pid=542): stderr: | 20221210000547228 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000547228 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000547228 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000547229 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000547229 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000547229 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000547229 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:05:49.111330 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=542): Process ended prematurely: osmo-stp_10.42.42.5(pid=542) [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=542)] [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 00:05:49.120766 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 00:05:49.149311 run osmo-hlr_10.42.42.2(pid=539): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=539)] 00:05:49.199676 run osmo-hlr_10.42.42.2(pid=539): stdout: | (launched: 2022-12-10_00:05:45.817099) 00:05:49.251630 run osmo-hlr_10.42.42.2(pid=539): stderr: | 20221210000546086 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210000546086 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210000546086 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210000546087 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210000546087 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210000546087 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210000546103 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210000546118 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210000546118 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210000546118 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:05:49.324478 run osmo-msc_10.42.42.6(pid=545): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=545)] 00:05:49.374666 run osmo-msc_10.42.42.6(pid=545): stdout: | (launched: 2022-12-10_00:05:48.179108) 00:05:49.426585 run osmo-msc_10.42.42.6(pid=545): stderr: | 20221210000548501 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210000548501 DLGLOBAL DEBUG validating counter group 0x7fb647399c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210000548501 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210000548501 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210000548501 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210000548501 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210000548503 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210000548503 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210000548504 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210000548504 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:05:49.479213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=538): Terminating (SIGTERM) 00:05:49.521274 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=541): Terminating (SIGTERM) 00:05:49.563266 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=544): Terminating (SIGTERM) 00:05:49.605723 --- ParallelTerminationStrategy: PID 538 died... 00:05:49.625888 run pcap-recorder_any(filters='host 10.42.42.2')(pid=538): Terminated: ok {rc=0} 00:05:49.673173 --- ParallelTerminationStrategy: PID 541 died... 00:05:49.693010 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=541): Terminated: ok {rc=0} 00:05:49.739631 --- ParallelTerminationStrategy: PID 544 died... 00:05:49.759362 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=544): Terminated: ok {rc=0} 00:05:49.847219 bus /sierra_3: Setting Powered False 00:05:50.945336 bus /sierra_3: Setting Powered False 00:05:52.061943 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 00:05:53.309610 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:05:53.316699 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 00:05:53.347647 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 00:05:53.375371 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 00:05:53.433328 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 00:05:53.464467 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 00:05:53.492488 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 00:05:54.044584 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 00:05:54.096641 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:05:54.108288 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 00:05:54.172725 tst mo_mt_call.py: using LAC 24610 00:05:54.296684 tst mo_mt_call.py: using RAC 130 00:05:54.427631 tst mo_mt_call.py: using CellId 24610 00:05:54.563435 tst mo_mt_call.py: using BVCI 24611 00:05:54.673488 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:05:54.684711 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:05:54.695952 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:05:54.707327 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:05:54.718672 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:05:54.730059 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 00:05:54.850042 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 00:05:54.971067 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:05:55.468878 run create_hlr_db(pid=550): Launched 00:05:55.592029 bus /sierra_2: Setting Powered False 00:05:56.656269 run create_hlr_db(pid=550): Terminated: ok {rc=0} 00:05:57.103846 run pcap-recorder_any(filters='host 10.42.42.2')(pid=552): Launched 00:05:57.424746 run osmo-hlr_10.42.42.2(pid=553): Launched 00:05:57.548428 run osmo-stp_10.42.42.5: Starting osmo-stp 00:05:58.105697 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=555): Launched 00:05:58.427430 run osmo-stp_10.42.42.5(pid=556): Launched 00:05:58.550631 run osmo-msc_10.42.42.6: Starting osmo-msc 00:05:59.131353 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=558): Launched 00:05:59.452903 run osmo-msc_10.42.42.6(pid=559): Launched 00:05:59.632572 run osmo-stp_10.42.42.5(pid=556): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=556)] 00:05:59.767587 run osmo-stp_10.42.42.5(pid=556): stdout: | (launched: 2022-12-10_00:05:58.368616) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:05:59.903242 run osmo-stp_10.42.42.5(pid=556): stderr: | 20221210000558560 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000558561 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000558561 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000558561 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000558562 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000558562 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000558562 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:06:00.038520 run osmo-stp_10.42.42.5(pid=556): stdout: | (launched: 2022-12-10_00:05:58.368616) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:06:00.166520 run osmo-stp_10.42.42.5(pid=556): stderr: | 20221210000558560 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000558561 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000558561 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000558561 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000558562 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000558562 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000558562 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:06:00.319839 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=556): Process ended prematurely: osmo-stp_10.42.42.5(pid=556) [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=556)] [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 00:06:00.329617 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 00:06:00.357489 run osmo-hlr_10.42.42.2(pid=553): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=553)] 00:06:00.407508 run osmo-hlr_10.42.42.2(pid=553): stdout: | (launched: 2022-12-10_00:05:57.366330) 00:06:00.458916 run osmo-hlr_10.42.42.2(pid=553): stderr: | 20221210000557566 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210000557566 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210000557566 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210000557566 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210000557566 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210000557567 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210000557579 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210000557587 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210000557587 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210000557587 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:06:00.530826 run osmo-msc_10.42.42.6(pid=559): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=559)] 00:06:00.580584 run osmo-msc_10.42.42.6(pid=559): stdout: | (launched: 2022-12-10_00:05:59.394357) 00:06:00.631681 run osmo-msc_10.42.42.6(pid=559): stderr: | 20221210000559717 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210000559717 DLGLOBAL DEBUG validating counter group 0x7f4eccbaec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210000559718 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210000559718 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210000559718 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210000559718 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210000559720 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210000559720 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210000559720 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210000559720 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:06:00.683349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=552): Terminating (SIGTERM) 00:06:00.724303 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=555): Terminating (SIGTERM) 00:06:00.765393 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=558): Terminating (SIGTERM) 00:06:00.807069 --- ParallelTerminationStrategy: PID 552 died... 00:06:00.826927 run pcap-recorder_any(filters='host 10.42.42.2')(pid=552): Terminated: ok {rc=0} 00:06:00.881217 --- ParallelTerminationStrategy: PID 555 died... 00:06:00.900350 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=555): Terminated: ok {rc=0} 00:06:00.953386 --- ParallelTerminationStrategy: PID 558 died... 00:06:00.972254 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=558): Terminated: ok {rc=0} 00:06:01.058751 bus /sierra_3: Setting Powered False 00:06:02.151558 bus /sierra_3: Setting Powered False 00:06:03.272511 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 00:06:04.420624 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:06:04.433021 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 00:06:04.501776 tst mo_mt_call_osmux.py: using LAC 24611 00:06:04.628898 tst mo_mt_call_osmux.py: using RAC 131 00:06:04.758140 tst mo_mt_call_osmux.py: using CellId 24611 00:06:04.883841 tst mo_mt_call_osmux.py: using BVCI 24612 00:06:05.000836 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:06:05.012595 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:06:05.024144 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:06:05.035855 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:06:05.047674 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:06:05.059463 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 00:06:05.178090 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 00:06:05.299244 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:06:05.799388 run create_hlr_db(pid=561): Launched 00:06:05.921146 bus /sierra_2: Setting Powered False 00:06:06.985301 run create_hlr_db(pid=561): Terminated: ok {rc=0} 00:06:07.416025 run pcap-recorder_any(filters='host 10.42.42.2')(pid=563): Launched 00:06:07.717634 run osmo-hlr_10.42.42.2(pid=564): Launched 00:06:07.832232 run osmo-stp_10.42.42.5: Starting osmo-stp 00:06:08.365676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=566): Launched 00:06:08.665080 run osmo-stp_10.42.42.5(pid=567): Launched 00:06:08.779014 run osmo-msc_10.42.42.6: Starting osmo-msc 00:06:09.321130 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=569): Launched 00:06:09.621579 run osmo-msc_10.42.42.6(pid=570): Launched 00:06:09.791372 run osmo-stp_10.42.42.5(pid=567): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=567)] 00:06:09.918854 run osmo-stp_10.42.42.5(pid=567): stdout: | (launched: 2022-12-10_00:06:08.610183) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:06:10.046351 run osmo-stp_10.42.42.5(pid=567): stderr: | 20221210000608779 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000608779 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000608780 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000608780 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000608781 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000608781 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000608781 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:06:10.171120 run osmo-stp_10.42.42.5(pid=567): stdout: | (launched: 2022-12-10_00:06:08.610183) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:06:10.291374 run osmo-stp_10.42.42.5(pid=567): stderr: | 20221210000608779 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000608779 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000608780 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000608780 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000608781 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000608781 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000608781 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:06:10.434424 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=567): Process ended prematurely: osmo-stp_10.42.42.5(pid=567) [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=567)] [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 00:06:10.443632 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 00:06:10.470164 run osmo-hlr_10.42.42.2(pid=564): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=564)] 00:06:10.517309 run osmo-hlr_10.42.42.2(pid=564): stdout: | (launched: 2022-12-10_00:06:07.661599) 00:06:10.566341 run osmo-hlr_10.42.42.2(pid=564): stderr: | 20221210000607837 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210000607837 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210000607838 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210000607838 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210000607838 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210000607838 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210000607850 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210000607859 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210000607859 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210000607859 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:06:10.634961 run osmo-msc_10.42.42.6(pid=570): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=570)] 00:06:10.682081 run osmo-msc_10.42.42.6(pid=570): stdout: | (launched: 2022-12-10_00:06:09.566182) 00:06:10.730834 run osmo-msc_10.42.42.6(pid=570): stderr: | 20221210000609841 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210000609841 DLGLOBAL DEBUG validating counter group 0x7f441f0d5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210000609841 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210000609841 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210000609842 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210000609842 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210000609843 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210000609844 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210000609844 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210000609844 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:06:10.780069 run pcap-recorder_any(filters='host 10.42.42.2')(pid=563): Terminating (SIGTERM) 00:06:10.818930 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=566): Terminating (SIGTERM) 00:06:10.858063 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=569): Terminating (SIGTERM) 00:06:10.897685 --- ParallelTerminationStrategy: PID 563 died... 00:06:10.916706 run pcap-recorder_any(filters='host 10.42.42.2')(pid=563): Terminated: ok {rc=0} 00:06:10.960552 --- ParallelTerminationStrategy: PID 566 died... 00:06:10.979290 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=566): Terminated: ok {rc=0} 00:06:11.022889 --- ParallelTerminationStrategy: PID 569 died... 00:06:11.041711 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=569): Terminated: ok {rc=0} 00:06:11.126771 bus /sierra_3: Setting Powered False 00:06:12.227000 bus /sierra_3: Setting Powered False 00:06:13.341303 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 00:06:14.585530 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:06:14.591923 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 00:06:14.623859 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 00:06:14.651499 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 00:06:14.705914 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 00:06:14.736771 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 00:06:14.764864 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 00:06:15.318221 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 00:06:15.370479 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:06:15.382488 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 00:06:15.451041 tst mo_mt_call.py: using LAC 24612 00:06:15.578393 tst mo_mt_call.py: using RAC 132 00:06:15.705079 tst mo_mt_call.py: using CellId 24612 00:06:15.825757 tst mo_mt_call.py: using BVCI 24613 00:06:15.953439 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:06:15.965447 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:06:15.977707 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:06:15.990377 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:06:16.002864 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:06:16.015650 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:06:16.157636 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:06:16.279601 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:06:16.797360 run create_hlr_db(pid=575): Launched 00:06:16.953645 bus /sierra_2: Setting Powered False 00:06:18.013829 run create_hlr_db(pid=575): Terminated: ok {rc=0} 00:06:18.464228 run pcap-recorder_any(filters='host 10.42.42.2')(pid=577): Launched 00:06:18.785949 run osmo-hlr_10.42.42.2(pid=578): Launched 00:06:18.909088 run osmo-stp_10.42.42.5: Starting osmo-stp 00:06:19.468498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=580): Launched 00:06:19.790740 run osmo-stp_10.42.42.5(pid=581): Launched 00:06:19.913482 run osmo-msc_10.42.42.6: Starting osmo-msc 00:06:20.497390 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=583): Launched 00:06:20.818935 run osmo-msc_10.42.42.6(pid=584): Launched 00:06:20.998514 run osmo-stp_10.42.42.5(pid=581): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=581)] 00:06:21.134494 run osmo-stp_10.42.42.5(pid=581): stdout: | (launched: 2022-12-10_00:06:19.731695) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:06:21.270864 run osmo-stp_10.42.42.5(pid=581): stderr: | 20221210000619924 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000619924 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000619924 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000619924 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000619925 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000619925 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000619925 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:06:21.406741 run osmo-stp_10.42.42.5(pid=581): stdout: | (launched: 2022-12-10_00:06:19.731695) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:06:21.536075 run osmo-stp_10.42.42.5(pid=581): stderr: | 20221210000619924 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000619924 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000619924 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000619924 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000619925 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000619925 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000619925 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:06:21.690178 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=581): Process ended prematurely: osmo-stp_10.42.42.5(pid=581) [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=581)] [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 00:06:21.699854 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 00:06:21.728622 run osmo-hlr_10.42.42.2(pid=578): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=578)] 00:06:21.779462 run osmo-hlr_10.42.42.2(pid=578): stdout: | (launched: 2022-12-10_00:06:18.727614) 00:06:21.831883 run osmo-hlr_10.42.42.2(pid=578): stderr: | 20221210000618926 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210000618926 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210000618926 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210000618926 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210000618926 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210000618926 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210000618938 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210000618946 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210000618946 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210000618946 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:06:21.905106 run osmo-msc_10.42.42.6(pid=584): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=584)] 00:06:21.955500 run osmo-msc_10.42.42.6(pid=584): stdout: | (launched: 2022-12-10_00:06:20.760150) 00:06:22.007501 run osmo-msc_10.42.42.6(pid=584): stderr: | 20221210000621079 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210000621080 DLGLOBAL DEBUG validating counter group 0x7f0fe3829c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210000621080 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210000621080 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210000621080 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210000621080 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210000621082 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210000621082 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210000621082 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210000621083 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:06:22.059932 run pcap-recorder_any(filters='host 10.42.42.2')(pid=577): Terminating (SIGTERM) 00:06:22.102401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=580): Terminating (SIGTERM) 00:06:22.145260 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=583): Terminating (SIGTERM) 00:06:22.188284 --- ParallelTerminationStrategy: PID 577 died... 00:06:22.209380 run pcap-recorder_any(filters='host 10.42.42.2')(pid=577): Terminated: ok {rc=0} 00:06:22.254750 --- ParallelTerminationStrategy: PID 580 died... 00:06:22.273587 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=580): Terminated: ok {rc=0} 00:06:22.318602 --- ParallelTerminationStrategy: PID 583 died... 00:06:22.337367 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=583): Terminated: ok {rc=0} 00:06:22.421970 bus /sierra_3: Setting Powered False 00:06:23.521411 bus /sierra_3: Setting Powered False 00:06:24.639727 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 00:06:25.786201 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:06:25.798341 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 00:06:25.865737 tst mo_mt_call_osmux.py: using LAC 24613 00:06:25.988721 tst mo_mt_call_osmux.py: using RAC 133 00:06:26.106468 tst mo_mt_call_osmux.py: using CellId 24613 00:06:26.224229 tst mo_mt_call_osmux.py: using BVCI 24614 00:06:26.333309 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:06:26.344659 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:06:26.356246 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:06:26.367351 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:06:26.378603 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:06:26.389787 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:06:26.510468 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:06:26.631578 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:06:27.130553 run create_hlr_db(pid=586): Launched 00:06:27.253512 bus /sierra_2: Setting Powered False 00:06:28.317559 run create_hlr_db(pid=586): Terminated: ok {rc=0} 00:06:28.747341 run pcap-recorder_any(filters='host 10.42.42.2')(pid=588): Launched 00:06:29.046894 run osmo-hlr_10.42.42.2(pid=589): Launched 00:06:29.160665 run osmo-stp_10.42.42.5: Starting osmo-stp 00:06:29.694197 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=591): Launched 00:06:29.994847 run osmo-stp_10.42.42.5(pid=592): Launched 00:06:30.108263 run osmo-msc_10.42.42.6: Starting osmo-msc 00:06:30.651352 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=594): Launched 00:06:30.986560 run osmo-msc_10.42.42.6(pid=595): Launched 00:06:31.310911 run osmo-stp_10.42.42.5(pid=592): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=592)] 00:06:31.520286 run osmo-stp_10.42.42.5(pid=592): stdout: | (launched: 2022-12-10_00:06:29.939565) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:06:31.860428 run osmo-stp_10.42.42.5(pid=592): stderr: | 20221210000630110 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000630110 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000630111 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000630111 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000630111 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000630112 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000630112 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:06:32.102944 run osmo-stp_10.42.42.5(pid=592): stdout: | (launched: 2022-12-10_00:06:29.939565) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:06:32.230942 run osmo-stp_10.42.42.5(pid=592): stderr: | 20221210000630110 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000630110 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000630111 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000630111 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000630111 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000630112 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000630112 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:06:32.376161 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=592): Process ended prematurely: osmo-stp_10.42.42.5(pid=592) [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=592)] [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 00:06:32.385536 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 00:06:32.412054 run osmo-hlr_10.42.42.2(pid=589): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=589)] 00:06:32.459743 run osmo-hlr_10.42.42.2(pid=589): stdout: | (launched: 2022-12-10_00:06:28.991964) 00:06:32.509263 run osmo-hlr_10.42.42.2(pid=589): stderr: | 20221210000629164 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210000629165 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210000629165 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210000629165 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210000629165 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210000629165 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210000629177 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210000629185 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210000629186 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210000629186 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:06:32.578229 run osmo-msc_10.42.42.6(pid=595): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=595)] 00:06:32.625475 run osmo-msc_10.42.42.6(pid=595): stdout: | (launched: 2022-12-10_00:06:30.923579) 00:06:32.674485 run osmo-msc_10.42.42.6(pid=595): stderr: | 20221210000631582 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210000631583 DLGLOBAL DEBUG validating counter group 0x7f944f70ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210000631583 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210000631583 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210000631583 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210000631583 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210000631586 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210000631587 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210000631587 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210000631587 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:06:32.723873 run pcap-recorder_any(filters='host 10.42.42.2')(pid=588): Terminating (SIGTERM) 00:06:32.763433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=591): Terminating (SIGTERM) 00:06:32.802945 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=594): Terminating (SIGTERM) 00:06:32.843001 --- ParallelTerminationStrategy: PID 588 died... 00:06:32.862290 run pcap-recorder_any(filters='host 10.42.42.2')(pid=588): Terminated: ok {rc=0} 00:06:32.906231 --- ParallelTerminationStrategy: PID 591 died... 00:06:32.925192 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=591): Terminated: ok {rc=0} 00:06:32.969490 --- ParallelTerminationStrategy: PID 594 died... 00:06:32.988163 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=594): Terminated: ok {rc=0} 00:06:33.073332 bus /sierra_3: Setting Powered False 00:06:34.173030 bus /sierra_3: Setting Powered False 00:06:35.286373 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 00:06:36.542275 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:06:36.548379 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 00:06:36.579505 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 00:06:36.606707 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 00:06:36.659128 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 00:06:36.689470 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 00:06:36.716825 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 00:06:37.269656 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 00:06:37.322686 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:06:37.334378 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:06:37.402015 tst mo_mt_call.py: using LAC 24614 00:06:37.532371 tst mo_mt_call.py: using RAC 134 00:06:37.650454 tst mo_mt_call.py: using CellId 24614 00:06:37.766342 tst mo_mt_call.py: using BVCI 24615 00:06:37.876660 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:06:37.887855 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:06:37.898813 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:06:37.909784 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:06:37.920660 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:06:37.931896 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 00:06:38.051403 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 00:06:38.167746 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:06:38.631524 run create_hlr_db(pid=600): Launched 00:06:38.753653 bus /sierra_2: Setting Powered False 00:06:39.813685 run create_hlr_db(pid=600): Terminated: ok {rc=0} 00:06:40.253079 run pcap-recorder_any(filters='host 10.42.42.2')(pid=602): Launched 00:06:40.574827 run osmo-hlr_10.42.42.2(pid=603): Launched 00:06:40.697363 run osmo-stp_10.42.42.5: Starting osmo-stp 00:06:41.247763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=605): Launched 00:06:41.569140 run osmo-stp_10.42.42.5(pid=606): Launched 00:06:41.692122 run osmo-msc_10.42.42.6: Starting osmo-msc 00:06:42.273234 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=608): Launched 00:06:42.596196 run osmo-msc_10.42.42.6(pid=609): Launched 00:06:42.775692 run osmo-stp_10.42.42.5(pid=606): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=606)] 00:06:42.911262 run osmo-stp_10.42.42.5(pid=606): stdout: | (launched: 2022-12-10_00:06:41.510718) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:06:43.047898 run osmo-stp_10.42.42.5(pid=606): stderr: | 20221210000641704 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000641704 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000641705 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000641705 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000641705 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000641705 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000641706 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:06:43.183608 run osmo-stp_10.42.42.5(pid=606): stdout: | (launched: 2022-12-10_00:06:41.510718) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:06:43.312110 run osmo-stp_10.42.42.5(pid=606): stderr: | 20221210000641704 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000641704 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000641705 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000641705 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000641705 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000641705 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000641706 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:06:43.465634 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=606): Process ended prematurely: osmo-stp_10.42.42.5(pid=606) [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=606)] [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 00:06:43.475395 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 00:06:43.504591 run osmo-hlr_10.42.42.2(pid=603): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=603)] 00:06:43.554805 run osmo-hlr_10.42.42.2(pid=603): stdout: | (launched: 2022-12-10_00:06:40.516028) 00:06:43.607061 run osmo-hlr_10.42.42.2(pid=603): stderr: | 20221210000640715 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210000640715 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210000640715 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210000640715 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210000640715 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210000640715 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210000640726 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210000640734 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210000640734 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210000640734 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:06:43.679473 run osmo-msc_10.42.42.6(pid=609): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=609)] 00:06:43.729761 run osmo-msc_10.42.42.6(pid=609): stdout: | (launched: 2022-12-10_00:06:42.537456) 00:06:43.781415 run osmo-msc_10.42.42.6(pid=609): stderr: | 20221210000642863 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210000642863 DLGLOBAL DEBUG validating counter group 0x7ff577dafc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210000642863 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210000642863 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210000642864 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210000642864 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210000642866 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210000642866 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210000642866 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210000642866 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:06:43.833552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=602): Terminating (SIGTERM) 00:06:43.875554 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=605): Terminating (SIGTERM) 00:06:43.917545 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=608): Terminating (SIGTERM) 00:06:43.959913 --- ParallelTerminationStrategy: PID 602 died... 00:06:43.979964 run pcap-recorder_any(filters='host 10.42.42.2')(pid=602): Terminated: ok {rc=0} 00:06:44.027164 --- ParallelTerminationStrategy: PID 605 died... 00:06:44.046847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=605): Terminated: ok {rc=0} 00:06:44.093731 --- ParallelTerminationStrategy: PID 608 died... 00:06:44.113391 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=608): Terminated: ok {rc=0} 00:06:44.200662 bus /sierra_3: Setting Powered False 00:06:45.299864 bus /sierra_3: Setting Powered False 00:06:46.413744 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 00:06:47.558038 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:06:47.570033 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:06:47.636271 tst mo_mt_call_osmux.py: using LAC 24615 00:06:47.756448 tst mo_mt_call_osmux.py: using RAC 135 00:06:47.875863 tst mo_mt_call_osmux.py: using CellId 24615 00:06:47.995268 tst mo_mt_call_osmux.py: using BVCI 24616 00:06:48.103874 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:06:48.115140 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:06:48.126173 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:06:48.136895 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:06:48.147838 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 00:06:48.158668 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 00:06:48.277628 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 00:06:48.393657 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:06:48.893544 run create_hlr_db(pid=611): Launched 00:06:49.016857 bus /sierra_2: Setting Powered False 00:06:50.079889 run create_hlr_db(pid=611): Terminated: ok {rc=0} 00:06:50.508835 run pcap-recorder_any(filters='host 10.42.42.2')(pid=613): Launched 00:06:50.831295 run osmo-hlr_10.42.42.2(pid=614): Launched 00:06:50.953846 run osmo-stp_10.42.42.5: Starting osmo-stp 00:06:51.510141 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=616): Launched 00:06:51.830895 run osmo-stp_10.42.42.5(pid=617): Launched 00:06:51.953749 run osmo-msc_10.42.42.6: Starting osmo-msc 00:06:52.535733 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=619): Launched 00:06:52.858143 run osmo-msc_10.42.42.6(pid=620): Launched 00:06:53.037249 run osmo-stp_10.42.42.5(pid=617): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=617)] 00:06:53.172731 run osmo-stp_10.42.42.5(pid=617): stdout: | (launched: 2022-12-10_00:06:51.772561) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:06:53.308856 run osmo-stp_10.42.42.5(pid=617): stderr: | 20221210000651962 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000651962 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000651963 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000651963 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000651964 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000651964 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000651964 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:06:53.444441 run osmo-stp_10.42.42.5(pid=617): stdout: | (launched: 2022-12-10_00:06:51.772561) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:06:53.573238 run osmo-stp_10.42.42.5(pid=617): stderr: | 20221210000651962 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000651962 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000651963 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000651963 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000651964 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000651964 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000651964 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:06:53.727004 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=617): Process ended prematurely: osmo-stp_10.42.42.5(pid=617) [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=617)] [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 00:06:53.736585 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 00:06:53.764824 run osmo-hlr_10.42.42.2(pid=614): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=614)] 00:06:53.815083 run osmo-hlr_10.42.42.2(pid=614): stdout: | (launched: 2022-12-10_00:06:50.772604) 00:06:53.866712 run osmo-hlr_10.42.42.2(pid=614): stderr: | 20221210000650971 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210000650971 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210000650971 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210000650971 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210000650971 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210000650972 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210000650984 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210000650992 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210000650993 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210000650993 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:06:53.938937 run osmo-msc_10.42.42.6(pid=620): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=620)] 00:06:53.988696 run osmo-msc_10.42.42.6(pid=620): stdout: | (launched: 2022-12-10_00:06:52.799468) 00:06:54.040091 run osmo-msc_10.42.42.6(pid=620): stderr: | 20221210000653119 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210000653119 DLGLOBAL DEBUG validating counter group 0x7f8f4844ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210000653119 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210000653119 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210000653119 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210000653120 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210000653121 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210000653122 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210000653122 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210000653122 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:06:54.092032 run pcap-recorder_any(filters='host 10.42.42.2')(pid=613): Terminating (SIGTERM) 00:06:54.133599 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=616): Terminating (SIGTERM) 00:06:54.175007 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=619): Terminating (SIGTERM) 00:06:54.217264 --- ParallelTerminationStrategy: PID 613 died... 00:06:54.237174 run pcap-recorder_any(filters='host 10.42.42.2')(pid=613): Terminated: ok {rc=0} 00:06:54.283581 --- ParallelTerminationStrategy: PID 616 died... 00:06:54.303120 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=616): Terminated: ok {rc=0} 00:06:54.349436 --- ParallelTerminationStrategy: PID 619 died... 00:06:54.369027 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=619): Terminated: ok {rc=0} 00:06:54.456224 bus /sierra_3: Setting Powered False 00:06:55.554506 bus /sierra_3: Setting Powered False 00:06:56.670555 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 emergency:trx-lms-limenet-micro --------------------------------------------------------------------- 00:06:57.918581 tst emergency:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:06:57.923481 tst emergency:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 00:06:57.954667 tst emergency:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 00:06:57.982317 tst emergency:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 00:06:58.069105 tst emergency:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 00:06:58.100386 tst emergency:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 00:06:58.128487 tst emergency:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 00:06:58.710082 tst emergency:trx-lms-limenet-micro: RESERVED RESOURCES for emergency: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2366 emergency:trx-lms-limenet-micro emergency_mo_mt_call.py ---------------------------------------------- 00:06:58.715274 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:06:58.726355 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 00:06:58.776239 tst emergency_mo_mt_call.py: using LAC 24616 00:06:58.892721 tst emergency_mo_mt_call.py: using RAC 136 00:06:59.007326 tst emergency_mo_mt_call.py: using CellId 24616 00:06:59.122496 tst emergency_mo_mt_call.py: using BVCI 24617 00:06:59.230706 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:06:59.241636 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:06:59.252256 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:06:59.262959 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:06:59.273773 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:06:59.284315 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 00:06:59.402150 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 00:06:59.520585 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:06:59.976848 run create_hlr_db(pid=626): Launched 00:07:00.097287 bus /sierra_2: Setting Powered False 00:07:01.156023 run create_hlr_db(pid=626): Terminated: ok {rc=0} 00:07:01.583682 run pcap-recorder_any(filters='host 10.42.42.2')(pid=628): Launched 00:07:01.935235 run osmo-hlr_10.42.42.2(pid=629): Launched 00:07:02.214243 run osmo-stp_10.42.42.5: Starting osmo-stp 00:07:02.718083 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=631): Launched 00:07:03.010884 run osmo-stp_10.42.42.5(pid=632): Launched 00:07:03.131536 tst emergency_mo_mt_call.py: using MSISDN 7444 00:07:03.282972 run osmo-msc_10.42.42.6: Starting osmo-msc 00:07:03.815005 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=634): Launched 00:07:04.109597 run osmo-msc_10.42.42.6(pid=635): Launched 00:07:04.276273 run osmo-stp_10.42.42.5(pid=632): ERR: Terminated: ERROR {rc=1} [trial-2366↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=632)] 00:07:04.401618 run osmo-stp_10.42.42.5(pid=632): stdout: | (launched: 2022-12-10_00:07:02.956754) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:07:04.526678 run osmo-stp_10.42.42.5(pid=632): stderr: | 20221210000703126 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000703126 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000703126 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000703127 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000703127 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000703127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000703127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:07:04.649152 run osmo-stp_10.42.42.5(pid=632): stdout: | (launched: 2022-12-10_00:07:02.956754) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:07:04.766460 run osmo-stp_10.42.42.5(pid=632): stderr: | 20221210000703126 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000703126 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000703126 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000703127 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000703127 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000703127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000703127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:07:04.906725 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=632): Process ended prematurely: osmo-stp_10.42.42.5(pid=632) [trial-2366↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=632)] [trial-2366↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19] 00:07:04.914938 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 00:07:04.940742 run osmo-hlr_10.42.42.2(pid=629): ERR: Terminated: ERROR {rc=237} [trial-2366↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=629)] 00:07:04.987803 run osmo-hlr_10.42.42.2(pid=629): stdout: | (launched: 2022-12-10_00:07:01.873115) 00:07:05.036317 run osmo-hlr_10.42.42.2(pid=629): stderr: | 20221210000702112 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210000702112 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210000702112 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210000702112 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210000702113 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210000702113 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210000702126 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/emergency:trx-lms-limenet-micro/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210000702137 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210000702137 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210000702137 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:07:05.104421 run osmo-msc_10.42.42.6(pid=635): ERR: Terminated: ERROR {rc=2} [trial-2366↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=635)] 00:07:05.151622 run osmo-msc_10.42.42.6(pid=635): stdout: | (launched: 2022-12-10_00:07:04.055224) 00:07:05.200242 run osmo-msc_10.42.42.6(pid=635): stderr: | 20221210000704326 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210000704326 DLGLOBAL DEBUG validating counter group 0x7fb47dad4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210000704326 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210000704326 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210000704327 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210000704327 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210000704329 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210000704329 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210000704329 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210000704329 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:07:05.249074 run pcap-recorder_any(filters='host 10.42.42.2')(pid=628): Terminating (SIGTERM) 00:07:05.287869 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=631): Terminating (SIGTERM) 00:07:05.326720 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=634): Terminating (SIGTERM) 00:07:05.366016 --- ParallelTerminationStrategy: PID 628 died... 00:07:05.384867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=628): Terminated: ok {rc=0} 00:07:05.428683 --- ParallelTerminationStrategy: PID 631 died... 00:07:05.447235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=631): Terminated: ok {rc=0} 00:07:05.490562 --- ParallelTerminationStrategy: PID 634 died... 00:07:05.508858 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=634): Terminated: ok {rc=0} 00:07:05.593401 bus /sierra_3: Setting Powered False 00:07:06.692603 bus /sierra_3: Setting Powered False 00:07:07.807036 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 emergency:trx-lms-limenet-micro emergency_preemptive_call.py ---------------------------------------------- 00:07:08.896392 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:07:08.908451 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 00:07:08.957102 tst emergency_preemptive_call.py: using LAC 24617 00:07:09.082803 tst emergency_preemptive_call.py: using RAC 137 00:07:09.206882 tst emergency_preemptive_call.py: using CellId 24617 00:07:09.330982 tst emergency_preemptive_call.py: using BVCI 24618 00:07:09.446494 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:07:09.458011 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:07:09.469459 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:07:09.481168 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:07:09.492871 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:07:09.504787 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 00:07:09.620400 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 00:07:09.736456 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 00:07:09.854071 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 00:07:09.968674 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:07:10.430275 run create_hlr_db(pid=637): Launched 00:07:10.551520 bus /sierra_2: Setting Powered False 00:07:11.610727 run create_hlr_db(pid=637): Terminated: ok {rc=0} 00:07:12.043215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=639): Launched 00:07:12.361834 run osmo-hlr_10.42.42.2(pid=640): Launched 00:07:12.482988 run osmo-stp_10.42.42.5: Starting osmo-stp 00:07:13.032275 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=642): Launched 00:07:13.348545 run osmo-stp_10.42.42.5(pid=643): Launched 00:07:13.478484 tst emergency_preemptive_call.py: using MSISDN 7445 00:07:13.640424 run osmo-msc_10.42.42.6: Starting osmo-msc 00:07:14.206425 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=645): Launched 00:07:14.522083 run osmo-msc_10.42.42.6(pid=646): Launched 00:07:14.698856 run osmo-stp_10.42.42.5(pid=643): ERR: Terminated: ERROR {rc=1} [trial-2366↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=643)] 00:07:14.832424 run osmo-stp_10.42.42.5(pid=643): stdout: | (launched: 2022-12-10_00:07:13.290599) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:07:14.966635 run osmo-stp_10.42.42.5(pid=643): stderr: | 20221210000713483 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000713483 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000713483 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000713484 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000713484 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000713484 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000713484 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:07:15.100083 run osmo-stp_10.42.42.5(pid=643): stdout: | (launched: 2022-12-10_00:07:13.290599) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:07:15.226534 run osmo-stp_10.42.42.5(pid=643): stderr: | 20221210000713483 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000713483 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000713483 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000713484 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000713484 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000713484 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000713484 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:07:15.377116 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=643): Process ended prematurely: osmo-stp_10.42.42.5(pid=643) [trial-2366↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=643)] [trial-2366↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32] 00:07:15.386282 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 00:07:15.414146 run osmo-hlr_10.42.42.2(pid=640): ERR: Terminated: ERROR {rc=237} [trial-2366↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=640)] 00:07:15.464046 run osmo-hlr_10.42.42.2(pid=640): stdout: | (launched: 2022-12-10_00:07:12.304096) 00:07:15.516028 run osmo-hlr_10.42.42.2(pid=640): stderr: | 20221210000712500 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210000712500 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210000712500 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210000712500 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210000712500 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210000712501 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210000712514 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/emergency:trx-lms-limenet-micro/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210000712523 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210000712523 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210000712524 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:07:15.588763 run osmo-msc_10.42.42.6(pid=646): ERR: Terminated: ERROR {rc=2} [trial-2366↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=646)] 00:07:15.638557 run osmo-msc_10.42.42.6(pid=646): stdout: | (launched: 2022-12-10_00:07:14.463775) 00:07:15.690117 run osmo-msc_10.42.42.6(pid=646): stderr: | 20221210000714786 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210000714786 DLGLOBAL DEBUG validating counter group 0x7f0db5631c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210000714786 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210000714786 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210000714786 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210000714787 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210000714788 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210000714789 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210000714789 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210000714789 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:07:15.742319 run pcap-recorder_any(filters='host 10.42.42.2')(pid=639): Terminating (SIGTERM) 00:07:15.784314 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=642): Terminating (SIGTERM) 00:07:15.826282 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=645): Terminating (SIGTERM) 00:07:15.887662 --- ParallelTerminationStrategy: PID 639 died... 00:07:15.907850 run pcap-recorder_any(filters='host 10.42.42.2')(pid=639): Terminated: ok {rc=0} 00:07:15.954964 --- ParallelTerminationStrategy: PID 642 died... 00:07:15.974998 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=642): Terminated: ok {rc=0} 00:07:16.023658 --- ParallelTerminationStrategy: PID 645 died... 00:07:16.043812 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=645): Terminated: ok {rc=0} 00:07:16.133260 bus /sierra_9: Setting Powered False 00:07:17.243618 bus /sierra_9: Setting Powered False 00:07:18.360542 bus /sierra_8: Setting Powered False 00:07:19.458554 bus /sierra_8: Setting Powered False 00:07:20.573708 bus /sierra_3: Setting Powered False 00:07:21.671320 bus /sierra_3: Setting Powered False 00:07:22.790405 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 emergency:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 gprs:trx-lms-limenet-micro --------------------------------------------------------------------- 00:07:24.061585 tst gprs:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:07:24.065865 tst gprs:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 00:07:24.094879 tst gprs:trx-lms-limenet-micro: Verifying 9 x ip_address (candidates: 9) 00:07:24.133412 tst gprs:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 00:07:24.219695 tst gprs:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 00:07:24.248366 tst gprs:trx-lms-limenet-micro: Reserving 9 x ip_address (candidates: 9) 00:07:24.286488 tst gprs:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 00:07:24.879068 tst gprs:trx-lms-limenet-micro: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2366 gprs:trx-lms-limenet-micro cs_paging_gprs_active.py ---------------------------------------------- 00:07:24.928229 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:07:24.939056 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 00:07:24.983438 tst cs_paging_gprs_active.py: using LAC 24618 00:07:25.106741 tst cs_paging_gprs_active.py: using RAC 138 00:07:25.223420 tst cs_paging_gprs_active.py: using CellId 24618 00:07:25.339719 tst cs_paging_gprs_active.py: using BVCI 24619 00:07:25.448783 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:07:25.459575 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:07:25.470091 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:07:25.480495 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:07:25.490929 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:07:25.501481 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:07:25.512012 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:07:25.522600 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:07:25.533408 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 00:07:25.652795 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 00:07:25.772337 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 00:07:25.991603 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:07:26.315620 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=651): Launched 00:07:26.597409 run iperf3-srv_10.42.42.10(pid=652): Launched 00:07:26.718962 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 00:07:26.937760 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:07:27.263041 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=653): Launched 00:07:27.544026 run iperf3-srv_10.42.42.10(pid=654): Launched 00:07:27.665166 tst cs_paging_gprs_active.py:38: start network... 00:07:27.882794 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:07:28.382032 run create_hlr_db(pid=655): Launched 00:07:28.504829 bus /sierra_2: Setting Powered False 00:07:29.569209 run create_hlr_db(pid=655): Terminated: ok {rc=0} 00:07:29.998986 run pcap-recorder_any(filters='host 10.42.42.2')(pid=657): Launched 00:07:30.300028 run osmo-hlr_10.42.42.2(pid=658): Launched 00:07:30.415508 run osmo-stp_10.42.42.5: Starting osmo-stp 00:07:30.993647 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=660): Launched 00:07:31.345898 run osmo-stp_10.42.42.5(pid=661): Launched 00:07:31.601387 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:07:32.250851 run pcap-recorder_any(filters='host 10.42.42.6')(pid=663): Launched 00:07:32.375024 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:07:32.648105 run patchelf(pid=664): Launched 00:07:32.827299 run osmo-stp_10.42.42.5(pid=661): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=661)] 00:07:32.963807 run osmo-stp_10.42.42.5(pid=661): stdout: | (launched: 2022-12-10_00:07:31.281356) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:07:33.102969 run osmo-stp_10.42.42.5(pid=661): stderr: | 20221210000731590 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000731590 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000731590 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000731591 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000731591 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000731591 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000731591 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:07:33.241669 run osmo-stp_10.42.42.5(pid=661): stdout: | (launched: 2022-12-10_00:07:31.281356) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:07:33.373908 run osmo-stp_10.42.42.5(pid=661): stderr: | 20221210000731590 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000731590 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000731590 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000731591 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000731591 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000731591 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000731591 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:07:33.531186 run patchelf(pid=664): Terminating (SIGINT) 00:07:33.712372 run patchelf(pid=664): Terminated: ok {rc=0} 00:07:33.843317 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=661): Process ended prematurely: osmo-stp_10.42.42.5(pid=661) [trial-2366↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=661)] [trial-2366↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38] 00:07:33.853462 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 00:07:33.882790 run osmo-hlr_10.42.42.2(pid=658): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=658)] 00:07:33.932912 run osmo-hlr_10.42.42.2(pid=658): stdout: | (launched: 2022-12-10_00:07:30.244725) 00:07:33.984656 run osmo-hlr_10.42.42.2(pid=658): stderr: | 20221210000730422 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210000730422 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210000730422 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210000730422 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210000730422 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210000730422 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210000730434 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-lms-limenet-micro/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210000730444 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210000730445 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210000730445 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:07:34.036789 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=651): Terminating (SIGTERM) 00:07:34.078819 run iperf3-srv_10.42.42.10(pid=652): Terminating (SIGTERM) 00:07:34.120705 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=653): Terminating (SIGTERM) 00:07:34.162568 run iperf3-srv_10.42.42.10(pid=654): Terminating (SIGTERM) 00:07:34.204270 run pcap-recorder_any(filters='host 10.42.42.2')(pid=657): Terminating (SIGTERM) 00:07:34.246518 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=660): Terminating (SIGTERM) 00:07:34.288421 run pcap-recorder_any(filters='host 10.42.42.6')(pid=663): Terminating (SIGTERM) 00:07:34.330605 --- ParallelTerminationStrategy: PID 651 died... 00:07:34.350560 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=651): Terminated: ok {rc=0} 00:07:34.397190 --- ParallelTerminationStrategy: PID 652 died... 00:07:34.417255 run iperf3-srv_10.42.42.10(pid=652): Terminated {rc=256} 00:07:34.463614 --- ParallelTerminationStrategy: PID 653 died... 00:07:34.483166 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=653): Terminated: ok {rc=0} 00:07:34.529882 --- ParallelTerminationStrategy: PID 654 died... 00:07:34.549237 run iperf3-srv_10.42.42.10(pid=654): Terminated {rc=256} 00:07:34.595280 --- ParallelTerminationStrategy: PID 657 died... 00:07:34.614702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=657): Terminated: ok {rc=0} 00:07:34.660698 --- ParallelTerminationStrategy: PID 660 died... 00:07:34.680066 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=660): Terminated: ok {rc=0} 00:07:34.726443 --- ParallelTerminationStrategy: PID 663 died... 00:07:34.745871 run pcap-recorder_any(filters='host 10.42.42.6')(pid=663): Terminated: ok {rc=0} 00:07:34.832753 bus /gobi_0: Setting Powered False 00:07:35.935080 bus /gobi_0: Setting Powered False 00:07:37.050030 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-lms-limenet-micro iperf3.py ---------------------------------------------- 00:07:38.200296 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:07:38.212323 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 00:07:38.261345 tst iperf3.py: using LAC 24619 00:07:38.388143 tst iperf3.py: using RAC 139 00:07:38.520062 tst iperf3.py: using CellId 24619 00:07:38.645270 tst iperf3.py: using BVCI 24620 00:07:38.761812 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:07:38.773326 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:07:38.784503 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:07:38.795740 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:07:38.807097 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:07:38.818743 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:07:38.830467 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:07:38.841746 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:07:38.853366 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 00:07:38.968554 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 00:07:39.172747 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:07:39.474967 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=665): Launched 00:07:39.737177 run iperf3-srv_10.42.42.10(pid=666): Launched 00:07:39.849420 tst iperf3.py:8: start network... 00:07:40.050751 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:07:40.517781 run create_hlr_db(pid=667): Launched 00:07:40.641075 bus /gobi_6: Setting Powered False 00:07:41.701135 run create_hlr_db(pid=667): Terminated: ok {rc=0} 00:07:42.139045 run pcap-recorder_any(filters='host 10.42.42.2')(pid=669): Launched 00:07:42.460555 run osmo-hlr_10.42.42.2(pid=670): Launched 00:07:42.584669 run osmo-stp_10.42.42.5: Starting osmo-stp 00:07:43.140259 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=672): Launched 00:07:43.461355 run osmo-stp_10.42.42.5(pid=673): Launched 00:07:43.585412 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:07:44.144230 run pcap-recorder_any(filters='host 10.42.42.6')(pid=675): Launched 00:07:44.266883 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:07:44.538925 run patchelf(pid=676): Launched 00:07:44.717751 run osmo-stp_10.42.42.5(pid=673): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=673)] 00:07:44.853520 run osmo-stp_10.42.42.5(pid=673): stdout: | (launched: 2022-12-10_00:07:43.402553) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:07:44.991447 run osmo-stp_10.42.42.5(pid=673): stderr: | 20221210000743593 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000743593 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000743594 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000743594 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000743595 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000743595 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000743595 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:07:45.130039 run osmo-stp_10.42.42.5(pid=673): stdout: | (launched: 2022-12-10_00:07:43.402553) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:07:45.262094 run osmo-stp_10.42.42.5(pid=673): stderr: | 20221210000743593 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000743593 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000743594 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000743594 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000743595 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000743595 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000743595 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:07:45.418603 run patchelf(pid=676): Terminating (SIGINT) 00:07:45.599561 run patchelf(pid=676): Terminated: ok {rc=0} 00:07:45.729609 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=673): Process ended prematurely: osmo-stp_10.42.42.5(pid=673) [trial-2366↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=673)] [trial-2366↪gprs:trx-lms-limenet-micro↪iperf3.py:8] 00:07:45.739612 tst iperf3.py:8: Test FAILED (7.6 sec) 00:07:45.768094 run osmo-hlr_10.42.42.2(pid=670): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-lms-limenet-micro↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=670)] 00:07:45.817666 run osmo-hlr_10.42.42.2(pid=670): stdout: | (launched: 2022-12-10_00:07:42.401957) 00:07:45.877503 run osmo-hlr_10.42.42.2(pid=670): stderr: | 20221210000742601 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210000742601 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210000742602 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210000742602 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210000742602 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210000742602 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210000742614 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-lms-limenet-micro/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210000742623 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210000742623 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210000742623 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:07:45.944834 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=665): Terminating (SIGTERM) 00:07:45.988793 run iperf3-srv_10.42.42.10(pid=666): Terminating (SIGTERM) 00:07:46.052889 run pcap-recorder_any(filters='host 10.42.42.2')(pid=669): Terminating (SIGTERM) 00:07:46.097165 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=672): Terminating (SIGTERM) 00:07:46.140536 run pcap-recorder_any(filters='host 10.42.42.6')(pid=675): Terminating (SIGTERM) 00:07:46.184870 --- ParallelTerminationStrategy: PID 665 died... 00:07:46.205073 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=665): Terminated: ok {rc=0} 00:07:46.253604 --- ParallelTerminationStrategy: PID 666 died... 00:07:46.273334 run iperf3-srv_10.42.42.10(pid=666): Terminated {rc=256} 00:07:46.319205 --- ParallelTerminationStrategy: PID 669 died... 00:07:46.339039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=669): Terminated: ok {rc=0} 00:07:46.385292 --- ParallelTerminationStrategy: PID 672 died... 00:07:46.405123 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=672): Terminated: ok {rc=0} 00:07:46.452248 --- ParallelTerminationStrategy: PID 675 died... 00:07:46.471908 run pcap-recorder_any(filters='host 10.42.42.6')(pid=675): Terminated: ok {rc=0} 00:07:46.564086 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-lms-limenet-micro iperf3m4.py ---------------------------------------------- 00:07:47.714768 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:07:47.726823 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 00:07:47.776756 tst iperf3m4.py: using LAC 24620 00:07:47.902503 tst iperf3m4.py: using RAC 140 00:07:48.028339 tst iperf3m4.py: using CellId 24620 00:07:48.145412 tst iperf3m4.py: using BVCI 24621 00:07:48.256274 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:07:48.267358 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:07:48.278254 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:07:48.289054 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:07:48.300067 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:07:48.310818 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:07:48.321753 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:07:48.332412 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:07:48.343344 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 00:07:48.465119 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 00:07:48.587831 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 00:07:48.706601 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 00:07:48.825398 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 00:07:49.027912 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:07:49.330102 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=677): Launched 00:07:49.591608 run iperf3-srv_10.42.42.10(pid=678): Launched 00:07:49.704025 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 00:07:49.905384 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:07:50.206721 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=679): Launched 00:07:50.468416 run iperf3-srv_10.42.42.10(pid=680): Launched 00:07:50.581665 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 00:07:50.782991 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:07:51.084849 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=681): Launched 00:07:51.346690 run iperf3-srv_10.42.42.10(pid=682): Launched 00:07:51.458431 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 00:07:51.659985 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:07:51.962508 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=683): Launched 00:07:52.223793 run iperf3-srv_10.42.42.10(pid=684): Launched 00:07:52.336201 tst iperf3m4.py:8: start network... 00:07:52.538321 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:07:53.004396 run create_hlr_db(pid=685): Launched 00:07:53.126941 bus /gobi_6: Setting Powered False 00:07:54.190592 run create_hlr_db(pid=685): Terminated: ok {rc=0} 00:07:54.622830 run pcap-recorder_any(filters='host 10.42.42.2')(pid=687): Launched 00:07:54.923041 run osmo-hlr_10.42.42.2(pid=688): Launched 00:07:55.036191 run osmo-stp_10.42.42.5: Starting osmo-stp 00:07:55.676942 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=690): Launched 00:07:55.971403 run osmo-stp_10.42.42.5(pid=691): Launched 00:07:56.083477 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:07:56.594222 run pcap-recorder_any(filters='host 10.42.42.6')(pid=693): Launched 00:07:56.706814 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:07:56.956666 run patchelf(pid=694): Launched 00:07:57.121731 run osmo-stp_10.42.42.5(pid=691): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=691)] 00:07:57.246655 run osmo-stp_10.42.42.5(pid=691): stdout: | (launched: 2022-12-10_00:07:55.917344) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:07:57.373616 run osmo-stp_10.42.42.5(pid=691): stderr: | 20221210000756087 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000756087 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000756087 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000756087 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000756088 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000756088 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000756088 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:07:57.500865 run osmo-stp_10.42.42.5(pid=691): stdout: | (launched: 2022-12-10_00:07:55.917344) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:07:57.622270 run osmo-stp_10.42.42.5(pid=691): stderr: | 20221210000756087 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000756087 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000756087 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000756087 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000756088 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000756088 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000756088 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:07:57.765837 run patchelf(pid=694): Terminating (SIGINT) 00:07:57.932710 run patchelf(pid=694): Terminated: ok {rc=0} 00:07:58.052935 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=691): Process ended prematurely: osmo-stp_10.42.42.5(pid=691) [trial-2366↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=691)] [trial-2366↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8] 00:07:58.062454 tst iperf3m4.py:8: Test FAILED (10.4 sec) 00:07:58.089705 run osmo-hlr_10.42.42.2(pid=688): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-lms-limenet-micro↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=688)] 00:07:58.136650 run osmo-hlr_10.42.42.2(pid=688): stdout: | (launched: 2022-12-10_00:07:54.867476) 00:07:58.185421 run osmo-hlr_10.42.42.2(pid=688): stderr: | 20221210000755043 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210000755043 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210000755043 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210000755043 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210000755043 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210000755043 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210000755055 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-lms-limenet-micro/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210000755065 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210000755065 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210000755065 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:07:58.234509 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=677): Terminating (SIGTERM) 00:07:58.273477 run iperf3-srv_10.42.42.10(pid=678): Terminating (SIGTERM) 00:07:58.312413 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=679): Terminating (SIGTERM) 00:07:58.351308 run iperf3-srv_10.42.42.10(pid=680): Terminating (SIGTERM) 00:07:58.390149 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=681): Terminating (SIGTERM) 00:07:58.429218 run iperf3-srv_10.42.42.10(pid=682): Terminating (SIGTERM) 00:07:58.467974 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=683): Terminating (SIGTERM) 00:07:58.506849 run iperf3-srv_10.42.42.10(pid=684): Terminating (SIGTERM) 00:07:58.545803 run pcap-recorder_any(filters='host 10.42.42.2')(pid=687): Terminating (SIGTERM) 00:07:58.585315 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=690): Terminating (SIGTERM) 00:07:58.624282 run pcap-recorder_any(filters='host 10.42.42.6')(pid=693): Terminating (SIGTERM) 00:07:58.663500 --- ParallelTerminationStrategy: PID 677 died... 00:07:58.682535 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=677): Terminated: ok {rc=0} 00:07:58.726025 --- ParallelTerminationStrategy: PID 678 died... 00:07:58.744540 run iperf3-srv_10.42.42.10(pid=678): Terminated {rc=256} 00:07:58.787836 --- ParallelTerminationStrategy: PID 679 died... 00:07:58.806552 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=679): Terminated: ok {rc=0} 00:07:58.849958 --- ParallelTerminationStrategy: PID 680 died... 00:07:58.868513 run iperf3-srv_10.42.42.10(pid=680): Terminated {rc=256} 00:07:58.912158 --- ParallelTerminationStrategy: PID 681 died... 00:07:58.930747 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=681): Terminated: ok {rc=0} 00:07:58.974076 --- ParallelTerminationStrategy: PID 682 died... 00:07:58.992417 run iperf3-srv_10.42.42.10(pid=682): Terminated {rc=256} 00:07:59.035901 --- ParallelTerminationStrategy: PID 683 died... 00:07:59.054600 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=683): Terminated: ok {rc=0} 00:07:59.098543 --- ParallelTerminationStrategy: PID 684 died... 00:07:59.117052 run iperf3-srv_10.42.42.10(pid=684): Terminated {rc=256} 00:07:59.160488 --- ParallelTerminationStrategy: PID 687 died... 00:07:59.179073 run pcap-recorder_any(filters='host 10.42.42.2')(pid=687): Terminated: ok {rc=0} 00:07:59.222658 --- ParallelTerminationStrategy: PID 690 died... 00:07:59.241081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=690): Terminated: ok {rc=0} 00:07:59.284370 --- ParallelTerminationStrategy: PID 693 died... 00:07:59.302921 run pcap-recorder_any(filters='host 10.42.42.6')(pid=693): Terminated: ok {rc=0} 00:07:59.387916 bus /gobi_4: Setting Powered False 00:08:00.487160 bus /gobi_4: Setting Powered False 00:08:01.615145 bus /gobi_1: Setting Powered False 00:08:02.724698 bus /gobi_1: Setting Powered False 00:08:03.839421 bus /gobi_0: Setting Powered False 00:08:04.939581 bus /gobi_0: Setting Powered False 00:08:06.063068 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-lms-limenet-micro ping.py ---------------------------------------------- 00:08:07.170691 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:07.183446 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 00:08:07.234031 tst ping.py: using LAC 24621 00:08:07.357818 tst ping.py: using RAC 141 00:08:07.485952 tst ping.py: using CellId 24621 00:08:07.612736 tst ping.py: using BVCI 24622 00:08:07.730320 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:07.742418 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:07.754636 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:07.768355 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:07.781461 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:07.793441 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:07.807739 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:07.819796 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 00:08:07.944460 tst ping.py:19: start network... 00:08:08.159295 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:08:08.659327 run create_hlr_db(pid=708): Launched 00:08:08.818463 bus /gobi_6: Setting Powered False 00:08:09.882322 run create_hlr_db(pid=708): Terminated: ok {rc=0} 00:08:10.337998 run pcap-recorder_any(filters='host 10.42.42.2')(pid=710): Launched 00:08:10.677358 run osmo-hlr_10.42.42.2(pid=711): Launched 00:08:10.919482 run osmo-stp_10.42.42.5: Starting osmo-stp 00:08:11.580052 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=713): Launched 00:08:11.915503 run osmo-stp_10.42.42.5(pid=714): Launched 00:08:12.195408 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:08:12.869540 run pcap-recorder_any(filters='host 10.42.42.6')(pid=783): Launched 00:08:13.019640 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:08:13.340193 run patchelf(pid=857): Launched 00:08:13.549973 run osmo-stp_10.42.42.5(pid=714): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=714)] 00:08:13.696145 run osmo-stp_10.42.42.5(pid=714): stdout: | (launched: 2022-12-10_00:08:11.854310) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:08:13.841993 run osmo-stp_10.42.42.5(pid=714): stderr: | 20221210000812146 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000812146 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000812147 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000812147 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000812147 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000812148 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000812148 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:08:14.002793 run osmo-stp_10.42.42.5(pid=714): stdout: | (launched: 2022-12-10_00:08:11.854310) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:08:14.148774 run osmo-stp_10.42.42.5(pid=714): stderr: | 20221210000812146 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000812146 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000812147 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000812147 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000812147 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000812148 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000812148 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:08:14.317570 run patchelf(pid=857): Terminating (SIGINT) 00:08:14.487140 run patchelf(pid=857): Terminated: ok {rc=0} 00:08:14.607556 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=714): Process ended prematurely: osmo-stp_10.42.42.5(pid=714) [trial-2366↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=714)] [trial-2366↪gprs:trx-lms-limenet-micro↪ping.py:22] 00:08:14.617137 tst ping.py:22: Test FAILED (7.4 sec) 00:08:14.644790 run osmo-hlr_10.42.42.2(pid=711): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-lms-limenet-micro↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=711)] 00:08:14.693857 run osmo-hlr_10.42.42.2(pid=711): stdout: | (launched: 2022-12-10_00:08:10.611368) 00:08:14.745316 run osmo-hlr_10.42.42.2(pid=711): stderr: | 20221210000810924 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210000810924 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210000810924 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210000810924 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210000810924 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210000810924 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210000810940 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-lms-limenet-micro/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210000810948 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210000810948 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210000810948 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:08:14.796280 run pcap-recorder_any(filters='host 10.42.42.2')(pid=710): Terminating (SIGTERM) 00:08:14.837562 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=713): Terminating (SIGTERM) 00:08:14.880932 run pcap-recorder_any(filters='host 10.42.42.6')(pid=783): Terminating (SIGTERM) 00:08:14.924378 --- ParallelTerminationStrategy: PID 710 died... 00:08:14.944277 run pcap-recorder_any(filters='host 10.42.42.2')(pid=710): Terminated: ok {rc=0} 00:08:14.990918 --- ParallelTerminationStrategy: PID 713 died... 00:08:15.010416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=713): Terminated: ok {rc=0} 00:08:15.055258 --- ParallelTerminationStrategy: PID 783 died... 00:08:15.074680 run pcap-recorder_any(filters='host 10.42.42.6')(pid=783): Terminated: ok {rc=0} 00:08:15.160656 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-lms-limenet-micro ping_idle_ping.py ---------------------------------------------- 00:08:16.262440 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:16.278731 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 00:08:16.335259 tst ping_idle_ping.py: using LAC 24622 00:08:16.487903 tst ping_idle_ping.py: using RAC 142 00:08:16.638240 tst ping_idle_ping.py: using CellId 24622 00:08:16.781978 tst ping_idle_ping.py: using BVCI 24623 00:08:16.913540 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:16.927863 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:16.939955 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:16.953962 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:16.966771 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:16.979955 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:16.992892 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 00:08:17.005590 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 00:08:17.138659 tst ping_idle_ping.py:24: start network... 00:08:17.384776 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:08:17.949230 run create_hlr_db(pid=1005): Launched 00:08:18.104396 bus /gobi_6: Setting Powered False 00:08:19.164005 run create_hlr_db(pid=1005): Terminated: ok {rc=0} 00:08:19.593749 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1007): Launched 00:08:19.922538 run osmo-hlr_10.42.42.2(pid=1008): Launched 00:08:20.163119 run osmo-stp_10.42.42.5: Starting osmo-stp 00:08:20.817255 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1010): Launched 00:08:21.148512 run osmo-stp_10.42.42.5(pid=1011): Launched 00:08:21.389547 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:08:22.021228 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1013): Launched 00:08:22.152570 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:08:22.425121 run patchelf(pid=1014): Launched 00:08:22.617674 run osmo-stp_10.42.42.5(pid=1011): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1011)] 00:08:22.755816 run osmo-stp_10.42.42.5(pid=1011): stdout: | (launched: 2022-12-10_00:08:21.086704) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:08:22.894001 run osmo-stp_10.42.42.5(pid=1011): stderr: | 20221210000821381 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000821381 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000821381 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000821381 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000821384 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000821384 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000821384 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:08:23.032000 run osmo-stp_10.42.42.5(pid=1011): stdout: | (launched: 2022-12-10_00:08:21.086704) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:08:23.164107 run osmo-stp_10.42.42.5(pid=1011): stderr: | 20221210000821381 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000821381 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000821381 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000821381 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000821384 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000821384 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000821384 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:08:23.320257 run patchelf(pid=1014): Terminating (SIGINT) 00:08:23.500486 run patchelf(pid=1014): Terminated: ok {rc=0} 00:08:23.630989 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=1011): Process ended prematurely: osmo-stp_10.42.42.5(pid=1011) [trial-2366↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1011)] [trial-2366↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27] 00:08:23.641695 tst ping_idle_ping.py:27: Test FAILED (7.4 sec) 00:08:23.674585 run osmo-hlr_10.42.42.2(pid=1008): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1008)] 00:08:23.728518 run osmo-hlr_10.42.42.2(pid=1008): stdout: | (launched: 2022-12-10_00:08:19.860781) 00:08:23.782538 run osmo-hlr_10.42.42.2(pid=1008): stderr: | 20221210000820167 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210000820167 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210000820167 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210000820167 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210000820167 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210000820167 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210000820189 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-lms-limenet-micro/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210000820202 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210000820202 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210000820202 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:08:23.837279 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1007): Terminating (SIGTERM) 00:08:23.882214 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1010): Terminating (SIGTERM) 00:08:23.928406 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1013): Terminating (SIGTERM) 00:08:23.974827 --- ParallelTerminationStrategy: PID 1007 died... 00:08:23.995777 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1007): Terminated: ok {rc=0} 00:08:24.046564 --- ParallelTerminationStrategy: PID 1010 died... 00:08:24.066995 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1010): Terminated: ok {rc=0} 00:08:24.116286 --- ParallelTerminationStrategy: PID 1013 died... 00:08:24.136850 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1013): Terminated: ok {rc=0} 00:08:24.228224 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2366 gprs:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 gprs:trx-lms-limenet-micro+mod-bts0-egprs --------------------------------------------------------------------- 00:08:25.525846 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:08:25.531977 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 00:08:25.564458 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 00:08:25.604457 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 00:08:25.693787 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 00:08:25.724003 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 00:08:25.764273 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 00:08:26.360575 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2366 gprs:trx-lms-limenet-micro+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 00:08:26.413374 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:08:26.424841 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:08:26.473112 tst cs_paging_gprs_active.py: using LAC 24623 00:08:26.599635 tst cs_paging_gprs_active.py: using RAC 143 00:08:26.725960 tst cs_paging_gprs_active.py: using CellId 24623 00:08:26.851799 tst cs_paging_gprs_active.py: using BVCI 24624 00:08:26.968077 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:08:26.979512 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:08:26.990689 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:08:27.002753 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:08:27.014845 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:08:27.027687 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:08:27.039229 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:08:27.051189 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:08:27.064173 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:08:27.182389 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:08:27.300883 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 00:08:27.516746 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:08:27.835841 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1019): Launched 00:08:28.110958 run iperf3-srv_10.42.42.10(pid=1020): Launched 00:08:28.229522 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 00:08:28.442932 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:08:28.761661 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1021): Launched 00:08:29.037670 run iperf3-srv_10.42.42.10(pid=1022): Launched 00:08:29.157287 tst cs_paging_gprs_active.py:38: start network... 00:08:29.372247 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:08:29.865625 run create_hlr_db(pid=1023): Launched 00:08:29.987081 bus /gobi_6: Setting Powered False 00:08:31.066184 run create_hlr_db(pid=1023): Terminated: ok {rc=0} 00:08:31.535206 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1025): Launched 00:08:31.870755 run osmo-hlr_10.42.42.2(pid=1026): Launched 00:08:32.118628 run osmo-stp_10.42.42.5: Starting osmo-stp 00:08:32.725550 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1028): Launched 00:08:33.044792 run osmo-stp_10.42.42.5(pid=1029): Launched 00:08:33.166211 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:08:33.718631 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1031): Launched 00:08:33.839933 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:08:34.107519 run patchelf(pid=1032): Launched 00:08:34.283454 run osmo-stp_10.42.42.5(pid=1029): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1029)] 00:08:34.417936 run osmo-stp_10.42.42.5(pid=1029): stdout: | (launched: 2022-12-10_00:08:32.985987) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:08:34.554891 run osmo-stp_10.42.42.5(pid=1029): stderr: | 20221210000833178 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000833178 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000833178 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000833178 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000833179 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000833179 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000833179 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:08:34.691535 run osmo-stp_10.42.42.5(pid=1029): stdout: | (launched: 2022-12-10_00:08:32.985987) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:08:34.821647 run osmo-stp_10.42.42.5(pid=1029): stderr: | 20221210000833178 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000833178 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000833178 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000833178 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000833179 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000833179 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000833179 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:08:34.976072 run patchelf(pid=1032): Terminating (SIGINT) 00:08:35.155338 run patchelf(pid=1032): Terminated: ok {rc=0} 00:08:35.284352 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=1029): Process ended prematurely: osmo-stp_10.42.42.5(pid=1029) [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1029)] [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 00:08:35.294519 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 00:08:35.323137 run osmo-hlr_10.42.42.2(pid=1026): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1026)] 00:08:35.373417 run osmo-hlr_10.42.42.2(pid=1026): stdout: | (launched: 2022-12-10_00:08:31.800873) 00:08:35.424812 run osmo-hlr_10.42.42.2(pid=1026): stderr: | 20221210000832089 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210000832089 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210000832089 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210000832089 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210000832089 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210000832089 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210000832104 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-lms-limenet-micro+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210000832126 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210000832127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210000832127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:08:35.476833 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1019): Terminating (SIGTERM) 00:08:35.518640 run iperf3-srv_10.42.42.10(pid=1020): Terminating (SIGTERM) 00:08:35.560731 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1021): Terminating (SIGTERM) 00:08:35.602664 run iperf3-srv_10.42.42.10(pid=1022): Terminating (SIGTERM) 00:08:35.644174 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1025): Terminating (SIGTERM) 00:08:35.685944 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1028): Terminating (SIGTERM) 00:08:35.727637 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1031): Terminating (SIGTERM) 00:08:35.769596 --- ParallelTerminationStrategy: PID 1019 died... 00:08:35.789511 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1019): Terminated: ok {rc=0} 00:08:35.835878 --- ParallelTerminationStrategy: PID 1020 died... 00:08:35.855095 run iperf3-srv_10.42.42.10(pid=1020): Terminated {rc=256} 00:08:35.900814 --- ParallelTerminationStrategy: PID 1021 died... 00:08:35.920554 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1021): Terminated: ok {rc=0} 00:08:35.966608 --- ParallelTerminationStrategy: PID 1022 died... 00:08:35.985942 run iperf3-srv_10.42.42.10(pid=1022): Terminated {rc=256} 00:08:36.031950 --- ParallelTerminationStrategy: PID 1025 died... 00:08:36.051235 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1025): Terminated: ok {rc=0} 00:08:36.097355 --- ParallelTerminationStrategy: PID 1028 died... 00:08:36.116711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1028): Terminated: ok {rc=0} 00:08:36.163154 --- ParallelTerminationStrategy: PID 1031 died... 00:08:36.182650 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1031): Terminated: ok {rc=0} 00:08:36.269937 bus /gobi_0: Setting Powered False 00:08:37.367514 bus /gobi_0: Setting Powered False 00:08:38.482501 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3.py ---------------------------------------------- 00:08:39.631765 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:08:39.644009 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:08:39.693157 tst iperf3.py: using LAC 24624 00:08:39.818444 tst iperf3.py: using RAC 144 00:08:39.947860 tst iperf3.py: using CellId 24624 00:08:40.072093 tst iperf3.py: using BVCI 24625 00:08:40.187234 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:08:40.199000 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:08:40.210502 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:08:40.222106 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:08:40.233741 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:08:40.245493 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:08:40.257282 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:08:40.268914 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:08:40.280939 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:08:40.397941 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 00:08:40.612104 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:08:40.929223 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1033): Launched 00:08:41.203908 run iperf3-srv_10.42.42.10(pid=1034): Launched 00:08:41.322127 tst iperf3.py:8: start network... 00:08:41.535413 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:08:42.048932 run create_hlr_db(pid=1035): Launched 00:08:42.170322 bus /gobi_6: Setting Powered False 00:08:43.233582 run create_hlr_db(pid=1035): Terminated: ok {rc=0} 00:08:43.657101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1037): Launched 00:08:43.973914 run osmo-hlr_10.42.42.2(pid=1038): Launched 00:08:44.094154 run osmo-stp_10.42.42.5: Starting osmo-stp 00:08:44.640416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1040): Launched 00:08:44.956714 run osmo-stp_10.42.42.5(pid=1041): Launched 00:08:45.077050 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:08:45.620600 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1043): Launched 00:08:45.741120 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:08:46.030945 run patchelf(pid=1044): Launched 00:08:46.217690 run osmo-stp_10.42.42.5(pid=1041): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1041)] 00:08:46.346389 run osmo-stp_10.42.42.5(pid=1041): stdout: | (launched: 2022-12-10_00:08:44.899350) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:08:46.477259 run osmo-stp_10.42.42.5(pid=1041): stderr: | 20221210000845092 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000845092 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000845093 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000845093 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000845093 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000845094 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000845094 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:08:46.606944 run osmo-stp_10.42.42.5(pid=1041): stdout: | (launched: 2022-12-10_00:08:44.899350) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:08:46.733132 run osmo-stp_10.42.42.5(pid=1041): stderr: | 20221210000845092 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000845092 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000845093 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000845093 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000845093 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000845094 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000845094 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:08:46.881183 run patchelf(pid=1044): Terminating (SIGINT) 00:08:47.053111 run patchelf(pid=1044): Terminated: ok {rc=0} 00:08:47.175524 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1041): Process ended prematurely: osmo-stp_10.42.42.5(pid=1041) [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1041)] [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8] 00:08:47.185934 tst iperf3.py:8: Test FAILED (7.6 sec) 00:08:47.213661 run osmo-hlr_10.42.42.2(pid=1038): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1038)] 00:08:47.262227 run osmo-hlr_10.42.42.2(pid=1038): stdout: | (launched: 2022-12-10_00:08:43.916631) 00:08:47.310734 run osmo-hlr_10.42.42.2(pid=1038): stderr: | 20221210000844114 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210000844114 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210000844114 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210000844114 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210000844114 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210000844114 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210000844127 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210000844135 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210000844135 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210000844135 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:08:47.359524 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1033): Terminating (SIGTERM) 00:08:47.398702 run iperf3-srv_10.42.42.10(pid=1034): Terminating (SIGTERM) 00:08:47.439519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1037): Terminating (SIGTERM) 00:08:47.478939 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1040): Terminating (SIGTERM) 00:08:47.517776 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1043): Terminating (SIGTERM) 00:08:47.556844 --- ParallelTerminationStrategy: PID 1033 died... 00:08:47.575776 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1033): Terminated: ok {rc=0} 00:08:47.619477 --- ParallelTerminationStrategy: PID 1034 died... 00:08:47.637679 run iperf3-srv_10.42.42.10(pid=1034): Terminated {rc=256} 00:08:47.681013 --- ParallelTerminationStrategy: PID 1037 died... 00:08:47.699596 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1037): Terminated: ok {rc=0} 00:08:47.742397 --- ParallelTerminationStrategy: PID 1040 died... 00:08:47.760487 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1040): Terminated: ok {rc=0} 00:08:47.803745 --- ParallelTerminationStrategy: PID 1043 died... 00:08:47.822065 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1043): Terminated: ok {rc=0} 00:08:47.904145 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 00:08:49.052432 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:08:49.064648 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:08:49.114697 tst iperf3m4.py: using LAC 24625 00:08:49.238874 tst iperf3m4.py: using RAC 145 00:08:49.362828 tst iperf3m4.py: using CellId 24625 00:08:49.488128 tst iperf3m4.py: using BVCI 24626 00:08:49.605705 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:08:49.617132 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:08:49.628362 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:08:49.640130 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:08:49.651825 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:08:49.663524 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:08:49.675204 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:08:49.686728 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:08:49.698822 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:08:49.827028 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:08:49.946394 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:08:50.063984 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:08:50.182904 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 00:08:50.396169 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:08:50.713385 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1045): Launched 00:08:50.989174 run iperf3-srv_10.42.42.10(pid=1046): Launched 00:08:51.108159 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 00:08:51.322587 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:08:51.640638 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1047): Launched 00:08:51.915251 run iperf3-srv_10.42.42.10(pid=1048): Launched 00:08:52.033744 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 00:08:52.247958 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:08:52.566047 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1049): Launched 00:08:52.840750 run iperf3-srv_10.42.42.10(pid=1050): Launched 00:08:52.959332 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 00:08:53.174315 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:08:53.492180 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1051): Launched 00:08:53.768118 run iperf3-srv_10.42.42.10(pid=1052): Launched 00:08:53.886452 tst iperf3m4.py:8: start network... 00:08:54.100468 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:08:54.590090 run create_hlr_db(pid=1053): Launched 00:08:54.711020 bus /gobi_6: Setting Powered False 00:08:55.773535 run create_hlr_db(pid=1053): Terminated: ok {rc=0} 00:08:56.214177 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1055): Launched 00:08:56.529784 run osmo-hlr_10.42.42.2(pid=1056): Launched 00:08:56.651609 run osmo-stp_10.42.42.5: Starting osmo-stp 00:08:57.202073 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1058): Launched 00:08:57.518596 run osmo-stp_10.42.42.5(pid=1059): Launched 00:08:57.640213 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:08:58.186344 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1061): Launched 00:08:58.307311 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:08:58.575631 run patchelf(pid=1062): Launched 00:08:58.751938 run osmo-stp_10.42.42.5(pid=1059): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1059)] 00:08:58.886428 run osmo-stp_10.42.42.5(pid=1059): stdout: | (launched: 2022-12-10_00:08:57.460588) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:08:59.023082 run osmo-stp_10.42.42.5(pid=1059): stderr: | 20221210000857652 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000857652 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000857652 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000857653 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000857653 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000857653 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000857653 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:08:59.161804 run osmo-stp_10.42.42.5(pid=1059): stdout: | (launched: 2022-12-10_00:08:57.460588) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:08:59.292315 run osmo-stp_10.42.42.5(pid=1059): stderr: | 20221210000857652 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000857652 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000857652 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000857653 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000857653 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000857653 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000857653 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:08:59.447603 run patchelf(pid=1062): Terminating (SIGINT) 00:08:59.626977 run patchelf(pid=1062): Terminated: ok {rc=0} 00:08:59.755722 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1059): Process ended prematurely: osmo-stp_10.42.42.5(pid=1059) [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1059)] [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8] 00:08:59.766368 tst iperf3m4.py:8: Test FAILED (10.8 sec) 00:08:59.795979 run osmo-hlr_10.42.42.2(pid=1056): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1056)] 00:08:59.846526 run osmo-hlr_10.42.42.2(pid=1056): stdout: | (launched: 2022-12-10_00:08:56.472338) 00:08:59.898451 run osmo-hlr_10.42.42.2(pid=1056): stderr: | 20221210000856669 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210000856669 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210000856669 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210000856669 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210000856669 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210000856669 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210000856682 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210000856690 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210000856690 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210000856690 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:08:59.950680 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1045): Terminating (SIGTERM) 00:08:59.992201 run iperf3-srv_10.42.42.10(pid=1046): Terminating (SIGTERM) 00:09:00.033868 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1047): Terminating (SIGTERM) 00:09:00.076241 run iperf3-srv_10.42.42.10(pid=1048): Terminating (SIGTERM) 00:09:00.118242 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1049): Terminating (SIGTERM) 00:09:00.160323 run iperf3-srv_10.42.42.10(pid=1050): Terminating (SIGTERM) 00:09:00.202867 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1051): Terminating (SIGTERM) 00:09:00.245067 run iperf3-srv_10.42.42.10(pid=1052): Terminating (SIGTERM) 00:09:00.286923 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1055): Terminating (SIGTERM) 00:09:00.329057 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1058): Terminating (SIGTERM) 00:09:00.371039 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1061): Terminating (SIGTERM) 00:09:00.413217 --- ParallelTerminationStrategy: PID 1045 died... 00:09:00.433056 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1045): Terminated: ok {rc=0} 00:09:00.479901 --- ParallelTerminationStrategy: PID 1046 died... 00:09:00.499436 run iperf3-srv_10.42.42.10(pid=1046): Terminated {rc=256} 00:09:00.545968 --- ParallelTerminationStrategy: PID 1047 died... 00:09:00.565741 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1047): Terminated: ok {rc=0} 00:09:00.612434 --- ParallelTerminationStrategy: PID 1048 died... 00:09:00.631875 run iperf3-srv_10.42.42.10(pid=1048): Terminated {rc=256} 00:09:00.678450 --- ParallelTerminationStrategy: PID 1049 died... 00:09:00.697889 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1049): Terminated: ok {rc=0} 00:09:00.744286 --- ParallelTerminationStrategy: PID 1050 died... 00:09:00.763765 run iperf3-srv_10.42.42.10(pid=1050): Terminated {rc=256} 00:09:00.809917 --- ParallelTerminationStrategy: PID 1051 died... 00:09:00.831995 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1051): Terminated: ok {rc=0} 00:09:00.891671 --- ParallelTerminationStrategy: PID 1052 died... 00:09:00.918123 run iperf3-srv_10.42.42.10(pid=1052): Terminated {rc=256} 00:09:00.964292 --- ParallelTerminationStrategy: PID 1055 died... 00:09:00.983895 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1055): Terminated: ok {rc=0} 00:09:01.039598 --- ParallelTerminationStrategy: PID 1058 died... 00:09:01.060339 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1058): Terminated: ok {rc=0} 00:09:01.108734 --- ParallelTerminationStrategy: PID 1061 died... 00:09:01.128505 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1061): Terminated: ok {rc=0} 00:09:01.216771 bus /gobi_4: Setting Powered False 00:09:02.317330 bus /gobi_4: Setting Powered False 00:09:03.433415 bus /gobi_1: Setting Powered False 00:09:04.532022 bus /gobi_1: Setting Powered False 00:09:05.651249 bus /gobi_0: Setting Powered False 00:09:06.749739 bus /gobi_0: Setting Powered False 00:09:07.864624 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping.py ---------------------------------------------- 00:09:08.968500 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:08.980791 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:09:09.029242 tst ping.py: using LAC 24626 00:09:09.152643 tst ping.py: using RAC 146 00:09:09.274964 tst ping.py: using CellId 24626 00:09:09.396729 tst ping.py: using BVCI 24627 00:09:09.510633 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:09.522398 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:09.533939 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:09.545622 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:09.557615 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:09.569313 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:09.581243 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:09.593606 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:09:09.707094 tst ping.py:19: start network... 00:09:09.902205 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:09:10.352272 run create_hlr_db(pid=1065): Launched 00:09:10.470592 bus /gobi_6: Setting Powered False 00:09:11.528878 run create_hlr_db(pid=1065): Terminated: ok {rc=0} 00:09:11.933651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1067): Launched 00:09:12.224479 run osmo-hlr_10.42.42.2(pid=1068): Launched 00:09:12.335678 run osmo-stp_10.42.42.5: Starting osmo-stp 00:09:12.851355 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1070): Launched 00:09:13.140240 run osmo-stp_10.42.42.5(pid=1071): Launched 00:09:13.250934 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:09:13.752599 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1073): Launched 00:09:13.864482 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:09:14.110494 run patchelf(pid=1074): Launched 00:09:14.271713 run osmo-stp_10.42.42.5(pid=1071): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1071)] 00:09:14.394696 run osmo-stp_10.42.42.5(pid=1071): stdout: | (launched: 2022-12-10_00:09:13.086770) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:09:14.519407 run osmo-stp_10.42.42.5(pid=1071): stderr: | 20221210000913255 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000913256 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000913256 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000913256 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000913258 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000913259 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000913259 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:09:14.644300 run osmo-stp_10.42.42.5(pid=1071): stdout: | (launched: 2022-12-10_00:09:13.086770) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:09:14.763463 run osmo-stp_10.42.42.5(pid=1071): stderr: | 20221210000913255 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000913256 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000913256 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000913256 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000913258 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000913259 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000913259 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:09:14.904775 run patchelf(pid=1074): Terminating (SIGINT) 00:09:15.068154 run patchelf(pid=1074): Terminated: ok {rc=0} 00:09:15.186281 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=1071): Process ended prematurely: osmo-stp_10.42.42.5(pid=1071) [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1071)] [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22] 00:09:15.195169 tst ping.py:22: Test FAILED (6.2 sec) 00:09:15.221683 run osmo-hlr_10.42.42.2(pid=1068): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1068)] 00:09:15.268634 run osmo-hlr_10.42.42.2(pid=1068): stdout: | (launched: 2022-12-10_00:09:12.170983) 00:09:15.317411 run osmo-hlr_10.42.42.2(pid=1068): stderr: | 20221210000912348 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210000912348 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210000912348 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210000912348 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210000912348 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210000912348 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210000912361 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210000912369 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210000912369 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210000912369 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:09:15.366538 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1067): Terminating (SIGTERM) 00:09:15.405466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1070): Terminating (SIGTERM) 00:09:15.444326 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1073): Terminating (SIGTERM) 00:09:15.483527 --- ParallelTerminationStrategy: PID 1067 died... 00:09:15.502432 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1067): Terminated: ok {rc=0} 00:09:15.545996 --- ParallelTerminationStrategy: PID 1070 died... 00:09:15.564218 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1070): Terminated: ok {rc=0} 00:09:15.607560 --- ParallelTerminationStrategy: PID 1073 died... 00:09:15.625936 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1073): Terminated: ok {rc=0} 00:09:15.710690 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 00:09:16.800053 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:16.817997 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:09:16.869605 tst ping_idle_ping.py: using LAC 24627 00:09:16.997882 tst ping_idle_ping.py: using RAC 147 00:09:17.158574 tst ping_idle_ping.py: using CellId 24627 00:09:17.283215 tst ping_idle_ping.py: using BVCI 24628 00:09:17.398074 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:17.409787 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:17.421222 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:17.433284 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:17.445652 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:17.457773 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:17.469821 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:09:17.481750 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:09:17.597464 tst ping_idle_ping.py:24: start network... 00:09:17.793367 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:09:18.246318 run create_hlr_db(pid=1075): Launched 00:09:18.365695 bus /gobi_6: Setting Powered False 00:09:19.424709 run create_hlr_db(pid=1075): Terminated: ok {rc=0} 00:09:19.832691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1077): Launched 00:09:20.123773 run osmo-hlr_10.42.42.2(pid=1078): Launched 00:09:20.234724 run osmo-stp_10.42.42.5: Starting osmo-stp 00:09:20.735204 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1080): Launched 00:09:21.026182 run osmo-stp_10.42.42.5(pid=1081): Launched 00:09:21.137491 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:09:21.640554 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1083): Launched 00:09:21.751223 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:09:21.997430 run patchelf(pid=1084): Launched 00:09:22.159567 run osmo-stp_10.42.42.5(pid=1081): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1081)] 00:09:22.283027 run osmo-stp_10.42.42.5(pid=1081): stdout: | (launched: 2022-12-10_00:09:20.972250) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:09:22.408637 run osmo-stp_10.42.42.5(pid=1081): stderr: | 20221210000921142 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000921142 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000921143 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000921143 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000921143 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000921143 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000921144 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:09:22.534203 run osmo-stp_10.42.42.5(pid=1081): stdout: | (launched: 2022-12-10_00:09:20.972250) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:09:22.654263 run osmo-stp_10.42.42.5(pid=1081): stderr: | 20221210000921142 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000921142 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000921143 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000921143 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000921143 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000921143 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000921144 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:09:22.796132 run patchelf(pid=1084): Terminating (SIGINT) 00:09:22.960220 run patchelf(pid=1084): Terminated: ok {rc=0} 00:09:23.078325 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=1081): Process ended prematurely: osmo-stp_10.42.42.5(pid=1081) [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1081)] [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27] 00:09:23.087137 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 00:09:23.113431 run osmo-hlr_10.42.42.2(pid=1078): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1078)] 00:09:23.160486 run osmo-hlr_10.42.42.2(pid=1078): stdout: | (launched: 2022-12-10_00:09:20.069938) 00:09:23.209328 run osmo-hlr_10.42.42.2(pid=1078): stderr: | 20221210000920247 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210000920247 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210000920247 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210000920247 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210000920247 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210000920247 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210000920259 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210000920267 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210000920268 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210000920268 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:09:23.258829 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1077): Terminating (SIGTERM) 00:09:23.297907 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1080): Terminating (SIGTERM) 00:09:23.336882 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1083): Terminating (SIGTERM) 00:09:23.376341 --- ParallelTerminationStrategy: PID 1077 died... 00:09:23.395046 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1077): Terminated: ok {rc=0} 00:09:23.438678 --- ParallelTerminationStrategy: PID 1080 died... 00:09:23.456810 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1080): Terminated: ok {rc=0} 00:09:23.500303 --- ParallelTerminationStrategy: PID 1083 died... 00:09:23.518444 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1083): Terminated: ok {rc=0} 00:09:23.600168 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2366 gprs:trx-lms-limenet-micro+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa --------------------------------------------------------------------- 00:09:24.901146 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:09:24.907953 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 00:09:24.939289 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 00:09:24.978901 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 00:09:25.066221 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 00:09:25.096037 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 00:09:25.135212 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 00:09:25.734101 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2366 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 00:09:25.786372 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:09:25.797854 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:09:25.865359 tst cs_paging_gprs_active.py: using LAC 24628 00:09:25.982542 tst cs_paging_gprs_active.py: using RAC 148 00:09:26.100759 tst cs_paging_gprs_active.py: using CellId 24628 00:09:26.226667 tst cs_paging_gprs_active.py: using BVCI 24629 00:09:26.342269 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:09:26.353978 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:09:26.365476 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:09:26.377130 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:09:26.388767 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:09:26.400379 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:09:26.412612 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:09:26.424607 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:09:26.436764 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:09:26.552793 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:09:26.668463 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 00:09:26.870127 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:09:27.169590 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1088): Launched 00:09:27.430272 run iperf3-srv_10.42.42.10(pid=1089): Launched 00:09:27.541299 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 00:09:27.740581 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:09:28.038260 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1090): Launched 00:09:28.296653 run iperf3-srv_10.42.42.10(pid=1091): Launched 00:09:28.407411 tst cs_paging_gprs_active.py:38: start network... 00:09:28.605975 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:09:29.065210 run create_hlr_db(pid=1092): Launched 00:09:29.185874 bus /gobi_6: Setting Powered False 00:09:30.245887 run create_hlr_db(pid=1092): Terminated: ok {rc=0} 00:09:30.660276 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1094): Launched 00:09:30.982146 run osmo-hlr_10.42.42.2(pid=1095): Launched 00:09:31.209795 run osmo-stp_10.42.42.5: Starting osmo-stp 00:09:31.954013 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1097): Launched 00:09:32.273994 run osmo-stp_10.42.42.5(pid=1098): Launched 00:09:32.396241 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:09:32.947214 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1100): Launched 00:09:33.068891 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:09:33.337738 run patchelf(pid=1101): Launched 00:09:33.514254 run osmo-stp_10.42.42.5(pid=1098): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1098)] 00:09:33.649299 run osmo-stp_10.42.42.5(pid=1098): stdout: | (launched: 2022-12-10_00:09:32.213363) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:09:33.786185 run osmo-stp_10.42.42.5(pid=1098): stderr: | 20221210000932406 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000932406 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000932406 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000932406 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000932407 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000932407 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000932407 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:09:33.922615 run osmo-stp_10.42.42.5(pid=1098): stdout: | (launched: 2022-12-10_00:09:32.213363) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:09:34.052930 run osmo-stp_10.42.42.5(pid=1098): stderr: | 20221210000932406 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000932406 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000932406 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000932406 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000932407 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000932407 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000932407 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:09:34.207566 run patchelf(pid=1101): Terminating (SIGINT) 00:09:34.386587 run patchelf(pid=1101): Terminated: ok {rc=0} 00:09:34.515516 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=1098): Process ended prematurely: osmo-stp_10.42.42.5(pid=1098) [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1098)] [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 00:09:34.525575 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 00:09:34.554397 run osmo-hlr_10.42.42.2(pid=1095): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1095)] 00:09:34.604282 run osmo-hlr_10.42.42.2(pid=1095): stdout: | (launched: 2022-12-10_00:09:30.921259) 00:09:34.655832 run osmo-hlr_10.42.42.2(pid=1095): stderr: | 20221210000931272 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210000931272 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210000931272 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210000931272 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210000931272 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210000931272 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210000931284 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210000931300 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210000931300 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210000931300 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:09:34.708047 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1088): Terminating (SIGTERM) 00:09:34.749701 run iperf3-srv_10.42.42.10(pid=1089): Terminating (SIGTERM) 00:09:34.791277 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1090): Terminating (SIGTERM) 00:09:34.832917 run iperf3-srv_10.42.42.10(pid=1091): Terminating (SIGTERM) 00:09:34.874493 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1094): Terminating (SIGTERM) 00:09:34.916161 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1097): Terminating (SIGTERM) 00:09:34.957773 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1100): Terminating (SIGTERM) 00:09:34.999576 --- ParallelTerminationStrategy: PID 1088 died... 00:09:35.019391 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1088): Terminated: ok {rc=0} 00:09:35.065778 --- ParallelTerminationStrategy: PID 1089 died... 00:09:35.085251 run iperf3-srv_10.42.42.10(pid=1089): Terminated {rc=256} 00:09:35.131012 --- ParallelTerminationStrategy: PID 1090 died... 00:09:35.150287 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1090): Terminated: ok {rc=0} 00:09:35.196082 --- ParallelTerminationStrategy: PID 1091 died... 00:09:35.215410 run iperf3-srv_10.42.42.10(pid=1091): Terminated {rc=256} 00:09:35.261346 --- ParallelTerminationStrategy: PID 1094 died... 00:09:35.280639 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1094): Terminated: ok {rc=0} 00:09:35.326747 --- ParallelTerminationStrategy: PID 1097 died... 00:09:35.346275 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1097): Terminated: ok {rc=0} 00:09:35.392344 --- ParallelTerminationStrategy: PID 1100 died... 00:09:35.411590 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1100): Terminated: ok {rc=0} 00:09:35.498687 bus /gobi_0: Setting Powered False 00:09:36.598280 bus /gobi_0: Setting Powered False 00:09:37.713185 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 00:09:38.860017 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:09:38.872380 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:09:38.942338 tst iperf3.py: using LAC 24629 00:09:39.067302 tst iperf3.py: using RAC 149 00:09:39.184161 tst iperf3.py: using CellId 24629 00:09:39.301360 tst iperf3.py: using BVCI 24630 00:09:39.410341 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:09:39.421543 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:09:39.432384 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:09:39.443294 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:09:39.454216 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:09:39.465083 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:09:39.476051 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:09:39.486809 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:09:39.497727 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:09:39.612030 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 00:09:39.811907 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:09:40.110139 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1102): Launched 00:09:40.368733 run iperf3-srv_10.42.42.10(pid=1103): Launched 00:09:40.479740 tst iperf3.py:8: start network... 00:09:40.678398 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:09:41.138442 run create_hlr_db(pid=1104): Launched 00:09:41.259149 bus /gobi_6: Setting Powered False 00:09:42.318042 run create_hlr_db(pid=1104): Terminated: ok {rc=0} 00:09:42.751836 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1106): Launched 00:09:43.070819 run osmo-hlr_10.42.42.2(pid=1107): Launched 00:09:43.192712 run osmo-stp_10.42.42.5: Starting osmo-stp 00:09:43.744126 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1109): Launched 00:09:44.060581 run osmo-stp_10.42.42.5(pid=1110): Launched 00:09:44.182305 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:09:44.730352 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1112): Launched 00:09:44.851116 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:09:45.119610 run patchelf(pid=1114): Launched 00:09:45.296738 run osmo-stp_10.42.42.5(pid=1110): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1110)] 00:09:45.431754 run osmo-stp_10.42.42.5(pid=1110): stdout: | (launched: 2022-12-10_00:09:44.002962) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:09:45.568580 run osmo-stp_10.42.42.5(pid=1110): stderr: | 20221210000944194 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000944194 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000944194 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000944194 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000944195 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000944195 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000944195 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:09:45.706393 run osmo-stp_10.42.42.5(pid=1110): stdout: | (launched: 2022-12-10_00:09:44.002962) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:09:45.843299 run osmo-stp_10.42.42.5(pid=1110): stderr: | 20221210000944194 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000944194 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000944194 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000944194 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000944195 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000944195 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000944195 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:09:45.999304 run patchelf(pid=1114): Terminating (SIGINT) 00:09:46.171995 run patchelf(pid=1114): Terminated: ok {rc=0} 00:09:46.297117 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1110): Process ended prematurely: osmo-stp_10.42.42.5(pid=1110) [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1110)] [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8] 00:09:46.307800 tst iperf3.py:8: Test FAILED (7.5 sec) 00:09:46.338263 run osmo-hlr_10.42.42.2(pid=1107): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1107)] 00:09:46.388546 run osmo-hlr_10.42.42.2(pid=1107): stdout: | (launched: 2022-12-10_00:09:43.013175) 00:09:46.440566 run osmo-hlr_10.42.42.2(pid=1107): stderr: | 20221210000943211 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210000943211 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210000943211 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210000943211 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210000943211 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210000943211 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210000943249 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210000943258 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210000943259 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210000943259 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:09:46.493959 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1102): Terminating (SIGTERM) 00:09:46.536265 run iperf3-srv_10.42.42.10(pid=1103): Terminating (SIGTERM) 00:09:46.578887 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1106): Terminating (SIGTERM) 00:09:46.621454 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1109): Terminating (SIGTERM) 00:09:46.666994 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1112): Terminating (SIGTERM) 00:09:46.711841 --- ParallelTerminationStrategy: PID 1102 died... 00:09:46.731820 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1102): Terminated: ok {rc=0} 00:09:46.781207 --- ParallelTerminationStrategy: PID 1103 died... 00:09:46.800543 run iperf3-srv_10.42.42.10(pid=1103): Terminated {rc=256} 00:09:46.848551 --- ParallelTerminationStrategy: PID 1106 died... 00:09:46.868281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1106): Terminated: ok {rc=0} 00:09:46.915278 --- ParallelTerminationStrategy: PID 1109 died... 00:09:46.934873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1109): Terminated: ok {rc=0} 00:09:46.981610 --- ParallelTerminationStrategy: PID 1112 died... 00:09:47.001186 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1112): Terminated: ok {rc=0} 00:09:47.089172 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 00:09:48.240392 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:09:48.252491 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:09:48.319454 tst iperf3m4.py: using LAC 24630 00:09:48.443467 tst iperf3m4.py: using RAC 150 00:09:48.561300 tst iperf3m4.py: using CellId 24630 00:09:48.677656 tst iperf3m4.py: using BVCI 24631 00:09:48.787758 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:09:48.798979 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:09:48.809958 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:09:48.821521 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:09:48.832897 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:09:48.844371 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:09:48.855727 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:09:48.867012 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:09:48.878550 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:09:48.998382 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:09:49.117293 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:09:49.236142 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:09:49.352328 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 00:09:49.554518 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:09:49.854270 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1115): Launched 00:09:50.112150 run iperf3-srv_10.42.42.10(pid=1116): Launched 00:09:50.224253 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 00:09:50.423102 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:09:50.721025 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1117): Launched 00:09:50.978961 run iperf3-srv_10.42.42.10(pid=1118): Launched 00:09:51.089753 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 00:09:51.288793 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:09:51.587377 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1120): Launched 00:09:51.845556 run iperf3-srv_10.42.42.10(pid=1121): Launched 00:09:51.957243 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 00:09:52.157557 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:09:52.457105 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1122): Launched 00:09:52.714938 run iperf3-srv_10.42.42.10(pid=1123): Launched 00:09:52.825940 tst iperf3m4.py:8: start network... 00:09:53.024264 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:09:53.483239 run create_hlr_db(pid=1128): Launched 00:09:53.604239 bus /gobi_6: Setting Powered False 00:09:54.664574 run create_hlr_db(pid=1128): Terminated: ok {rc=0} 00:09:55.099120 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1130): Launched 00:09:55.417535 run osmo-hlr_10.42.42.2(pid=1131): Launched 00:09:55.540156 run osmo-stp_10.42.42.5: Starting osmo-stp 00:09:56.095416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1133): Launched 00:09:56.414522 run osmo-stp_10.42.42.5(pid=1139): Launched 00:09:56.536391 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:09:57.087667 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1141): Launched 00:09:57.210167 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:09:57.479614 run patchelf(pid=1142): Launched 00:09:57.658752 run osmo-stp_10.42.42.5(pid=1139): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1139)] 00:09:57.794010 run osmo-stp_10.42.42.5(pid=1139): stdout: | (launched: 2022-12-10_00:09:56.356619) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:09:57.931463 run osmo-stp_10.42.42.5(pid=1139): stderr: | 20221210000956547 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000956548 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000956548 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000956548 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000956549 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000956549 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000956549 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:09:58.069305 run osmo-stp_10.42.42.5(pid=1139): stdout: | (launched: 2022-12-10_00:09:56.356619) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:09:58.200571 run osmo-stp_10.42.42.5(pid=1139): stderr: | 20221210000956547 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210000956548 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210000956548 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210000956548 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210000956549 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210000956549 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210000956549 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:09:58.355840 run patchelf(pid=1142): Terminating (SIGINT) 00:09:58.535299 run patchelf(pid=1142): Terminated: ok {rc=0} 00:09:58.665245 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1139): Process ended prematurely: osmo-stp_10.42.42.5(pid=1139) [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1139)] [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8] 00:09:58.675517 tst iperf3m4.py:8: Test FAILED (10.5 sec) 00:09:58.704660 run osmo-hlr_10.42.42.2(pid=1131): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1131)] 00:09:58.754353 run osmo-hlr_10.42.42.2(pid=1131): stdout: | (launched: 2022-12-10_00:09:55.359888) 00:09:58.806048 run osmo-hlr_10.42.42.2(pid=1131): stderr: | 20221210000955558 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210000955558 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210000955558 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210000955558 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210000955558 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210000955558 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210000955571 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210000955579 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210000955579 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210000955579 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:09:58.858314 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1115): Terminating (SIGTERM) 00:09:58.899931 run iperf3-srv_10.42.42.10(pid=1116): Terminating (SIGTERM) 00:09:58.941640 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1117): Terminating (SIGTERM) 00:09:58.983221 run iperf3-srv_10.42.42.10(pid=1118): Terminating (SIGTERM) 00:09:59.024636 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1120): Terminating (SIGTERM) 00:09:59.066344 run iperf3-srv_10.42.42.10(pid=1121): Terminating (SIGTERM) 00:09:59.107865 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1122): Terminating (SIGTERM) 00:09:59.149444 run iperf3-srv_10.42.42.10(pid=1123): Terminating (SIGTERM) 00:09:59.191083 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1130): Terminating (SIGTERM) 00:09:59.232555 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1133): Terminating (SIGTERM) 00:09:59.274299 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1141): Terminating (SIGTERM) 00:09:59.316075 --- ParallelTerminationStrategy: PID 1115 died... 00:09:59.335991 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1115): Terminated: ok {rc=0} 00:09:59.382945 --- ParallelTerminationStrategy: PID 1116 died... 00:09:59.402432 run iperf3-srv_10.42.42.10(pid=1116): Terminated {rc=256} 00:09:59.448293 --- ParallelTerminationStrategy: PID 1117 died... 00:09:59.467958 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1117): Terminated: ok {rc=0} 00:09:59.513872 --- ParallelTerminationStrategy: PID 1118 died... 00:09:59.533179 run iperf3-srv_10.42.42.10(pid=1118): Terminated {rc=256} 00:09:59.579524 --- ParallelTerminationStrategy: PID 1120 died... 00:09:59.599243 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1120): Terminated: ok {rc=0} 00:09:59.645583 --- ParallelTerminationStrategy: PID 1121 died... 00:09:59.665072 run iperf3-srv_10.42.42.10(pid=1121): Terminated {rc=256} 00:09:59.711063 --- ParallelTerminationStrategy: PID 1122 died... 00:09:59.730500 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1122): Terminated: ok {rc=0} 00:09:59.776746 --- ParallelTerminationStrategy: PID 1123 died... 00:09:59.796320 run iperf3-srv_10.42.42.10(pid=1123): Terminated {rc=256} 00:09:59.842869 --- ParallelTerminationStrategy: PID 1130 died... 00:09:59.862551 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1130): Terminated: ok {rc=0} 00:09:59.908927 --- ParallelTerminationStrategy: PID 1133 died... 00:09:59.928541 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1133): Terminated: ok {rc=0} 00:09:59.974998 --- ParallelTerminationStrategy: PID 1141 died... 00:09:59.994635 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1141): Terminated: ok {rc=0} 00:10:00.082909 bus /gobi_4: Setting Powered False 00:10:01.187393 bus /gobi_4: Setting Powered False 00:10:02.314929 bus /gobi_1: Setting Powered False 00:10:03.412603 bus /gobi_1: Setting Powered False 00:10:04.530468 bus /gobi_0: Setting Powered False 00:10:05.627467 bus /gobi_0: Setting Powered False 00:10:06.742278 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 00:10:07.846849 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:07.860007 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:10:07.930957 tst ping.py: using LAC 24631 00:10:08.054878 tst ping.py: using RAC 151 00:10:08.177196 tst ping.py: using CellId 24631 00:10:08.301871 tst ping.py: using BVCI 24632 00:10:08.417071 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:08.428603 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:08.440238 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:08.451978 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:08.463510 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:08.475115 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:08.486848 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:08.498490 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:10:08.614727 tst ping.py:19: start network... 00:10:08.811878 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:10:09.265377 run create_hlr_db(pid=1147): Launched 00:10:09.386205 bus /gobi_6: Setting Powered False 00:10:10.445391 run create_hlr_db(pid=1147): Terminated: ok {rc=0} 00:10:10.872317 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1149): Launched 00:10:11.184661 run osmo-hlr_10.42.42.2(pid=1150): Launched 00:10:11.304243 run osmo-stp_10.42.42.5: Starting osmo-stp 00:10:11.849361 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1152): Launched 00:10:12.161063 run osmo-stp_10.42.42.5(pid=1153): Launched 00:10:12.280021 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:10:12.818152 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1155): Launched 00:10:12.936792 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:10:13.200867 run patchelf(pid=1156): Launched 00:10:13.374341 run osmo-stp_10.42.42.5(pid=1153): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1153)] 00:10:13.506669 run osmo-stp_10.42.42.5(pid=1153): stdout: | (launched: 2022-12-10_00:10:12.104096) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:10:13.641311 run osmo-stp_10.42.42.5(pid=1153): stderr: | 20221210001012295 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001012295 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001012295 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001012296 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001012298 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001012298 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001012298 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:10:13.775666 run osmo-stp_10.42.42.5(pid=1153): stdout: | (launched: 2022-12-10_00:10:12.104096) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:10:13.903969 run osmo-stp_10.42.42.5(pid=1153): stderr: | 20221210001012295 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001012295 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001012295 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001012296 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001012298 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001012298 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001012298 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:10:14.055921 run patchelf(pid=1156): Terminating (SIGINT) 00:10:14.231037 run patchelf(pid=1156): Terminated: ok {rc=0} 00:10:14.357428 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=1153): Process ended prematurely: osmo-stp_10.42.42.5(pid=1153) [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1153)] [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22] 00:10:14.367038 tst ping.py:22: Test FAILED (6.5 sec) 00:10:14.395524 run osmo-hlr_10.42.42.2(pid=1150): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1150)] 00:10:14.445412 run osmo-hlr_10.42.42.2(pid=1150): stdout: | (launched: 2022-12-10_00:10:11.127781) 00:10:14.497199 run osmo-hlr_10.42.42.2(pid=1150): stderr: | 20221210001011325 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210001011325 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210001011325 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210001011325 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210001011325 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210001011325 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210001011339 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210001011347 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210001011347 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210001011347 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:10:14.549211 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1149): Terminating (SIGTERM) 00:10:14.591134 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1152): Terminating (SIGTERM) 00:10:14.632708 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1155): Terminating (SIGTERM) 00:10:14.674581 --- ParallelTerminationStrategy: PID 1149 died... 00:10:14.694500 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1149): Terminated: ok {rc=0} 00:10:14.740883 --- ParallelTerminationStrategy: PID 1152 died... 00:10:14.760620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1152): Terminated: ok {rc=0} 00:10:14.806936 --- ParallelTerminationStrategy: PID 1155 died... 00:10:14.826337 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1155): Terminated: ok {rc=0} 00:10:14.912854 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 00:10:16.001063 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:16.014099 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:10:16.087396 tst ping_idle_ping.py: using LAC 24632 00:10:16.213450 tst ping_idle_ping.py: using RAC 152 00:10:16.373602 tst ping_idle_ping.py: using CellId 24632 00:10:16.499397 tst ping_idle_ping.py: using BVCI 24633 00:10:16.616771 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:16.629226 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:16.641664 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:16.653724 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:16.666099 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:16.678489 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:16.690984 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:10:16.703460 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:10:16.847610 tst ping_idle_ping.py:24: start network... 00:10:17.078682 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:10:17.539803 run create_hlr_db(pid=1157): Launched 00:10:17.660912 bus /gobi_6: Setting Powered False 00:10:18.720080 run create_hlr_db(pid=1157): Terminated: ok {rc=0} 00:10:19.129911 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1159): Launched 00:10:19.422696 run osmo-hlr_10.42.42.2(pid=1160): Launched 00:10:19.533690 run osmo-stp_10.42.42.5: Starting osmo-stp 00:10:20.053061 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1162): Launched 00:10:20.346290 run osmo-stp_10.42.42.5(pid=1163): Launched 00:10:20.457147 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:10:20.961317 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1165): Launched 00:10:21.073135 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:10:21.320541 run patchelf(pid=1166): Launched 00:10:21.483029 run osmo-stp_10.42.42.5(pid=1163): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1163)] 00:10:21.606938 run osmo-stp_10.42.42.5(pid=1163): stdout: | (launched: 2022-12-10_00:10:20.291682) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:10:21.733123 run osmo-stp_10.42.42.5(pid=1163): stderr: | 20221210001020463 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001020463 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001020463 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001020463 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001020464 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001020464 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001020464 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:10:21.858886 run osmo-stp_10.42.42.5(pid=1163): stdout: | (launched: 2022-12-10_00:10:20.291682) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:10:21.979663 run osmo-stp_10.42.42.5(pid=1163): stderr: | 20221210001020463 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001020463 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001020463 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001020463 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001020464 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001020464 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001020464 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:10:22.122078 run patchelf(pid=1166): Terminating (SIGINT) 00:10:22.286391 run patchelf(pid=1166): Terminated: ok {rc=0} 00:10:22.404692 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=1163): Process ended prematurely: osmo-stp_10.42.42.5(pid=1163) [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1163)] [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 00:10:22.413624 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 00:10:22.439780 run osmo-hlr_10.42.42.2(pid=1160): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1160)] 00:10:22.486627 run osmo-hlr_10.42.42.2(pid=1160): stdout: | (launched: 2022-12-10_00:10:19.368863) 00:10:22.535204 run osmo-hlr_10.42.42.2(pid=1160): stderr: | 20221210001019543 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210001019543 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210001019543 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210001019543 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210001019543 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210001019543 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210001019556 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210001019565 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210001019565 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210001019565 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:10:22.584175 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1159): Terminating (SIGTERM) 00:10:22.623339 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1162): Terminating (SIGTERM) 00:10:22.662281 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1165): Terminating (SIGTERM) 00:10:22.701524 --- ParallelTerminationStrategy: PID 1159 died... 00:10:22.720234 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1159): Terminated: ok {rc=0} 00:10:22.763673 --- ParallelTerminationStrategy: PID 1162 died... 00:10:22.782037 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1162): Terminated: ok {rc=0} 00:10:22.825305 --- ParallelTerminationStrategy: PID 1165 died... 00:10:22.843699 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1165): Terminated: ok {rc=0} 00:10:22.927862 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2366 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 00:10:24.231075 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:10:24.237239 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 00:10:24.266153 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 00:10:24.303981 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 00:10:24.388376 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 00:10:24.417038 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 00:10:24.454879 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 00:10:25.056104 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2366 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 00:10:25.104097 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:10:25.115122 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:10:25.178602 tst cs_paging_gprs_active.py: using LAC 24633 00:10:25.293384 tst cs_paging_gprs_active.py: using RAC 153 00:10:25.409085 tst cs_paging_gprs_active.py: using CellId 24633 00:10:25.524751 tst cs_paging_gprs_active.py: using BVCI 24634 00:10:25.632537 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:10:25.643688 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:10:25.654531 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:10:25.665368 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:10:25.676111 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:10:25.686933 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:10:25.697826 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:10:25.708545 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:10:25.719427 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:10:25.838277 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:10:25.955926 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 00:10:26.158389 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:10:26.458253 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1172): Launched 00:10:26.717451 run iperf3-srv_10.42.42.10(pid=1174): Launched 00:10:26.828842 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 00:10:27.029361 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:10:27.329277 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1176): Launched 00:10:27.588531 run iperf3-srv_10.42.42.10(pid=1177): Launched 00:10:27.699519 tst cs_paging_gprs_active.py:38: start network... 00:10:27.899848 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:10:28.360699 run create_hlr_db(pid=1178): Launched 00:10:28.483810 bus /gobi_6: Setting Powered False 00:10:29.543041 run create_hlr_db(pid=1178): Terminated: ok {rc=0} 00:10:29.979311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1180): Launched 00:10:30.299796 run osmo-hlr_10.42.42.2(pid=1181): Launched 00:10:30.422516 run osmo-stp_10.42.42.5: Starting osmo-stp 00:10:30.997112 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1183): Launched 00:10:31.330625 run osmo-stp_10.42.42.5(pid=1184): Launched 00:10:31.551231 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:10:32.183915 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1186): Launched 00:10:32.310964 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:10:32.596031 run patchelf(pid=1187): Launched 00:10:32.774431 run osmo-stp_10.42.42.5(pid=1184): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1184)] 00:10:32.910048 run osmo-stp_10.42.42.5(pid=1184): stdout: | (launched: 2022-12-10_00:10:31.266650) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:10:33.047900 run osmo-stp_10.42.42.5(pid=1184): stderr: | 20221210001031521 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001031521 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001031529 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001031529 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001031530 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001031530 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001031530 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:10:33.186130 run osmo-stp_10.42.42.5(pid=1184): stdout: | (launched: 2022-12-10_00:10:31.266650) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:10:33.317513 run osmo-stp_10.42.42.5(pid=1184): stderr: | 20221210001031521 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001031521 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001031529 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001031529 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001031530 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001031530 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001031530 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:10:33.473630 run patchelf(pid=1187): Terminating (SIGINT) 00:10:33.654459 run patchelf(pid=1187): Terminated: ok {rc=0} 00:10:33.784668 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=1184): Process ended prematurely: osmo-stp_10.42.42.5(pid=1184) [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1184)] [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 00:10:33.795178 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 00:10:33.824348 run osmo-hlr_10.42.42.2(pid=1181): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1181)] 00:10:33.874265 run osmo-hlr_10.42.42.2(pid=1181): stdout: | (launched: 2022-12-10_00:10:30.241976) 00:10:33.925909 run osmo-hlr_10.42.42.2(pid=1181): stderr: | 20221210001030438 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210001030438 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210001030438 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210001030439 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210001030439 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210001030439 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210001030452 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210001030461 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210001030461 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210001030461 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:10:33.977726 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1172): Terminating (SIGTERM) 00:10:34.019516 run iperf3-srv_10.42.42.10(pid=1174): Terminating (SIGTERM) 00:10:34.061083 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1176): Terminating (SIGTERM) 00:10:34.103166 run iperf3-srv_10.42.42.10(pid=1177): Terminating (SIGTERM) 00:10:34.144743 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1180): Terminating (SIGTERM) 00:10:34.186537 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1183): Terminating (SIGTERM) 00:10:34.228276 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1186): Terminating (SIGTERM) 00:10:34.270369 --- ParallelTerminationStrategy: PID 1172 died... 00:10:34.290269 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1172): Terminated: ok {rc=0} 00:10:34.336789 --- ParallelTerminationStrategy: PID 1174 died... 00:10:34.356601 run iperf3-srv_10.42.42.10(pid=1174): Terminated {rc=256} 00:10:34.402768 --- ParallelTerminationStrategy: PID 1176 died... 00:10:34.422216 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1176): Terminated: ok {rc=0} 00:10:34.468295 --- ParallelTerminationStrategy: PID 1177 died... 00:10:34.487715 run iperf3-srv_10.42.42.10(pid=1177): Terminated {rc=256} 00:10:34.534307 --- ParallelTerminationStrategy: PID 1180 died... 00:10:34.553768 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1180): Terminated: ok {rc=0} 00:10:34.600028 --- ParallelTerminationStrategy: PID 1183 died... 00:10:34.619351 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1183): Terminated: ok {rc=0} 00:10:34.665566 --- ParallelTerminationStrategy: PID 1186 died... 00:10:34.684834 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1186): Terminated: ok {rc=0} 00:10:34.772749 bus /gobi_0: Setting Powered False 00:10:35.871302 bus /gobi_0: Setting Powered False 00:10:36.986305 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 00:10:38.135976 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:10:38.148272 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:10:38.217423 tst iperf3.py: using LAC 24634 00:10:38.343710 tst iperf3.py: using RAC 154 00:10:38.468644 tst iperf3.py: using CellId 24634 00:10:38.594272 tst iperf3.py: using BVCI 24635 00:10:38.711938 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:10:38.723568 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:10:38.734843 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:10:38.746397 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:10:38.758069 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:10:38.769554 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:10:38.781238 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:10:38.792904 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:10:38.804754 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:10:38.922525 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 00:10:39.139234 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:10:39.459329 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1188): Launched 00:10:39.736367 run iperf3-srv_10.42.42.10(pid=1189): Launched 00:10:39.855643 tst iperf3.py:8: start network... 00:10:40.071714 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:10:40.565071 run create_hlr_db(pid=1190): Launched 00:10:40.686451 bus /gobi_6: Setting Powered False 00:10:41.749342 run create_hlr_db(pid=1190): Terminated: ok {rc=0} 00:10:42.175617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1192): Launched 00:10:42.473319 run osmo-hlr_10.42.42.2(pid=1193): Launched 00:10:42.587976 run osmo-stp_10.42.42.5: Starting osmo-stp 00:10:43.102066 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1195): Launched 00:10:43.399164 run osmo-stp_10.42.42.5(pid=1196): Launched 00:10:43.512432 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:10:44.027692 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1198): Launched 00:10:44.141237 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:10:44.392568 run patchelf(pid=1199): Launched 00:10:44.558321 run osmo-stp_10.42.42.5(pid=1196): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1196)] 00:10:44.684115 run osmo-stp_10.42.42.5(pid=1196): stdout: | (launched: 2022-12-10_00:10:43.344668) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:10:44.811851 run osmo-stp_10.42.42.5(pid=1196): stderr: | 20221210001043515 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001043515 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001043516 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001043516 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001043517 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001043517 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001043517 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:10:44.939632 run osmo-stp_10.42.42.5(pid=1196): stdout: | (launched: 2022-12-10_00:10:43.344668) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:10:45.060896 run osmo-stp_10.42.42.5(pid=1196): stderr: | 20221210001043515 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001043515 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001043516 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001043516 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001043517 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001043517 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001043517 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:10:45.205612 run patchelf(pid=1199): Terminating (SIGINT) 00:10:45.373162 run patchelf(pid=1199): Terminated: ok {rc=0} 00:10:45.493759 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1196): Process ended prematurely: osmo-stp_10.42.42.5(pid=1196) [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1196)] [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8] 00:10:45.503162 tst iperf3.py:8: Test FAILED (7.4 sec) 00:10:45.530036 run osmo-hlr_10.42.42.2(pid=1193): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1193)] 00:10:45.577441 run osmo-hlr_10.42.42.2(pid=1193): stdout: | (launched: 2022-12-10_00:10:42.418933) 00:10:45.626505 run osmo-hlr_10.42.42.2(pid=1193): stderr: | 20221210001042595 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210001042595 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210001042595 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210001042596 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210001042596 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210001042596 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210001042608 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210001042617 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210001042617 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210001042618 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:10:45.675981 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1188): Terminating (SIGTERM) 00:10:45.715571 run iperf3-srv_10.42.42.10(pid=1189): Terminating (SIGTERM) 00:10:45.754922 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1192): Terminating (SIGTERM) 00:10:45.794236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1195): Terminating (SIGTERM) 00:10:45.836916 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1198): Terminating (SIGTERM) 00:10:45.890938 --- ParallelTerminationStrategy: PID 1188 died... 00:10:45.913059 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1188): Terminated: ok {rc=0} 00:10:45.964348 --- ParallelTerminationStrategy: PID 1189 died... 00:10:45.985144 run iperf3-srv_10.42.42.10(pid=1189): Terminated {rc=256} 00:10:46.034713 --- ParallelTerminationStrategy: PID 1192 died... 00:10:46.056221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1192): Terminated: ok {rc=0} 00:10:46.106045 --- ParallelTerminationStrategy: PID 1195 died... 00:10:46.126708 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1195): Terminated: ok {rc=0} 00:10:46.176822 --- ParallelTerminationStrategy: PID 1198 died... 00:10:46.197368 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1198): Terminated: ok {rc=0} 00:10:46.289565 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 00:10:47.442345 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:10:47.454648 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:10:47.525285 tst iperf3m4.py: using LAC 24635 00:10:47.652393 tst iperf3m4.py: using RAC 155 00:10:47.782049 tst iperf3m4.py: using CellId 24635 00:10:47.908041 tst iperf3m4.py: using BVCI 24636 00:10:48.025046 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:10:48.036555 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:10:48.048081 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:10:48.060283 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:10:48.072386 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:10:48.084420 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:10:48.096591 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:10:48.108512 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:10:48.120729 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:10:48.240012 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:10:48.361580 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:10:48.481720 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:10:48.598561 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 00:10:48.800013 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:10:49.099004 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1200): Launched 00:10:49.357615 run iperf3-srv_10.42.42.10(pid=1201): Launched 00:10:49.469580 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 00:10:49.669522 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:10:49.969827 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1202): Launched 00:10:50.230282 run iperf3-srv_10.42.42.10(pid=1203): Launched 00:10:50.341297 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 00:10:50.540664 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:10:50.839715 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1204): Launched 00:10:51.100912 run iperf3-srv_10.42.42.10(pid=1205): Launched 00:10:51.212234 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 00:10:51.411850 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:10:51.711162 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1206): Launched 00:10:51.971543 run iperf3-srv_10.42.42.10(pid=1207): Launched 00:10:52.083038 tst iperf3m4.py:8: start network... 00:10:52.282403 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:10:52.743961 run create_hlr_db(pid=1208): Launched 00:10:52.866401 bus /gobi_6: Setting Powered False 00:10:53.925697 run create_hlr_db(pid=1208): Terminated: ok {rc=0} 00:10:54.362992 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1210): Launched 00:10:54.684294 run osmo-hlr_10.42.42.2(pid=1211): Launched 00:10:54.807355 run osmo-stp_10.42.42.5: Starting osmo-stp 00:10:55.360237 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1213): Launched 00:10:55.680649 run osmo-stp_10.42.42.5(pid=1214): Launched 00:10:55.802219 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:10:56.352435 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1216): Launched 00:10:56.474833 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:10:56.745632 run patchelf(pid=1217): Launched 00:10:56.923352 run osmo-stp_10.42.42.5(pid=1214): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1214)] 00:10:57.058943 run osmo-stp_10.42.42.5(pid=1214): stdout: | (launched: 2022-12-10_00:10:55.622152) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:10:57.196453 run osmo-stp_10.42.42.5(pid=1214): stderr: | 20221210001055812 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001055813 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001055813 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001055813 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001055814 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001055814 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001055814 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:10:57.334181 run osmo-stp_10.42.42.5(pid=1214): stdout: | (launched: 2022-12-10_00:10:55.622152) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:10:57.465528 run osmo-stp_10.42.42.5(pid=1214): stderr: | 20221210001055812 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001055813 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001055813 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001055813 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001055814 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001055814 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001055814 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:10:57.621842 run patchelf(pid=1217): Terminating (SIGINT) 00:10:57.802109 run patchelf(pid=1217): Terminated: ok {rc=0} 00:10:57.931577 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1214): Process ended prematurely: osmo-stp_10.42.42.5(pid=1214) [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1214)] [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8] 00:10:57.942088 tst iperf3m4.py:8: Test FAILED (10.5 sec) 00:10:57.971373 run osmo-hlr_10.42.42.2(pid=1211): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1211)] 00:10:58.021671 run osmo-hlr_10.42.42.2(pid=1211): stdout: | (launched: 2022-12-10_00:10:54.625898) 00:10:58.073669 run osmo-hlr_10.42.42.2(pid=1211): stderr: | 20221210001054823 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210001054823 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210001054823 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210001054823 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210001054823 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210001054823 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210001054835 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210001054843 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210001054843 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210001054843 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:10:58.125866 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1200): Terminating (SIGTERM) 00:10:58.167825 run iperf3-srv_10.42.42.10(pid=1201): Terminating (SIGTERM) 00:10:58.209749 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1202): Terminating (SIGTERM) 00:10:58.251444 run iperf3-srv_10.42.42.10(pid=1203): Terminating (SIGTERM) 00:10:58.293035 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1204): Terminating (SIGTERM) 00:10:58.334726 run iperf3-srv_10.42.42.10(pid=1205): Terminating (SIGTERM) 00:10:58.376415 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1206): Terminating (SIGTERM) 00:10:58.418267 run iperf3-srv_10.42.42.10(pid=1207): Terminating (SIGTERM) 00:10:58.460037 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1210): Terminating (SIGTERM) 00:10:58.502004 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1213): Terminating (SIGTERM) 00:10:58.543740 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1216): Terminating (SIGTERM) 00:10:58.585579 --- ParallelTerminationStrategy: PID 1200 died... 00:10:58.605486 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1200): Terminated: ok {rc=0} 00:10:58.652836 --- ParallelTerminationStrategy: PID 1201 died... 00:10:58.672844 run iperf3-srv_10.42.42.10(pid=1201): Terminated {rc=256} 00:10:58.719074 --- ParallelTerminationStrategy: PID 1202 died... 00:10:58.738462 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1202): Terminated: ok {rc=0} 00:10:58.784706 --- ParallelTerminationStrategy: PID 1203 died... 00:10:58.804127 run iperf3-srv_10.42.42.10(pid=1203): Terminated {rc=256} 00:10:58.850245 --- ParallelTerminationStrategy: PID 1204 died... 00:10:58.869705 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1204): Terminated: ok {rc=0} 00:10:58.915941 --- ParallelTerminationStrategy: PID 1205 died... 00:10:58.935250 run iperf3-srv_10.42.42.10(pid=1205): Terminated {rc=256} 00:10:58.981495 --- ParallelTerminationStrategy: PID 1206 died... 00:10:59.000812 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1206): Terminated: ok {rc=0} 00:10:59.047207 --- ParallelTerminationStrategy: PID 1207 died... 00:10:59.066522 run iperf3-srv_10.42.42.10(pid=1207): Terminated {rc=256} 00:10:59.112717 --- ParallelTerminationStrategy: PID 1210 died... 00:10:59.132193 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1210): Terminated: ok {rc=0} 00:10:59.178920 --- ParallelTerminationStrategy: PID 1213 died... 00:10:59.198408 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1213): Terminated: ok {rc=0} 00:10:59.244686 --- ParallelTerminationStrategy: PID 1216 died... 00:10:59.264133 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1216): Terminated: ok {rc=0} 00:10:59.351556 bus /gobi_4: Setting Powered False 00:11:00.449203 bus /gobi_4: Setting Powered False 00:11:01.566092 bus /gobi_1: Setting Powered False 00:11:02.663177 bus /gobi_1: Setting Powered False 00:11:03.777573 bus /gobi_0: Setting Powered False 00:11:04.874919 bus /gobi_0: Setting Powered False 00:11:05.990925 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 00:11:07.093750 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:07.105486 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:11:07.171297 tst ping.py: using LAC 24636 00:11:07.287155 tst ping.py: using RAC 156 00:11:07.404223 tst ping.py: using CellId 24636 00:11:07.520024 tst ping.py: using BVCI 24637 00:11:07.627651 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:07.638883 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:07.649801 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:07.660652 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:07.671562 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:07.682679 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:07.693718 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:07.704469 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:11:07.818386 tst ping.py:19: start network... 00:11:08.014588 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:11:08.467760 run create_hlr_db(pid=1218): Launched 00:11:08.587416 bus /gobi_6: Setting Powered False 00:11:09.646576 run create_hlr_db(pid=1218): Terminated: ok {rc=0} 00:11:10.056407 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1220): Launched 00:11:10.370112 run osmo-hlr_10.42.42.2(pid=1221): Launched 00:11:10.489550 run osmo-stp_10.42.42.5: Starting osmo-stp 00:11:11.032295 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1223): Launched 00:11:11.344349 run osmo-stp_10.42.42.5(pid=1224): Launched 00:11:11.463770 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:11:12.004596 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1226): Launched 00:11:12.124553 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:11:12.389653 run patchelf(pid=1227): Launched 00:11:12.563232 run osmo-stp_10.42.42.5(pid=1224): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1224)] 00:11:12.695917 run osmo-stp_10.42.42.5(pid=1224): stdout: | (launched: 2022-12-10_00:11:11.287230) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:11:12.830241 run osmo-stp_10.42.42.5(pid=1224): stderr: | 20221210001111478 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001111478 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001111478 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001111479 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001111481 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001111481 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001111481 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:11:12.964385 run osmo-stp_10.42.42.5(pid=1224): stdout: | (launched: 2022-12-10_00:11:11.287230) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:11:13.092743 run osmo-stp_10.42.42.5(pid=1224): stderr: | 20221210001111478 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001111478 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001111478 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001111479 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001111481 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001111481 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001111481 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:11:13.244876 run patchelf(pid=1227): Terminating (SIGINT) 00:11:13.419949 run patchelf(pid=1227): Terminated: ok {rc=0} 00:11:13.546338 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=1224): Process ended prematurely: osmo-stp_10.42.42.5(pid=1224) [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1224)] [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22] 00:11:13.555847 tst ping.py:22: Test FAILED (6.5 sec) 00:11:13.583704 run osmo-hlr_10.42.42.2(pid=1221): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1221)] 00:11:13.634325 run osmo-hlr_10.42.42.2(pid=1221): stdout: | (launched: 2022-12-10_00:11:10.313116) 00:11:13.685989 run osmo-hlr_10.42.42.2(pid=1221): stderr: | 20221210001110509 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210001110509 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210001110509 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210001110509 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210001110509 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210001110509 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210001110539 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210001110548 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210001110548 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210001110548 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:11:13.737722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1220): Terminating (SIGTERM) 00:11:13.779138 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1223): Terminating (SIGTERM) 00:11:13.820570 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1226): Terminating (SIGTERM) 00:11:13.862533 --- ParallelTerminationStrategy: PID 1220 died... 00:11:13.882560 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1220): Terminated: ok {rc=0} 00:11:13.929046 --- ParallelTerminationStrategy: PID 1223 died... 00:11:13.948351 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1223): Terminated: ok {rc=0} 00:11:13.994486 --- ParallelTerminationStrategy: PID 1226 died... 00:11:14.013837 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1226): Terminated: ok {rc=0} 00:11:14.102468 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 00:11:15.190171 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:15.202916 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 00:11:15.273485 tst ping_idle_ping.py: using LAC 24637 00:11:15.398819 tst ping_idle_ping.py: using RAC 157 00:11:15.522600 tst ping_idle_ping.py: using CellId 24637 00:11:15.648752 tst ping_idle_ping.py: using BVCI 24638 00:11:15.765531 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:15.777194 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:15.788723 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:15.800465 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:15.812213 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:15.824321 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:15.845298 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 00:11:15.857818 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 00:11:15.993187 tst ping_idle_ping.py:24: start network... 00:11:16.209429 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:11:16.712249 run create_hlr_db(pid=1228): Launched 00:11:16.892429 bus /gobi_6: Setting Powered False 00:11:17.955337 run create_hlr_db(pid=1228): Terminated: ok {rc=0} 00:11:18.409318 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1230): Launched 00:11:18.702440 run osmo-hlr_10.42.42.2(pid=1232): Launched 00:11:18.813796 run osmo-stp_10.42.42.5: Starting osmo-stp 00:11:19.321456 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1234): Launched 00:11:19.615527 run osmo-stp_10.42.42.5(pid=1235): Launched 00:11:19.727113 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:11:20.232790 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1237): Launched 00:11:20.344808 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:11:20.592404 run patchelf(pid=1238): Launched 00:11:20.755363 run osmo-stp_10.42.42.5(pid=1235): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1235)] 00:11:20.879373 run osmo-stp_10.42.42.5(pid=1235): stdout: | (launched: 2022-12-10_00:11:19.561342) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:11:21.004861 run osmo-stp_10.42.42.5(pid=1235): stderr: | 20221210001119732 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001119733 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001119733 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001119733 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001119734 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001119734 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001119734 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:11:21.130612 run osmo-stp_10.42.42.5(pid=1235): stdout: | (launched: 2022-12-10_00:11:19.561342) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:11:21.251149 run osmo-stp_10.42.42.5(pid=1235): stderr: | 20221210001119732 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001119733 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001119733 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001119733 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001119734 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001119734 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001119734 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:11:21.393878 run patchelf(pid=1238): Terminating (SIGINT) 00:11:21.558492 run patchelf(pid=1238): Terminated: ok {rc=0} 00:11:21.677198 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=1235): Process ended prematurely: osmo-stp_10.42.42.5(pid=1235) [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1235)] [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 00:11:21.686335 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 00:11:21.712731 run osmo-hlr_10.42.42.2(pid=1232): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1232)] 00:11:21.760160 run osmo-hlr_10.42.42.2(pid=1232): stdout: | (launched: 2022-12-10_00:11:18.648603) 00:11:21.810255 run osmo-hlr_10.42.42.2(pid=1232): stderr: | 20221210001118825 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210001118825 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210001118825 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210001118825 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210001118825 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210001118825 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210001118837 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210001118846 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210001118846 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210001118846 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:11:21.859750 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1230): Terminating (SIGTERM) 00:11:21.899120 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1234): Terminating (SIGTERM) 00:11:21.938430 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1237): Terminating (SIGTERM) 00:11:21.977944 --- ParallelTerminationStrategy: PID 1230 died... 00:11:21.996893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1230): Terminated: ok {rc=0} 00:11:22.040813 --- ParallelTerminationStrategy: PID 1234 died... 00:11:22.059553 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1234): Terminated: ok {rc=0} 00:11:22.103176 --- ParallelTerminationStrategy: PID 1237 died... 00:11:22.121744 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1237): Terminated: ok {rc=0} 00:11:22.205168 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2366 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 00:11:23.505846 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:11:23.513133 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 00:11:23.544263 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 00:11:23.579971 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 00:11:23.635145 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 00:11:23.664258 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 00:11:23.698611 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 00:11:24.260170 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2366 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 00:11:24.265511 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:11:24.276809 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 00:11:24.341774 tst switch_tch_pdch.py: using LAC 24638 00:11:24.466979 tst switch_tch_pdch.py: using RAC 158 00:11:24.590358 tst switch_tch_pdch.py: using CellId 24638 00:11:24.716081 tst switch_tch_pdch.py: using BVCI 24639 00:11:24.832011 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:11:24.843996 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:11:24.856288 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:11:24.868455 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:11:24.880587 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:11:24.892337 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:11:24.904786 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:11:24.917656 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:11:25.034633 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:11:25.154160 tst switch_tch_pdch.py:51: start network... 00:11:25.365089 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:11:25.850703 run create_hlr_db(pid=1242): Launched 00:11:25.969622 bus /gobi_6: Setting Powered False 00:11:27.032417 run create_hlr_db(pid=1242): Terminated: ok {rc=0} 00:11:27.452370 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1244): Launched 00:11:27.745834 run osmo-hlr_10.42.42.2(pid=1245): Launched 00:11:27.857457 run osmo-stp_10.42.42.5: Starting osmo-stp 00:11:28.378963 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1247): Launched 00:11:28.670630 run osmo-stp_10.42.42.5(pid=1248): Launched 00:11:28.781687 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:11:29.285966 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1250): Launched 00:11:29.397505 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:11:29.644215 run patchelf(pid=1251): Launched 00:11:29.806789 run osmo-stp_10.42.42.5(pid=1248): ERR: Terminated: ERROR {rc=1} [trial-2366↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1248)] 00:11:29.930397 run osmo-stp_10.42.42.5(pid=1248): stdout: | (launched: 2022-12-10_00:11:28.616746) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:11:30.055806 run osmo-stp_10.42.42.5(pid=1248): stderr: | 20221210001128786 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001128786 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001128786 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001128787 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001128787 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001128787 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001128787 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:11:30.181465 run osmo-stp_10.42.42.5(pid=1248): stdout: | (launched: 2022-12-10_00:11:28.616746) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:11:30.302022 run osmo-stp_10.42.42.5(pid=1248): stderr: | 20221210001128786 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001128786 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001128786 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001128787 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001128787 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001128787 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001128787 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:11:30.444129 run patchelf(pid=1251): Terminating (SIGINT) 00:11:30.608525 run patchelf(pid=1251): Terminated: ok {rc=0} 00:11:30.726711 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=1248): Process ended prematurely: osmo-stp_10.42.42.5(pid=1248) [trial-2366↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1248)] [trial-2366↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 00:11:30.735576 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 00:11:30.762286 run osmo-hlr_10.42.42.2(pid=1245): ERR: Terminated: ERROR {rc=237} [trial-2366↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1245)] 00:11:30.809517 run osmo-hlr_10.42.42.2(pid=1245): stdout: | (launched: 2022-12-10_00:11:27.691672) 00:11:30.889695 run osmo-hlr_10.42.42.2(pid=1245): stderr: | 20221210001127869 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210001127869 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210001127869 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210001127869 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210001127869 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210001127869 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210001127881 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210001127889 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210001127889 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210001127889 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:11:30.953414 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1244): Terminating (SIGTERM) 00:11:30.998557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1247): Terminating (SIGTERM) 00:11:31.044487 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1250): Terminating (SIGTERM) 00:11:31.091824 --- ParallelTerminationStrategy: PID 1244 died... 00:11:31.112642 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1244): Terminated: ok {rc=0} 00:11:31.163501 --- ParallelTerminationStrategy: PID 1247 died... 00:11:31.184134 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1247): Terminated: ok {rc=0} 00:11:31.233710 --- ParallelTerminationStrategy: PID 1250 died... 00:11:31.254960 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1250): Terminated: ok {rc=0} 00:11:31.346169 bus /gobi_0: Setting Powered False 00:11:32.447275 bus /gobi_0: Setting Powered False 00:11:33.564267 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2366 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 00:11:34.819173 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:11:34.824909 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 00:11:34.854209 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 00:11:34.888478 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 00:11:34.940480 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 00:11:34.969374 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 00:11:35.003439 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 00:11:35.562490 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2366 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 00:11:35.567795 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:11:35.579219 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 00:11:35.644593 tst switch_tch_pdch.py: using LAC 24639 00:11:35.764875 tst switch_tch_pdch.py: using RAC 159 00:11:35.879044 tst switch_tch_pdch.py: using CellId 24639 00:11:36.002863 tst switch_tch_pdch.py: using BVCI 24640 00:11:36.117819 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:11:36.129570 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:11:36.141228 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:11:36.153097 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:11:36.164619 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:11:36.176393 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:11:36.188191 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 00:11:36.200699 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 00:11:36.317184 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 00:11:36.437485 tst switch_tch_pdch.py:51: start network... 00:11:36.648424 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:11:37.104787 run create_hlr_db(pid=1255): Launched 00:11:37.223608 bus /gobi_6: Setting Powered False 00:11:38.286433 run create_hlr_db(pid=1255): Terminated: ok {rc=0} 00:11:38.681340 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1257): Launched 00:11:38.974979 run osmo-hlr_10.42.42.2(pid=1258): Launched 00:11:39.087251 run osmo-stp_10.42.42.5: Starting osmo-stp 00:11:39.565261 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1260): Launched 00:11:39.857930 run osmo-stp_10.42.42.5(pid=1261): Launched 00:11:39.969020 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:11:40.448272 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1263): Launched 00:11:40.559865 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:11:40.806747 run patchelf(pid=1264): Launched 00:11:40.968810 run osmo-stp_10.42.42.5(pid=1261): ERR: Terminated: ERROR {rc=1} [trial-2366↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1261)] 00:11:41.092688 run osmo-stp_10.42.42.5(pid=1261): stdout: | (launched: 2022-12-10_00:11:39.803677) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:11:41.218090 run osmo-stp_10.42.42.5(pid=1261): stderr: | 20221210001139973 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001139973 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001139974 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001139974 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001139975 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001139975 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001139975 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:11:41.343647 run osmo-stp_10.42.42.5(pid=1261): stdout: | (launched: 2022-12-10_00:11:39.803677) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:11:41.463511 run osmo-stp_10.42.42.5(pid=1261): stderr: | 20221210001139973 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001139973 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001139974 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001139974 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001139975 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001139975 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001139975 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:11:41.605612 run patchelf(pid=1264): Terminating (SIGINT) 00:11:41.769878 run patchelf(pid=1264): Terminated: ok {rc=0} 00:11:41.888453 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=1261): Process ended prematurely: osmo-stp_10.42.42.5(pid=1261) [trial-2366↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1261)] [trial-2366↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 00:11:41.897698 tst switch_tch_pdch.py:54: Test FAILED (6.3 sec) 00:11:41.924154 run osmo-hlr_10.42.42.2(pid=1258): ERR: Terminated: ERROR {rc=237} [trial-2366↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1258)] 00:11:41.971041 run osmo-hlr_10.42.42.2(pid=1258): stdout: | (launched: 2022-12-10_00:11:38.921362) 00:11:42.019911 run osmo-hlr_10.42.42.2(pid=1258): stderr: | 20221210001139095 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210001139095 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210001139095 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210001139095 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210001139095 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210001139096 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210001139107 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210001139116 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210001139116 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210001139117 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:11:42.069274 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1257): Terminating (SIGTERM) 00:11:42.109114 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1260): Terminating (SIGTERM) 00:11:42.148525 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1263): Terminating (SIGTERM) 00:11:42.188325 --- ParallelTerminationStrategy: PID 1257 died... 00:11:42.207338 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1257): Terminated: ok {rc=0} 00:11:42.251141 --- ParallelTerminationStrategy: PID 1260 died... 00:11:42.270164 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1260): Terminated: ok {rc=0} 00:11:42.313691 --- ParallelTerminationStrategy: PID 1263 died... 00:11:42.332164 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1263): Terminated: ok {rc=0} 00:11:42.417830 bus /gobi_0: Setting Powered False 00:11:43.516643 bus /gobi_0: Setting Powered False 00:11:44.631143 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2366 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 nitb_sms:nanobts --------------------------------------------------------------------- 00:11:45.888364 tst nitb_sms:nanobts: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:11:45.892848 tst nitb_sms:nanobts: Verifying 1 x bts (candidates: 11) 00:11:45.920549 tst nitb_sms:nanobts: Verifying 1 x ip_address (candidates: 9) 00:11:45.927862 tst nitb_sms:nanobts: Verifying 2 x modem (candidates: 12) 00:11:45.980061 tst nitb_sms:nanobts: Reserving 1 x bts (candidates: 11) 00:11:46.005633 tst nitb_sms:nanobts: Reserving 1 x ip_address (candidates: 9) 00:11:46.014450 tst nitb_sms:nanobts: Reserving 2 x modem (candidates: 12) 00:11:46.557985 tst nitb_sms:nanobts: RESERVED RESOURCES for nitb_sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 nitb_sms:nanobts mo_mt_sms.py ---------------------------------------------- 00:11:46.565441 tst nitb_sms:nanobts: Using 1 x ip_address (candidates: 1) 00:11:46.579907 tst nitb_sms:nanobts: Using 1 x bts (candidates: 1) 00:11:46.616164 tst mo_mt_sms.py: using LAC 24640 00:11:46.737876 tst mo_mt_sms.py: using RAC 160 00:11:46.898789 tst mo_mt_sms.py: using CellId 24640 00:11:47.016219 tst mo_mt_sms.py: using BVCI 24641 00:11:47.141539 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 00:11:47.257763 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 00:11:47.379667 tst mo_mt_sms.py:9: start nitb and bts... 00:11:47.591242 run osmo-nitb_10.42.42.2: Starting osmo-nitb 00:11:48.230083 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1268): Launched 00:11:48.543476 run osmo-nitb_10.42.42.2(pid=1269): Launched 00:11:48.717842 run osmo-nitb_10.42.42.2(pid=1269): ERR: Terminated: ERROR {rc=2} [trial-2366↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1269)] 00:11:48.858936 run osmo-nitb_10.42.42.2(pid=1269): stdout: | (launched: 2022-12-10_00:11:48.486683) 00:11:49.001685 run osmo-nitb_10.42.42.2(pid=1269): stderr: | (launched: 2022-12-10_00:11:48.533238) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:11:49.144097 run osmo-nitb_10.42.42.2(pid=1269): stdout: | (launched: 2022-12-10_00:11:48.486683) 00:11:49.281300 run osmo-nitb_10.42.42.2(pid=1269): stderr: | (launched: 2022-12-10_00:11:48.533238) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=1269): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1269) [trial-2366↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1269)] 00:11:49.662879 tst osmo-nitb_10.42.42.2(pid=1269): stdout: | (launched: 2022-12-10_00:11:48.486683) 00:11:49.790364 tst osmo-nitb_10.42.42.2(pid=1269): stderr: | (launched: 2022-12-10_00:11:48.533238) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:11:49.939624 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=1269): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1269) [trial-2366↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1269)] [trial-2366↪nitb_sms:nanobts↪mo_mt_sms.py:11] 00:11:49.948890 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 00:11:49.956136 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1268): Terminating (SIGTERM) 00:11:50.167106 --- ParallelTerminationStrategy: PID 1268 died... 00:11:50.188773 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1268): Terminated: ok {rc=0} 00:11:50.275928 bus /sierra_3: Setting Powered False 00:11:51.375390 bus /sierra_3: Setting Powered False 00:11:52.491787 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 nitb_sms:nanobts FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 sms:nanobts+band-1900 --------------------------------------------------------------------- 00:11:53.681900 tst sms:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:11:53.687319 tst sms:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 00:11:53.712515 tst sms:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 00:11:53.739708 tst sms:nanobts+band-1900: Verifying 2 x modem (candidates: 12) 00:11:53.791923 tst sms:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 00:11:53.816394 tst sms:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 00:11:53.844132 tst sms:nanobts+band-1900: Reserving 2 x modem (candidates: 12) 00:11:54.392800 tst sms:nanobts+band-1900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 sms:nanobts+band-1900 mo_mt_sms.py ---------------------------------------------- 00:11:54.397961 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 00:11:54.409010 tst sms:nanobts+band-1900: Using 1 x bts (candidates: 1) 00:11:54.446674 tst mo_mt_sms.py: using LAC 24641 00:11:54.568201 tst mo_mt_sms.py: using RAC 161 00:11:54.690571 tst mo_mt_sms.py: using CellId 24641 00:11:54.816321 tst mo_mt_sms.py: using BVCI 24642 00:11:54.931561 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 00:11:54.942658 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 00:11:54.953662 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 00:11:54.964682 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 00:11:54.975915 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 00:11:54.987024 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 00:11:55.103684 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 00:11:55.222957 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:11:55.708509 run create_hlr_db(pid=1274): Launched 00:11:55.826470 bus /sierra_2: Setting Powered False 00:11:56.889285 run create_hlr_db(pid=1274): Terminated: ok {rc=0} 00:11:57.308262 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1276): Launched 00:11:57.601352 run osmo-hlr_10.42.42.2(pid=1277): Launched 00:11:57.715873 run osmo-stp_10.42.42.5: Starting osmo-stp 00:11:58.219032 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1279): Launched 00:11:58.510759 run osmo-stp_10.42.42.5(pid=1280): Launched 00:11:58.622658 run osmo-msc_10.42.42.6: Starting osmo-msc 00:11:59.150878 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1282): Launched 00:11:59.443272 run osmo-msc_10.42.42.6(pid=1283): Launched 00:11:59.606222 run osmo-stp_10.42.42.5(pid=1280): ERR: Terminated: ERROR {rc=1} [trial-2366↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1280)] 00:11:59.729833 run osmo-stp_10.42.42.5(pid=1280): stdout: | (launched: 2022-12-10_00:11:58.456450) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:11:59.854330 run osmo-stp_10.42.42.5(pid=1280): stderr: | 20221210001158625 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001158626 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001158626 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001158626 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001158627 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001158627 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001158627 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:11:59.976588 run osmo-stp_10.42.42.5(pid=1280): stdout: | (launched: 2022-12-10_00:11:58.456450) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:12:00.093824 run osmo-stp_10.42.42.5(pid=1280): stderr: | 20221210001158625 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001158626 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001158626 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001158626 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001158627 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001158627 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001158627 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:12:00.233909 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=1280): Process ended prematurely: osmo-stp_10.42.42.5(pid=1280) [trial-2366↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1280)] [trial-2366↪sms:nanobts+band-1900↪mo_mt_sms.py:16] 00:12:00.242229 tst mo_mt_sms.py:16: Test FAILED (5.8 sec) 00:12:00.268277 run osmo-hlr_10.42.42.2(pid=1277): ERR: Terminated: ERROR {rc=237} [trial-2366↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1277)] 00:12:00.315469 run osmo-hlr_10.42.42.2(pid=1277): stdout: | (launched: 2022-12-10_00:11:57.547065) 00:12:00.364758 run osmo-hlr_10.42.42.2(pid=1277): stderr: | 20221210001157723 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210001157723 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210001157723 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210001157724 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210001157724 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210001157724 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210001157736 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/sms:nanobts+band-1900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210001157745 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210001157745 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210001157745 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:12:00.433004 run osmo-msc_10.42.42.6(pid=1283): ERR: Terminated: ERROR {rc=2} [trial-2366↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1283)] 00:12:00.479850 run osmo-msc_10.42.42.6(pid=1283): stdout: | (launched: 2022-12-10_00:11:59.389598) 00:12:00.529564 run osmo-msc_10.42.42.6(pid=1283): stderr: | 20221210001159664 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210001159664 DLGLOBAL DEBUG validating counter group 0x7f28da4dbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210001159664 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210001159664 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210001159665 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210001159665 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210001159666 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210001159667 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210001159667 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210001159667 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:12:00.578745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1276): Terminating (SIGTERM) 00:12:00.618272 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1279): Terminating (SIGTERM) 00:12:00.657531 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1282): Terminating (SIGTERM) 00:12:00.696934 --- ParallelTerminationStrategy: PID 1276 died... 00:12:00.715925 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1276): Terminated: ok {rc=0} 00:12:00.759750 --- ParallelTerminationStrategy: PID 1279 died... 00:12:00.778226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1279): Terminated: ok {rc=0} 00:12:00.821868 --- ParallelTerminationStrategy: PID 1282 died... 00:12:00.861826 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1282): Terminated: ok {rc=0} 00:12:00.955223 bus /sierra_3: Setting Powered False 00:12:02.052738 bus /sierra_3: Setting Powered False 00:12:03.171579 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 sms:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 nitb_ussd:nanobts+band-1900 --------------------------------------------------------------------- 00:12:04.398751 tst nitb_ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:12:04.404008 tst nitb_ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 00:12:04.428802 tst nitb_ussd:nanobts+band-1900: Verifying 1 x ip_address (candidates: 9) 00:12:04.436529 tst nitb_ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 00:12:04.476882 tst nitb_ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 00:12:04.502224 tst nitb_ussd:nanobts+band-1900: Reserving 1 x ip_address (candidates: 9) 00:12:04.509204 tst nitb_ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 00:12:05.025808 tst nitb_ussd:nanobts+band-1900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2366 nitb_ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 00:12:05.030864 tst nitb_ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 1) 00:12:05.042063 tst nitb_ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 00:12:05.081069 tst assert_extension.py: using LAC 24642 00:12:05.195723 tst assert_extension.py: using RAC 162 00:12:05.309382 tst assert_extension.py: using CellId 24642 00:12:05.425832 tst assert_extension.py: using BVCI 24643 00:12:05.531961 tst nitb_ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 00:12:05.649617 tst assert_extension.py:10: start nitb and bts... 00:12:05.861040 run osmo-nitb_10.42.42.2: Starting osmo-nitb 00:12:06.500110 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1290): Launched 00:12:06.814326 run osmo-nitb_10.42.42.2(pid=1291): Launched 00:12:06.988114 run osmo-nitb_10.42.42.2(pid=1291): ERR: Terminated: ERROR {rc=2} [trial-2366↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1291)] 00:12:07.128497 run osmo-nitb_10.42.42.2(pid=1291): stdout: | (launched: 2022-12-10_00:12:06.757551) 00:12:07.270919 run osmo-nitb_10.42.42.2(pid=1291): stderr: | (launched: 2022-12-10_00:12:06.803934) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:12:07.412586 run osmo-nitb_10.42.42.2(pid=1291): stdout: | (launched: 2022-12-10_00:12:06.757551) 00:12:07.549460 run osmo-nitb_10.42.42.2(pid=1291): stderr: | (launched: 2022-12-10_00:12:06.803934) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=1291): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1291) [trial-2366↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1291)] 00:12:07.933408 tst osmo-nitb_10.42.42.2(pid=1291): stdout: | (launched: 2022-12-10_00:12:06.757551) 00:12:08.060296 tst osmo-nitb_10.42.42.2(pid=1291): stderr: | (launched: 2022-12-10_00:12:06.803934) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:12:08.209829 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=1291): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1291) [trial-2366↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1291)] [trial-2366↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12] 00:12:08.219043 tst assert_extension.py:12: Test FAILED (3.2 sec) 00:12:08.226106 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1290): Terminating (SIGTERM) 00:12:08.437172 --- ParallelTerminationStrategy: PID 1290 died... 00:12:08.458418 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1290): Terminated: ok {rc=0} 00:12:08.545085 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 nitb_ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 ussd:nanobts+band-1900 --------------------------------------------------------------------- 00:12:09.708262 tst ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:12:09.713095 tst ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 00:12:09.736895 tst ussd:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 00:12:09.763306 tst ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 00:12:09.804554 tst ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 00:12:09.828240 tst ussd:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 00:12:09.854870 tst ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 00:12:10.384642 tst ussd:nanobts+band-1900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2366 ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 00:12:10.390908 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 00:12:10.402068 tst ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 00:12:10.450780 tst assert_extension.py: using LAC 24643 00:12:10.574304 tst assert_extension.py: using RAC 163 00:12:10.697270 tst assert_extension.py: using CellId 24643 00:12:10.824309 tst assert_extension.py: using BVCI 24644 00:12:10.938528 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 00:12:10.949929 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 00:12:10.960834 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 00:12:10.972192 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 00:12:10.983353 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 00:12:10.994537 tst ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 00:12:11.108754 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:12:11.561175 run create_hlr_db(pid=1295): Launched 00:12:11.681612 bus /sierra_2: Setting Powered False 00:12:12.740750 run create_hlr_db(pid=1295): Terminated: ok {rc=0} 00:12:13.168799 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1297): Launched 00:12:13.482111 run osmo-hlr_10.42.42.2(pid=1298): Launched 00:12:13.603269 run osmo-stp_10.42.42.5: Starting osmo-stp 00:12:14.146067 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1300): Launched 00:12:14.458954 run osmo-stp_10.42.42.5(pid=1301): Launched 00:12:14.579785 run osmo-msc_10.42.42.6: Starting osmo-msc 00:12:15.146300 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1303): Launched 00:12:15.459906 run osmo-msc_10.42.42.6(pid=1304): Launched 00:12:15.636068 run osmo-stp_10.42.42.5(pid=1301): ERR: Terminated: ERROR {rc=1} [trial-2366↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1301)] 00:12:15.769661 run osmo-stp_10.42.42.5(pid=1301): stdout: | (launched: 2022-12-10_00:12:14.401373) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:12:16.019317 run osmo-stp_10.42.42.5(pid=1301): stderr: | 20221210001214593 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001214593 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001214593 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001214594 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001214594 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001214594 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001214594 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:12:16.167585 run osmo-stp_10.42.42.5(pid=1301): stdout: | (launched: 2022-12-10_00:12:14.401373) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:12:16.297329 run osmo-stp_10.42.42.5(pid=1301): stderr: | 20221210001214593 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001214593 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001214593 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001214594 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001214594 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001214594 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001214594 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:12:16.452555 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=1301): Process ended prematurely: osmo-stp_10.42.42.5(pid=1301) [trial-2366↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1301)] [trial-2366↪ussd:nanobts+band-1900↪assert_extension.py:17] 00:12:16.462658 tst assert_extension.py:17: Test FAILED (6.1 sec) 00:12:16.493950 run osmo-hlr_10.42.42.2(pid=1298): ERR: Terminated: ERROR {rc=237} [trial-2366↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1298)] 00:12:16.547217 run osmo-hlr_10.42.42.2(pid=1298): stdout: | (launched: 2022-12-10_00:12:13.425514) 00:12:16.602166 run osmo-hlr_10.42.42.2(pid=1298): stderr: | 20221210001213622 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210001213622 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210001213622 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210001213622 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210001213622 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210001213622 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210001213633 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/ussd:nanobts+band-1900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210001213641 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210001213641 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210001213641 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:12:16.677992 run osmo-msc_10.42.42.6(pid=1304): ERR: Terminated: ERROR {rc=2} [trial-2366↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1304)] 00:12:16.733305 run osmo-msc_10.42.42.6(pid=1304): stdout: | (launched: 2022-12-10_00:12:15.402002) 00:12:16.795780 run osmo-msc_10.42.42.6(pid=1304): stderr: | 20221210001215724 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210001215724 DLGLOBAL DEBUG validating counter group 0x7f5e46cc8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210001215725 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210001215725 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210001215725 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210001215725 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210001215727 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210001215727 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210001215727 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210001215727 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:12:16.859411 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1297): Terminating (SIGTERM) 00:12:16.912370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1300): Terminating (SIGTERM) 00:12:16.963839 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1303): Terminating (SIGTERM) 00:12:17.016480 --- ParallelTerminationStrategy: PID 1297 died... 00:12:17.037569 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1297): Terminated: ok {rc=0} 00:12:17.087919 --- ParallelTerminationStrategy: PID 1300 died... 00:12:17.108835 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1300): Terminated: ok {rc=0} 00:12:17.158775 --- ParallelTerminationStrategy: PID 1303 died... 00:12:17.179529 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1303): Terminated: ok {rc=0} 00:12:17.271973 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 00:12:18.474828 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:12:18.482967 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 00:12:18.509247 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 00:12:18.537358 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 00:12:18.590906 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 00:12:18.615480 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 00:12:18.644376 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 00:12:19.196674 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 00:12:19.249758 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:12:19.261677 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 00:12:19.323466 tst mo_mt_call.py: using LAC 24644 00:12:19.451839 tst mo_mt_call.py: using RAC 164 00:12:19.577206 tst mo_mt_call.py: using CellId 24644 00:12:19.699967 tst mo_mt_call.py: using BVCI 24645 00:12:19.817067 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:12:19.828852 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:12:19.840418 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:12:19.852100 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:12:19.864016 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:12:19.875841 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 00:12:19.996548 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 00:12:20.119101 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:12:20.612539 run create_hlr_db(pid=1309): Launched 00:12:20.734454 bus /sierra_2: Setting Powered False 00:12:21.797643 run create_hlr_db(pid=1309): Terminated: ok {rc=0} 00:12:22.223980 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1311): Launched 00:12:22.521631 run osmo-hlr_10.42.42.2(pid=1312): Launched 00:12:22.636483 run osmo-stp_10.42.42.5: Starting osmo-stp 00:12:23.151282 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1314): Launched 00:12:23.447598 run osmo-stp_10.42.42.5(pid=1315): Launched 00:12:23.560817 run osmo-msc_10.42.42.6: Starting osmo-msc 00:12:24.100208 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1317): Launched 00:12:24.397720 run osmo-msc_10.42.42.6(pid=1318): Launched 00:12:24.565592 run osmo-stp_10.42.42.5(pid=1315): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1315)] 00:12:24.692654 run osmo-stp_10.42.42.5(pid=1315): stdout: | (launched: 2022-12-10_00:12:23.393469) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:12:24.819775 run osmo-stp_10.42.42.5(pid=1315): stderr: | 20221210001223562 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001223562 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001223562 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001223563 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001223565 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001223565 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001223565 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:12:24.943794 run osmo-stp_10.42.42.5(pid=1315): stdout: | (launched: 2022-12-10_00:12:23.393469) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:12:25.062174 run osmo-stp_10.42.42.5(pid=1315): stderr: | 20221210001223562 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001223562 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001223562 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001223563 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001223565 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001223565 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001223565 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:12:25.204029 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1315): Process ended prematurely: osmo-stp_10.42.42.5(pid=1315) [trial-2366↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1315)] [trial-2366↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 00:12:25.212997 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 00:12:25.239203 run osmo-hlr_10.42.42.2(pid=1312): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1312)] 00:12:25.285922 run osmo-hlr_10.42.42.2(pid=1312): stdout: | (launched: 2022-12-10_00:12:22.467031) 00:12:25.334589 run osmo-hlr_10.42.42.2(pid=1312): stderr: | 20221210001222641 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210001222641 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210001222641 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210001222641 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210001222641 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210001222641 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210001222688 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210001222698 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210001222698 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210001222698 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:12:25.402594 run osmo-msc_10.42.42.6(pid=1318): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1318)] 00:12:25.449403 run osmo-msc_10.42.42.6(pid=1318): stdout: | (launched: 2022-12-10_00:12:24.342890) 00:12:25.497996 run osmo-msc_10.42.42.6(pid=1318): stderr: | 20221210001224616 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210001224617 DLGLOBAL DEBUG validating counter group 0x7feec108dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210001224617 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210001224617 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210001224617 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210001224617 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210001224619 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210001224619 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210001224619 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210001224619 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:12:25.547268 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1311): Terminating (SIGTERM) 00:12:25.586537 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1314): Terminating (SIGTERM) 00:12:25.625673 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1317): Terminating (SIGTERM) 00:12:25.664864 --- ParallelTerminationStrategy: PID 1311 died... 00:12:25.683880 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1311): Terminated: ok {rc=0} 00:12:25.727367 --- ParallelTerminationStrategy: PID 1314 died... 00:12:25.745830 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1314): Terminated: ok {rc=0} 00:12:25.789075 --- ParallelTerminationStrategy: PID 1317 died... 00:12:25.807630 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1317): Terminated: ok {rc=0} 00:12:25.890107 bus /sierra_3: Setting Powered False 00:12:26.985062 bus /sierra_3: Setting Powered False 00:12:28.099145 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 00:12:29.244847 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:12:29.256912 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 00:12:29.315829 tst mo_mt_call_osmux.py: using LAC 24645 00:12:29.433946 tst mo_mt_call_osmux.py: using RAC 165 00:12:29.549059 tst mo_mt_call_osmux.py: using CellId 24645 00:12:29.664211 tst mo_mt_call_osmux.py: using BVCI 24646 00:12:29.771659 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:12:29.782984 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:12:29.794085 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:12:29.805144 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:12:29.816154 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:12:29.827236 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 00:12:29.945322 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 00:12:30.063022 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:12:30.525708 run create_hlr_db(pid=1320): Launched 00:12:30.647250 bus /sierra_2: Setting Powered False 00:12:31.711067 run create_hlr_db(pid=1320): Terminated: ok {rc=0} 00:12:32.170071 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1322): Launched 00:12:32.501767 run osmo-hlr_10.42.42.2(pid=1323): Launched 00:12:32.625407 run osmo-stp_10.42.42.5: Starting osmo-stp 00:12:33.194378 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1325): Launched 00:12:33.512657 run osmo-stp_10.42.42.5(pid=1326): Launched 00:12:33.635590 run osmo-msc_10.42.42.6: Starting osmo-msc 00:12:34.213667 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1328): Launched 00:12:34.532429 run osmo-msc_10.42.42.6(pid=1329): Launched 00:12:34.710835 run osmo-stp_10.42.42.5(pid=1326): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1326)] 00:12:34.846283 run osmo-stp_10.42.42.5(pid=1326): stdout: | (launched: 2022-12-10_00:12:33.454633) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:12:34.981882 run osmo-stp_10.42.42.5(pid=1326): stderr: | 20221210001233645 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001233645 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001233646 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001233646 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001233646 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001233646 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001233646 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:12:35.117456 run osmo-stp_10.42.42.5(pid=1326): stdout: | (launched: 2022-12-10_00:12:33.454633) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:12:35.245206 run osmo-stp_10.42.42.5(pid=1326): stderr: | 20221210001233645 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001233645 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001233646 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001233646 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001233646 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001233646 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001233646 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:12:35.398274 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1326): Process ended prematurely: osmo-stp_10.42.42.5(pid=1326) [trial-2366↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1326)] [trial-2366↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 00:12:35.408052 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 00:12:35.436404 run osmo-hlr_10.42.42.2(pid=1323): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1323)] 00:12:35.486276 run osmo-hlr_10.42.42.2(pid=1323): stdout: | (launched: 2022-12-10_00:12:32.443991) 00:12:35.537988 run osmo-hlr_10.42.42.2(pid=1323): stderr: | 20221210001232641 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210001232641 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210001232641 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210001232641 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210001232641 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210001232641 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210001232653 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210001232662 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210001232663 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210001232663 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:12:35.610319 run osmo-msc_10.42.42.6(pid=1329): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1329)] 00:12:35.660500 run osmo-msc_10.42.42.6(pid=1329): stdout: | (launched: 2022-12-10_00:12:34.474327) 00:12:35.712276 run osmo-msc_10.42.42.6(pid=1329): stderr: | 20221210001234797 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210001234798 DLGLOBAL DEBUG validating counter group 0x7f6d21780c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210001234798 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210001234798 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210001234798 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210001234798 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210001234800 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210001234800 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210001234800 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210001234801 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:12:35.764253 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1322): Terminating (SIGTERM) 00:12:35.805926 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1325): Terminating (SIGTERM) 00:12:35.847522 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1328): Terminating (SIGTERM) 00:12:35.890156 --- ParallelTerminationStrategy: PID 1322 died... 00:12:35.912889 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1322): Terminated: ok {rc=0} 00:12:35.959926 --- ParallelTerminationStrategy: PID 1325 died... 00:12:35.979379 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1325): Terminated: ok {rc=0} 00:12:36.026296 --- ParallelTerminationStrategy: PID 1328 died... 00:12:36.046046 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1328): Terminated: ok {rc=0} 00:12:36.134369 bus /sierra_3: Setting Powered False 00:12:37.232167 bus /sierra_3: Setting Powered False 00:12:38.349465 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 00:12:39.591765 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:12:39.599102 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 00:12:39.622737 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 00:12:39.649282 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 00:12:39.701913 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 00:12:39.726025 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 00:12:39.752367 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 00:12:40.303202 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 00:12:40.351023 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:12:40.362303 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 00:12:40.421320 tst mo_mt_call.py: using LAC 24646 00:12:40.539434 tst mo_mt_call.py: using RAC 166 00:12:40.657457 tst mo_mt_call.py: using CellId 24646 00:12:40.773792 tst mo_mt_call.py: using BVCI 24647 00:12:40.882979 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:12:40.894319 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:12:40.905374 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:12:40.916361 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:12:40.927475 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:12:40.938576 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 00:12:41.057295 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 00:12:41.176549 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:12:41.670044 run create_hlr_db(pid=1334): Launched 00:12:41.792107 bus /sierra_2: Setting Powered False 00:12:42.856146 run create_hlr_db(pid=1334): Terminated: ok {rc=0} 00:12:43.299696 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1336): Launched 00:12:43.618528 run osmo-hlr_10.42.42.2(pid=1337): Launched 00:12:43.742729 run osmo-stp_10.42.42.5: Starting osmo-stp 00:12:44.294488 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1339): Launched 00:12:44.612236 run osmo-stp_10.42.42.5(pid=1340): Launched 00:12:44.734448 run osmo-msc_10.42.42.6: Starting osmo-msc 00:12:45.311530 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1342): Launched 00:12:45.631109 run osmo-msc_10.42.42.6(pid=1343): Launched 00:12:45.809420 run osmo-stp_10.42.42.5(pid=1340): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1340)] 00:12:45.949672 run osmo-stp_10.42.42.5(pid=1340): stdout: | (launched: 2022-12-10_00:12:44.554555) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:12:46.275130 run osmo-stp_10.42.42.5(pid=1340): stderr: | 20221210001244747 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001244748 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001244748 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001244748 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001244749 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001244749 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001244749 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:12:46.451328 run osmo-stp_10.42.42.5(pid=1340): stdout: | (launched: 2022-12-10_00:12:44.554555) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:12:46.591776 run osmo-stp_10.42.42.5(pid=1340): stderr: | 20221210001244747 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001244748 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001244748 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001244748 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001244749 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001244749 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001244749 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:12:46.748165 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1340): Process ended prematurely: osmo-stp_10.42.42.5(pid=1340) [trial-2366↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1340)] [trial-2366↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 00:12:46.758578 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 00:12:46.789242 run osmo-hlr_10.42.42.2(pid=1337): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1337)] 00:12:46.841448 run osmo-hlr_10.42.42.2(pid=1337): stdout: | (launched: 2022-12-10_00:12:43.560622) 00:12:46.896387 run osmo-hlr_10.42.42.2(pid=1337): stderr: | 20221210001243760 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210001243760 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210001243761 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210001243761 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210001243761 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210001243761 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210001243777 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210001243786 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210001243786 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210001243786 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:12:46.971120 run osmo-msc_10.42.42.6(pid=1343): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1343)] 00:12:47.023353 run osmo-msc_10.42.42.6(pid=1343): stdout: | (launched: 2022-12-10_00:12:45.573319) 00:12:47.077589 run osmo-msc_10.42.42.6(pid=1343): stderr: | 20221210001246011 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210001246011 DLGLOBAL DEBUG validating counter group 0x7f20778a2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210001246011 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210001246011 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210001246011 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210001246012 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210001246015 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210001246016 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210001246016 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210001246016 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:12:47.131979 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1336): Terminating (SIGTERM) 00:12:47.175984 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1339): Terminating (SIGTERM) 00:12:47.220101 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1342): Terminating (SIGTERM) 00:12:47.264426 --- ParallelTerminationStrategy: PID 1336 died... 00:12:47.284816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1336): Terminated: ok {rc=0} 00:12:47.334207 --- ParallelTerminationStrategy: PID 1339 died... 00:12:47.354874 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1339): Terminated: ok {rc=0} 00:12:47.402683 --- ParallelTerminationStrategy: PID 1342 died... 00:12:47.422227 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1342): Terminated: ok {rc=0} 00:12:47.510004 bus /sierra_3: Setting Powered False 00:12:48.607109 bus /sierra_3: Setting Powered False 00:12:49.723875 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 00:12:50.871987 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:12:50.884184 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 00:12:50.945133 tst mo_mt_call_osmux.py: using LAC 24647 00:12:51.070914 tst mo_mt_call_osmux.py: using RAC 167 00:12:51.195938 tst mo_mt_call_osmux.py: using CellId 24647 00:12:51.322409 tst mo_mt_call_osmux.py: using BVCI 24648 00:12:51.440136 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:12:51.451815 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:12:51.463241 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:12:51.474936 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:12:51.486728 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:12:51.498348 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 00:12:51.619329 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 00:12:51.737605 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:12:52.198925 run create_hlr_db(pid=1345): Launched 00:12:52.321185 bus /sierra_2: Setting Powered False 00:12:53.380212 run create_hlr_db(pid=1345): Terminated: ok {rc=0} 00:12:53.796890 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1347): Launched 00:12:54.095367 run osmo-hlr_10.42.42.2(pid=1348): Launched 00:12:54.208428 run osmo-stp_10.42.42.5: Starting osmo-stp 00:12:54.734968 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1350): Launched 00:12:55.033199 run osmo-stp_10.42.42.5(pid=1351): Launched 00:12:55.146290 run osmo-msc_10.42.42.6: Starting osmo-msc 00:12:55.685424 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1353): Launched 00:12:55.985007 run osmo-msc_10.42.42.6(pid=1354): Launched 00:12:56.151696 run osmo-stp_10.42.42.5(pid=1351): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1351)] 00:12:56.277759 run osmo-stp_10.42.42.5(pid=1351): stdout: | (launched: 2022-12-10_00:12:54.978428) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:12:56.404016 run osmo-stp_10.42.42.5(pid=1351): stderr: | 20221210001255146 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001255146 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001255147 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001255147 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001255149 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001255150 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001255150 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:12:56.528615 run osmo-stp_10.42.42.5(pid=1351): stdout: | (launched: 2022-12-10_00:12:54.978428) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:12:56.647516 run osmo-stp_10.42.42.5(pid=1351): stderr: | 20221210001255146 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001255146 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001255147 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001255147 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001255149 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001255150 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001255150 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:12:56.790376 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1351): Process ended prematurely: osmo-stp_10.42.42.5(pid=1351) [trial-2366↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1351)] [trial-2366↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 00:12:56.799366 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 00:12:56.825861 run osmo-hlr_10.42.42.2(pid=1348): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1348)] 00:12:56.873571 run osmo-hlr_10.42.42.2(pid=1348): stdout: | (launched: 2022-12-10_00:12:54.040547) 00:12:56.922694 run osmo-hlr_10.42.42.2(pid=1348): stderr: | 20221210001254213 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210001254213 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210001254213 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210001254213 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210001254214 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210001254214 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210001254225 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210001254234 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210001254234 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210001254234 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:12:56.991991 run osmo-msc_10.42.42.6(pid=1354): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1354)] 00:12:57.039344 run osmo-msc_10.42.42.6(pid=1354): stdout: | (launched: 2022-12-10_00:12:55.930243) 00:12:57.088303 run osmo-msc_10.42.42.6(pid=1354): stderr: | 20221210001256202 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210001256202 DLGLOBAL DEBUG validating counter group 0x7fd3d2709c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210001256202 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210001256202 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210001256203 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210001256204 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210001256205 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210001256206 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210001256206 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210001256206 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:12:57.137504 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1347): Terminating (SIGTERM) 00:12:57.176699 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1350): Terminating (SIGTERM) 00:12:57.215984 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1353): Terminating (SIGTERM) 00:12:57.255489 --- ParallelTerminationStrategy: PID 1347 died... 00:12:57.274383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1347): Terminated: ok {rc=0} 00:12:57.317962 --- ParallelTerminationStrategy: PID 1350 died... 00:12:57.336328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1350): Terminated: ok {rc=0} 00:12:57.380327 --- ParallelTerminationStrategy: PID 1353 died... 00:12:57.398901 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1353): Terminated: ok {rc=0} 00:12:57.483979 bus /sierra_3: Setting Powered False 00:12:58.584548 bus /sierra_3: Setting Powered False 00:12:59.701819 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 00:13:00.965510 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:13:00.973975 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 00:13:01.000779 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 00:13:01.029804 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 00:13:01.089297 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 00:13:01.139014 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 00:13:01.182807 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 00:13:01.703696 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 00:13:01.777270 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:13:01.794186 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 00:13:01.875835 tst mo_mt_call.py: using LAC 24648 00:13:02.008816 tst mo_mt_call.py: using RAC 168 00:13:02.136440 tst mo_mt_call.py: using CellId 24648 00:13:02.289145 tst mo_mt_call.py: using BVCI 24649 00:13:02.402271 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:13:02.414124 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:13:02.425466 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:13:02.436717 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:13:02.448168 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:13:02.459567 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 00:13:02.578656 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 00:13:02.700839 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:13:03.193700 run create_hlr_db(pid=1359): Launched 00:13:03.315672 bus /sierra_2: Setting Powered False 00:13:04.379422 run create_hlr_db(pid=1359): Terminated: ok {rc=0} 00:13:04.806492 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1361): Launched 00:13:05.105103 run osmo-hlr_10.42.42.2(pid=1362): Launched 00:13:05.218039 run osmo-stp_10.42.42.5: Starting osmo-stp 00:13:05.770959 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1364): Launched 00:13:06.089711 run osmo-stp_10.42.42.5(pid=1365): Launched 00:13:06.211804 run osmo-msc_10.42.42.6: Starting osmo-msc 00:13:06.790370 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1367): Launched 00:13:07.108897 run osmo-msc_10.42.42.6(pid=1368): Launched 00:13:07.286836 run osmo-stp_10.42.42.5(pid=1365): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1365)] 00:13:07.421534 run osmo-stp_10.42.42.5(pid=1365): stdout: | (launched: 2022-12-10_00:13:06.031865) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:13:07.557114 run osmo-stp_10.42.42.5(pid=1365): stderr: | 20221210001306222 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001306222 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001306222 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001306223 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001306223 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001306223 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001306223 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:13:07.692145 run osmo-stp_10.42.42.5(pid=1365): stdout: | (launched: 2022-12-10_00:13:06.031865) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:13:07.819448 run osmo-stp_10.42.42.5(pid=1365): stderr: | 20221210001306222 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001306222 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001306222 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001306223 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001306223 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001306223 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001306223 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:13:07.971573 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1365): Process ended prematurely: osmo-stp_10.42.42.5(pid=1365) [trial-2366↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1365)] [trial-2366↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 00:13:07.981311 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 00:13:08.009695 run osmo-hlr_10.42.42.2(pid=1362): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1362)] 00:13:08.059534 run osmo-hlr_10.42.42.2(pid=1362): stdout: | (launched: 2022-12-10_00:13:05.050686) 00:13:08.111206 run osmo-hlr_10.42.42.2(pid=1362): stderr: | 20221210001305228 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210001305228 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210001305228 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210001305228 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210001305228 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210001305228 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210001305244 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210001305254 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210001305254 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210001305254 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:13:08.183288 run osmo-msc_10.42.42.6(pid=1368): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1368)] 00:13:08.233140 run osmo-msc_10.42.42.6(pid=1368): stdout: | (launched: 2022-12-10_00:13:07.051119) 00:13:08.284706 run osmo-msc_10.42.42.6(pid=1368): stderr: | 20221210001307370 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210001307370 DLGLOBAL DEBUG validating counter group 0x7f49a1344c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210001307370 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210001307370 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210001307370 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210001307371 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210001307372 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210001307373 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210001307373 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210001307373 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:13:08.336326 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1361): Terminating (SIGTERM) 00:13:08.377598 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1364): Terminating (SIGTERM) 00:13:08.419165 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1367): Terminating (SIGTERM) 00:13:08.461106 --- ParallelTerminationStrategy: PID 1361 died... 00:13:08.480873 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1361): Terminated: ok {rc=0} 00:13:08.527529 --- ParallelTerminationStrategy: PID 1364 died... 00:13:08.547128 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1364): Terminated: ok {rc=0} 00:13:08.593889 --- ParallelTerminationStrategy: PID 1367 died... 00:13:08.613384 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1367): Terminated: ok {rc=0} 00:13:08.700295 bus /sierra_3: Setting Powered False 00:13:09.798648 bus /sierra_3: Setting Powered False 00:13:10.912232 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 00:13:12.057343 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:13:12.069194 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 00:13:12.129041 tst mo_mt_call_osmux.py: using LAC 24649 00:13:12.247946 tst mo_mt_call_osmux.py: using RAC 169 00:13:12.366540 tst mo_mt_call_osmux.py: using CellId 24649 00:13:12.484869 tst mo_mt_call_osmux.py: using BVCI 24650 00:13:12.593154 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:13:12.604208 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:13:12.615172 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:13:12.626093 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:13:12.637103 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:13:12.648012 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 00:13:12.760898 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 00:13:12.875942 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:13:13.338084 run create_hlr_db(pid=1370): Launched 00:13:13.458777 bus /sierra_2: Setting Powered False 00:13:14.518232 run create_hlr_db(pid=1370): Terminated: ok {rc=0} 00:13:14.933051 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1372): Launched 00:13:15.230848 run osmo-hlr_10.42.42.2(pid=1373): Launched 00:13:15.343303 run osmo-stp_10.42.42.5: Starting osmo-stp 00:13:15.861782 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1375): Launched 00:13:16.217735 run osmo-stp_10.42.42.5(pid=1376): Launched 00:13:16.431110 run osmo-msc_10.42.42.6: Starting osmo-msc 00:13:17.119238 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1378): Launched 00:13:17.443782 run osmo-msc_10.42.42.6(pid=1379): Launched 00:13:17.623256 run osmo-stp_10.42.42.5(pid=1376): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1376)] 00:13:17.760377 run osmo-stp_10.42.42.5(pid=1376): stdout: | (launched: 2022-12-10_00:13:16.151316) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:13:17.896337 run osmo-stp_10.42.42.5(pid=1376): stderr: | 20221210001316477 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001316477 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001316477 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001316478 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001316478 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001316478 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001316479 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:13:18.031205 run osmo-stp_10.42.42.5(pid=1376): stdout: | (launched: 2022-12-10_00:13:16.151316) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:13:18.158934 run osmo-stp_10.42.42.5(pid=1376): stderr: | 20221210001316477 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001316477 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001316477 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001316478 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001316478 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001316478 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001316479 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:13:18.311522 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1376): Process ended prematurely: osmo-stp_10.42.42.5(pid=1376) [trial-2366↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1376)] [trial-2366↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 00:13:18.321376 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 00:13:18.348719 run osmo-hlr_10.42.42.2(pid=1373): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1373)] 00:13:18.398856 run osmo-hlr_10.42.42.2(pid=1373): stdout: | (launched: 2022-12-10_00:13:15.176345) 00:13:18.450293 run osmo-hlr_10.42.42.2(pid=1373): stderr: | 20221210001315356 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210001315356 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210001315356 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210001315356 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210001315356 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210001315356 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210001315370 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210001315379 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210001315379 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210001315379 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:13:18.523261 run osmo-msc_10.42.42.6(pid=1379): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1379)] 00:13:18.573739 run osmo-msc_10.42.42.6(pid=1379): stdout: | (launched: 2022-12-10_00:13:17.385804) 00:13:18.625267 run osmo-msc_10.42.42.6(pid=1379): stderr: | 20221210001317704 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210001317705 DLGLOBAL DEBUG validating counter group 0x7f03dd45bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210001317705 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210001317705 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210001317705 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210001317705 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210001317707 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210001317707 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210001317707 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210001317708 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:13:18.677215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1372): Terminating (SIGTERM) 00:13:18.719224 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1375): Terminating (SIGTERM) 00:13:18.760857 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1378): Terminating (SIGTERM) 00:13:18.803243 --- ParallelTerminationStrategy: PID 1372 died... 00:13:18.823032 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1372): Terminated: ok {rc=0} 00:13:18.869295 --- ParallelTerminationStrategy: PID 1375 died... 00:13:18.888619 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1375): Terminated: ok {rc=0} 00:13:18.934524 --- ParallelTerminationStrategy: PID 1378 died... 00:13:18.953799 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1378): Terminated: ok {rc=0} 00:13:19.040942 bus /sierra_3: Setting Powered False 00:13:20.138976 bus /sierra_3: Setting Powered False 00:13:21.254286 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 00:13:22.494279 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:13:22.501594 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 00:13:22.525000 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 00:13:22.551410 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 00:13:22.601285 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 00:13:22.624651 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 00:13:22.650971 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 00:13:23.206192 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 00:13:23.254158 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:13:23.265539 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 00:13:23.323282 tst mo_mt_call.py: using LAC 24650 00:13:23.440340 tst mo_mt_call.py: using RAC 170 00:13:23.555115 tst mo_mt_call.py: using CellId 24650 00:13:23.669241 tst mo_mt_call.py: using BVCI 24651 00:13:23.776204 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:13:23.787441 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:13:23.798500 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:13:23.809520 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:13:23.820567 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:13:23.831554 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 00:13:23.949419 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 00:13:24.069116 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:13:24.561594 run create_hlr_db(pid=1384): Launched 00:13:24.684477 bus /sierra_2: Setting Powered False 00:13:25.748207 run create_hlr_db(pid=1384): Terminated: ok {rc=0} 00:13:26.191772 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1386): Launched 00:13:26.511614 run osmo-hlr_10.42.42.2(pid=1387): Launched 00:13:26.634030 run osmo-stp_10.42.42.5: Starting osmo-stp 00:13:27.149656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1389): Launched 00:13:27.449354 run osmo-stp_10.42.42.5(pid=1390): Launched 00:13:27.564556 run osmo-msc_10.42.42.6: Starting osmo-msc 00:13:28.103527 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1392): Launched 00:13:28.401042 run osmo-msc_10.42.42.6(pid=1393): Launched 00:13:28.566920 run osmo-stp_10.42.42.5(pid=1390): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1390)] 00:13:28.693247 run osmo-stp_10.42.42.5(pid=1390): stdout: | (launched: 2022-12-10_00:13:27.394445) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:13:28.818278 run osmo-stp_10.42.42.5(pid=1390): stderr: | 20221210001327563 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001327563 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001327563 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001327563 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001327564 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001327564 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001327564 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:13:28.941708 run osmo-stp_10.42.42.5(pid=1390): stdout: | (launched: 2022-12-10_00:13:27.394445) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:13:29.059657 run osmo-stp_10.42.42.5(pid=1390): stderr: | 20221210001327563 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001327563 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001327563 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001327563 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001327564 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001327564 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001327564 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:13:29.201713 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1390): Process ended prematurely: osmo-stp_10.42.42.5(pid=1390) [trial-2366↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1390)] [trial-2366↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 00:13:29.210775 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 00:13:29.237116 run osmo-hlr_10.42.42.2(pid=1387): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1387)] 00:13:29.284131 run osmo-hlr_10.42.42.2(pid=1387): stdout: | (launched: 2022-12-10_00:13:26.453739) 00:13:29.332545 run osmo-hlr_10.42.42.2(pid=1387): stderr: | 20221210001326651 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210001326651 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210001326651 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210001326651 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210001326651 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210001326651 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210001326664 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210001326672 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210001326672 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210001326672 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:13:29.400761 run osmo-msc_10.42.42.6(pid=1393): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1393)] 00:13:29.447564 run osmo-msc_10.42.42.6(pid=1393): stdout: | (launched: 2022-12-10_00:13:28.346344) 00:13:29.496100 run osmo-msc_10.42.42.6(pid=1393): stderr: | 20221210001328616 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210001328616 DLGLOBAL DEBUG validating counter group 0x7fe0a5f31c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210001328616 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210001328616 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210001328617 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210001328617 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210001328619 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210001328620 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210001328620 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210001328620 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:13:29.544887 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1386): Terminating (SIGTERM) 00:13:29.583791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1389): Terminating (SIGTERM) 00:13:29.622567 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1392): Terminating (SIGTERM) 00:13:29.661910 --- ParallelTerminationStrategy: PID 1386 died... 00:13:29.680731 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1386): Terminated: ok {rc=0} 00:13:29.724600 --- ParallelTerminationStrategy: PID 1389 died... 00:13:29.743211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1389): Terminated: ok {rc=0} 00:13:29.787087 --- ParallelTerminationStrategy: PID 1392 died... 00:13:29.805781 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1392): Terminated: ok {rc=0} 00:13:29.888506 bus /sierra_3: Setting Powered False 00:13:30.998910 bus /sierra_3: Setting Powered False 00:13:32.132062 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 00:13:33.274828 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:13:33.286695 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 00:13:33.346356 tst mo_mt_call_osmux.py: using LAC 24651 00:13:33.462322 tst mo_mt_call_osmux.py: using RAC 171 00:13:33.580382 tst mo_mt_call_osmux.py: using CellId 24651 00:13:33.696252 tst mo_mt_call_osmux.py: using BVCI 24652 00:13:33.803601 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:13:33.814785 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:13:33.825866 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:13:33.836833 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:13:33.847924 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:13:33.858876 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 00:13:33.977140 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 00:13:34.094379 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:13:34.555547 run create_hlr_db(pid=1396): Launched 00:13:34.677320 bus /sierra_2: Setting Powered False 00:13:35.737369 run create_hlr_db(pid=1396): Terminated: ok {rc=0} 00:13:36.153478 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1398): Launched 00:13:36.452637 run osmo-hlr_10.42.42.2(pid=1399): Launched 00:13:36.565690 run osmo-stp_10.42.42.5: Starting osmo-stp 00:13:37.101909 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1401): Launched 00:13:37.399742 run osmo-stp_10.42.42.5(pid=1402): Launched 00:13:37.513564 run osmo-msc_10.42.42.6: Starting osmo-msc 00:13:38.051849 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1404): Launched 00:13:38.348409 run osmo-msc_10.42.42.6(pid=1405): Launched 00:13:38.514637 run osmo-stp_10.42.42.5(pid=1402): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1402)] 00:13:38.640387 run osmo-stp_10.42.42.5(pid=1402): stdout: | (launched: 2022-12-10_00:13:37.345095) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:13:38.766005 run osmo-stp_10.42.42.5(pid=1402): stderr: | 20221210001337514 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001337515 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001337515 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001337515 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001337518 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001337518 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001337518 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:13:38.889667 run osmo-stp_10.42.42.5(pid=1402): stdout: | (launched: 2022-12-10_00:13:37.345095) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:13:39.007792 run osmo-stp_10.42.42.5(pid=1402): stderr: | 20221210001337514 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001337515 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001337515 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001337515 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001337518 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001337518 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001337518 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:13:39.150148 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1402): Process ended prematurely: osmo-stp_10.42.42.5(pid=1402) [trial-2366↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1402)] [trial-2366↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 00:13:39.159100 tst mo_mt_call_osmux.py:8: Test FAILED (5.9 sec) 00:13:39.185429 run osmo-hlr_10.42.42.2(pid=1399): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1399)] 00:13:39.232442 run osmo-hlr_10.42.42.2(pid=1399): stdout: | (launched: 2022-12-10_00:13:36.397539) 00:13:39.282013 run osmo-hlr_10.42.42.2(pid=1399): stderr: | 20221210001336575 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210001336575 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210001336575 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210001336575 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210001336575 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210001336575 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210001336587 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210001336596 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210001336596 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210001336596 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:13:39.350682 run osmo-msc_10.42.42.6(pid=1405): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1405)] 00:13:39.397890 run osmo-msc_10.42.42.6(pid=1405): stdout: | (launched: 2022-12-10_00:13:38.293783) 00:13:39.446615 run osmo-msc_10.42.42.6(pid=1405): stderr: | 20221210001338566 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210001338566 DLGLOBAL DEBUG validating counter group 0x7f254385bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210001338566 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210001338566 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210001338567 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210001338567 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210001338569 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210001338569 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210001338570 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210001338570 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:13:39.495860 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1398): Terminating (SIGTERM) 00:13:39.535022 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1401): Terminating (SIGTERM) 00:13:39.574229 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1404): Terminating (SIGTERM) 00:13:39.613684 --- ParallelTerminationStrategy: PID 1398 died... 00:13:39.632669 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1398): Terminated: ok {rc=0} 00:13:39.676513 --- ParallelTerminationStrategy: PID 1401 died... 00:13:39.695037 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1401): Terminated: ok {rc=0} 00:13:39.738366 --- ParallelTerminationStrategy: PID 1404 died... 00:13:39.757007 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1404): Terminated: ok {rc=0} 00:13:39.842638 bus /sierra_3: Setting Powered False 00:13:40.941814 bus /sierra_3: Setting Powered False 00:13:42.056411 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 00:13:43.294470 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:13:43.302965 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 00:13:43.328240 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 00:13:43.356472 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 00:13:43.409008 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 00:13:43.433335 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 00:13:43.461002 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 00:13:44.015056 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 00:13:44.066503 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:13:44.078295 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 00:13:44.139256 tst mo_mt_call.py: using LAC 24652 00:13:44.267471 tst mo_mt_call.py: using RAC 172 00:13:44.391911 tst mo_mt_call.py: using CellId 24652 00:13:44.516821 tst mo_mt_call.py: using BVCI 24653 00:13:44.632595 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:13:44.644501 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:13:44.656085 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:13:44.667646 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:13:44.679780 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:13:44.691551 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:13:44.808641 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:13:44.923734 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:13:45.387216 run create_hlr_db(pid=1410): Launched 00:13:45.509769 bus /sierra_2: Setting Powered False 00:13:46.581129 run create_hlr_db(pid=1410): Terminated: ok {rc=0} 00:13:47.043713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1412): Launched 00:13:47.372301 run osmo-hlr_10.42.42.2(pid=1413): Launched 00:13:47.495709 run osmo-stp_10.42.42.5: Starting osmo-stp 00:13:48.047783 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1415): Launched 00:13:48.365912 run osmo-stp_10.42.42.5(pid=1416): Launched 00:13:48.486687 run osmo-msc_10.42.42.6: Starting osmo-msc 00:13:49.066326 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1418): Launched 00:13:49.385148 run osmo-msc_10.42.42.6(pid=1419): Launched 00:13:49.562796 run osmo-stp_10.42.42.5(pid=1416): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1416)] 00:13:49.699045 run osmo-stp_10.42.42.5(pid=1416): stdout: | (launched: 2022-12-10_00:13:48.307947) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:13:49.834273 run osmo-stp_10.42.42.5(pid=1416): stderr: | 20221210001348501 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001348501 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001348501 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001348502 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001348502 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001348502 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001348502 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:13:49.968897 run osmo-stp_10.42.42.5(pid=1416): stdout: | (launched: 2022-12-10_00:13:48.307947) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:13:50.095828 run osmo-stp_10.42.42.5(pid=1416): stderr: | 20221210001348501 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001348501 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001348501 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001348502 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001348502 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001348502 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001348502 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:13:50.247914 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1416): Process ended prematurely: osmo-stp_10.42.42.5(pid=1416) [trial-2366↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1416)] [trial-2366↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 00:13:50.257508 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 00:13:50.286605 run osmo-hlr_10.42.42.2(pid=1413): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1413)] 00:13:50.334288 run osmo-hlr_10.42.42.2(pid=1413): stdout: | (launched: 2022-12-10_00:13:47.314272) 00:13:50.383991 run osmo-hlr_10.42.42.2(pid=1413): stderr: | 20221210001347514 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210001347514 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210001347514 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210001347514 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210001347514 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210001347514 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210001347526 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210001347534 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210001347535 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210001347535 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:13:50.452998 run osmo-msc_10.42.42.6(pid=1419): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1419)] 00:13:50.501309 run osmo-msc_10.42.42.6(pid=1419): stdout: | (launched: 2022-12-10_00:13:49.326879) 00:13:50.550855 run osmo-msc_10.42.42.6(pid=1419): stderr: | 20221210001349649 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210001349649 DLGLOBAL DEBUG validating counter group 0x7f9a55076c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210001349649 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210001349649 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210001349650 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210001349650 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210001349651 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210001349652 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210001349652 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210001349652 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:13:50.600805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1412): Terminating (SIGTERM) 00:13:50.640310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1415): Terminating (SIGTERM) 00:13:50.680216 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1418): Terminating (SIGTERM) 00:13:50.720579 --- ParallelTerminationStrategy: PID 1412 died... 00:13:50.739609 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1412): Terminated: ok {rc=0} 00:13:50.784158 --- ParallelTerminationStrategy: PID 1415 died... 00:13:50.802761 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1415): Terminated: ok {rc=0} 00:13:50.847343 --- ParallelTerminationStrategy: PID 1418 died... 00:13:50.866067 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1418): Terminated: ok {rc=0} 00:13:50.951907 bus /sierra_3: Setting Powered False 00:13:52.051822 bus /sierra_3: Setting Powered False 00:13:53.166090 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 00:13:54.314864 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:13:54.327391 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 00:13:54.389651 tst mo_mt_call_osmux.py: using LAC 24653 00:13:54.507663 tst mo_mt_call_osmux.py: using RAC 173 00:13:54.626892 tst mo_mt_call_osmux.py: using CellId 24653 00:13:54.744682 tst mo_mt_call_osmux.py: using BVCI 24654 00:13:54.854674 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:13:54.865977 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:13:54.876918 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:13:54.887996 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:13:54.899124 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:13:54.910241 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:13:55.028532 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:13:55.147634 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:13:55.611344 run create_hlr_db(pid=1421): Launched 00:13:55.732490 bus /sierra_2: Setting Powered False 00:13:56.792133 run create_hlr_db(pid=1421): Terminated: ok {rc=0} 00:13:57.208510 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1423): Launched 00:13:57.506850 run osmo-hlr_10.42.42.2(pid=1424): Launched 00:13:57.618923 run osmo-stp_10.42.42.5: Starting osmo-stp 00:13:58.130095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1426): Launched 00:13:58.427377 run osmo-stp_10.42.42.5(pid=1427): Launched 00:13:58.540125 run osmo-msc_10.42.42.6: Starting osmo-msc 00:13:59.081364 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1429): Launched 00:13:59.381086 run osmo-msc_10.42.42.6(pid=1430): Launched 00:13:59.549263 run osmo-stp_10.42.42.5(pid=1427): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1427)] 00:13:59.675779 run osmo-stp_10.42.42.5(pid=1427): stdout: | (launched: 2022-12-10_00:13:58.372720) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:13:59.802377 run osmo-stp_10.42.42.5(pid=1427): stderr: | 20221210001358543 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001358543 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001358544 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001358544 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001358545 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001358545 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001358545 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:13:59.926067 run osmo-stp_10.42.42.5(pid=1427): stdout: | (launched: 2022-12-10_00:13:58.372720) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:14:00.044097 run osmo-stp_10.42.42.5(pid=1427): stderr: | 20221210001358543 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001358543 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001358544 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001358544 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001358545 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001358545 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001358545 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:14:00.186098 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1427): Process ended prematurely: osmo-stp_10.42.42.5(pid=1427) [trial-2366↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1427)] [trial-2366↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 00:14:00.194852 tst mo_mt_call_osmux.py:8: Test FAILED (5.9 sec) 00:14:00.221186 run osmo-hlr_10.42.42.2(pid=1424): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1424)] 00:14:00.267958 run osmo-hlr_10.42.42.2(pid=1424): stdout: | (launched: 2022-12-10_00:13:57.452190) 00:14:00.316657 run osmo-hlr_10.42.42.2(pid=1424): stderr: | 20221210001357627 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210001357627 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210001357627 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210001357627 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210001357627 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210001357627 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210001357643 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210001357652 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210001357652 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210001357652 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:14:00.384739 run osmo-msc_10.42.42.6(pid=1430): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1430)] 00:14:00.431471 run osmo-msc_10.42.42.6(pid=1430): stdout: | (launched: 2022-12-10_00:13:59.325888) 00:14:00.480205 run osmo-msc_10.42.42.6(pid=1430): stderr: | 20221210001359599 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210001359600 DLGLOBAL DEBUG validating counter group 0x7f34a6e48c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210001359600 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210001359600 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210001359600 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210001359600 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210001359602 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210001359602 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210001359603 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210001359603 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:14:00.530169 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1423): Terminating (SIGTERM) 00:14:00.569286 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1426): Terminating (SIGTERM) 00:14:00.608250 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1429): Terminating (SIGTERM) 00:14:00.647539 --- ParallelTerminationStrategy: PID 1423 died... 00:14:00.666404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1423): Terminated: ok {rc=0} 00:14:00.709741 --- ParallelTerminationStrategy: PID 1426 died... 00:14:00.727995 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1426): Terminated: ok {rc=0} 00:14:00.771460 --- ParallelTerminationStrategy: PID 1429 died... 00:14:00.789973 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1429): Terminated: ok {rc=0} 00:14:00.881502 bus /sierra_3: Setting Powered False 00:14:01.994127 bus /sierra_3: Setting Powered False 00:14:03.106918 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 emergency:nanobts+band-1900 --------------------------------------------------------------------- 00:14:04.347168 tst emergency:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:14:04.353577 tst emergency:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 00:14:04.378939 tst emergency:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 00:14:04.407648 tst emergency:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 00:14:04.494125 tst emergency:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 00:14:04.518877 tst emergency:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 00:14:04.547244 tst emergency:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 00:14:05.131315 tst emergency:nanobts+band-1900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2366 emergency:nanobts+band-1900 emergency_mo_mt_call.py ---------------------------------------------- 00:14:05.136868 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 00:14:05.148509 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 00:14:05.188316 tst emergency_mo_mt_call.py: using LAC 24654 00:14:05.315535 tst emergency_mo_mt_call.py: using RAC 174 00:14:05.439055 tst emergency_mo_mt_call.py: using CellId 24654 00:14:05.562583 tst emergency_mo_mt_call.py: using BVCI 24655 00:14:05.677376 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 00:14:05.688658 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 00:14:05.699948 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 00:14:05.711956 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 00:14:05.724060 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 00:14:05.735681 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 00:14:05.850316 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 00:14:05.967141 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:14:06.453030 run create_hlr_db(pid=1436): Launched 00:14:06.572489 bus /sierra_2: Setting Powered False 00:14:07.635813 run create_hlr_db(pid=1436): Terminated: ok {rc=0} 00:14:08.055925 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1438): Launched 00:14:08.348709 run osmo-hlr_10.42.42.2(pid=1439): Launched 00:14:08.460887 run osmo-stp_10.42.42.5: Starting osmo-stp 00:14:08.968164 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1441): Launched 00:14:09.260331 run osmo-stp_10.42.42.5(pid=1442): Launched 00:14:09.381888 tst emergency_mo_mt_call.py: using MSISDN 7446 00:14:09.531460 run osmo-msc_10.42.42.6: Starting osmo-msc 00:14:10.057702 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1444): Launched 00:14:10.350395 run osmo-msc_10.42.42.6(pid=1445): Launched 00:14:10.513402 run osmo-stp_10.42.42.5(pid=1442): ERR: Terminated: ERROR {rc=1} [trial-2366↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1442)] 00:14:10.636314 run osmo-stp_10.42.42.5(pid=1442): stdout: | (launched: 2022-12-10_00:14:09.206461) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:14:10.760192 run osmo-stp_10.42.42.5(pid=1442): stderr: | 20221210001409377 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001409377 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001409378 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001409378 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001409378 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001409379 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001409379 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:14:10.881930 run osmo-stp_10.42.42.5(pid=1442): stdout: | (launched: 2022-12-10_00:14:09.206461) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:14:10.998135 run osmo-stp_10.42.42.5(pid=1442): stderr: | 20221210001409377 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001409377 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001409378 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001409378 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001409378 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001409379 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001409379 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:14:11.137531 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=1442): Process ended prematurely: osmo-stp_10.42.42.5(pid=1442) [trial-2366↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1442)] [trial-2366↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19] 00:14:11.145922 tst emergency_mo_mt_call.py:19: Test FAILED (6.0 sec) 00:14:11.171806 run osmo-hlr_10.42.42.2(pid=1439): ERR: Terminated: ERROR {rc=237} [trial-2366↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1439)] 00:14:11.218832 run osmo-hlr_10.42.42.2(pid=1439): stdout: | (launched: 2022-12-10_00:14:08.294740) 00:14:11.267849 run osmo-hlr_10.42.42.2(pid=1439): stderr: | 20221210001408470 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210001408470 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210001408470 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210001408470 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210001408470 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210001408470 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210001408484 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/emergency:nanobts+band-1900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210001408492 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210001408492 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210001408492 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:14:11.336128 run osmo-msc_10.42.42.6(pid=1445): ERR: Terminated: ERROR {rc=2} [trial-2366↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1445)] 00:14:11.383025 run osmo-msc_10.42.42.6(pid=1445): stdout: | (launched: 2022-12-10_00:14:10.296605) 00:14:11.431701 run osmo-msc_10.42.42.6(pid=1445): stderr: | 20221210001410567 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210001410567 DLGLOBAL DEBUG validating counter group 0x7fce2e0efc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210001410567 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210001410567 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210001410567 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210001410568 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210001410570 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210001410570 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210001410570 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210001410570 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:14:11.480885 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1438): Terminating (SIGTERM) 00:14:11.520234 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1441): Terminating (SIGTERM) 00:14:11.560018 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1444): Terminating (SIGTERM) 00:14:11.599634 --- ParallelTerminationStrategy: PID 1438 died... 00:14:11.618561 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1438): Terminated: ok {rc=0} 00:14:11.662768 --- ParallelTerminationStrategy: PID 1441 died... 00:14:11.681657 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1441): Terminated: ok {rc=0} 00:14:11.725070 --- ParallelTerminationStrategy: PID 1444 died... 00:14:11.743555 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1444): Terminated: ok {rc=0} 00:14:11.827303 bus /sierra_3: Setting Powered False 00:14:12.922741 bus /sierra_3: Setting Powered False 00:14:14.036484 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 emergency:nanobts+band-1900 emergency_preemptive_call.py ---------------------------------------------- 00:14:15.124269 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 00:14:15.135648 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 00:14:15.176623 tst emergency_preemptive_call.py: using LAC 24655 00:14:15.293742 tst emergency_preemptive_call.py: using RAC 175 00:14:15.410659 tst emergency_preemptive_call.py: using CellId 24655 00:14:15.527410 tst emergency_preemptive_call.py: using BVCI 24656 00:14:15.633973 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 00:14:15.644775 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 00:14:15.655537 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 00:14:15.666199 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 00:14:15.676757 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 00:14:15.687350 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 00:14:15.805053 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 00:14:15.951105 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 00:14:16.078840 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 00:14:16.217493 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:14:16.763127 run create_hlr_db(pid=1447): Launched 00:14:16.916858 bus /sierra_2: Setting Powered False 00:14:17.974918 run create_hlr_db(pid=1447): Terminated: ok {rc=0} 00:14:18.384911 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1449): Launched 00:14:18.679621 run osmo-hlr_10.42.42.2(pid=1450): Launched 00:14:18.791281 run osmo-stp_10.42.42.5: Starting osmo-stp 00:14:19.311677 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1452): Launched 00:14:19.603668 run osmo-stp_10.42.42.5(pid=1453): Launched 00:14:19.725385 tst emergency_preemptive_call.py: using MSISDN 7447 00:14:19.874543 run osmo-msc_10.42.42.6: Starting osmo-msc 00:14:20.399483 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1455): Launched 00:14:20.692322 run osmo-msc_10.42.42.6(pid=1456): Launched 00:14:20.857206 run osmo-stp_10.42.42.5(pid=1453): ERR: Terminated: ERROR {rc=1} [trial-2366↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1453)] 00:14:20.981428 run osmo-stp_10.42.42.5(pid=1453): stdout: | (launched: 2022-12-10_00:14:19.549676) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:14:21.105516 run osmo-stp_10.42.42.5(pid=1453): stderr: | 20221210001419720 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001419720 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001419721 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001419721 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001419721 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001419721 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001419722 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:14:21.227132 run osmo-stp_10.42.42.5(pid=1453): stdout: | (launched: 2022-12-10_00:14:19.549676) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:14:21.343771 run osmo-stp_10.42.42.5(pid=1453): stderr: | 20221210001419720 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001419720 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001419721 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001419721 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001419721 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001419721 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001419722 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:14:21.483473 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=1453): Process ended prematurely: osmo-stp_10.42.42.5(pid=1453) [trial-2366↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1453)] [trial-2366↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32] 00:14:21.491707 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 00:14:21.517518 run osmo-hlr_10.42.42.2(pid=1450): ERR: Terminated: ERROR {rc=237} [trial-2366↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1450)] 00:14:21.564558 run osmo-hlr_10.42.42.2(pid=1450): stdout: | (launched: 2022-12-10_00:14:18.624781) 00:14:21.613794 run osmo-hlr_10.42.42.2(pid=1450): stderr: | 20221210001418802 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210001418802 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210001418802 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210001418802 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210001418802 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210001418802 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210001418816 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/emergency:nanobts+band-1900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210001418826 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210001418827 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210001418827 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:14:21.682435 run osmo-msc_10.42.42.6(pid=1456): ERR: Terminated: ERROR {rc=2} [trial-2366↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1456)] 00:14:21.729547 run osmo-msc_10.42.42.6(pid=1456): stdout: | (launched: 2022-12-10_00:14:20.637533) 00:14:21.778324 run osmo-msc_10.42.42.6(pid=1456): stderr: | 20221210001420909 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210001420909 DLGLOBAL DEBUG validating counter group 0x7fb282bc7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210001420909 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210001420909 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210001420910 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210001420910 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210001420912 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210001420912 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210001420912 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210001420912 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:14:21.827203 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1449): Terminating (SIGTERM) 00:14:21.865964 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1452): Terminating (SIGTERM) 00:14:21.905878 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1455): Terminating (SIGTERM) 00:14:21.945070 --- ParallelTerminationStrategy: PID 1449 died... 00:14:21.963677 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1449): Terminated: ok {rc=0} 00:14:22.007406 --- ParallelTerminationStrategy: PID 1452 died... 00:14:22.025950 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1452): Terminated: ok {rc=0} 00:14:22.069611 --- ParallelTerminationStrategy: PID 1455 died... 00:14:22.088111 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1455): Terminated: ok {rc=0} 00:14:22.170368 bus /sierra_9: Setting Powered False 00:14:23.267550 bus /sierra_9: Setting Powered False 00:14:24.382825 bus /sierra_8: Setting Powered False 00:14:25.478721 bus /sierra_8: Setting Powered False 00:14:26.592260 bus /sierra_3: Setting Powered False 00:14:27.693323 bus /sierra_3: Setting Powered False 00:14:28.809736 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 emergency:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 gprs:nanobts+band-1900 --------------------------------------------------------------------- 00:14:30.082004 tst gprs:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:14:30.088018 tst gprs:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 00:14:30.111575 tst gprs:nanobts+band-1900: Verifying 9 x ip_address (candidates: 9) 00:14:30.149759 tst gprs:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 00:14:30.238354 tst gprs:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 00:14:30.264191 tst gprs:nanobts+band-1900: Reserving 9 x ip_address (candidates: 9) 00:14:30.303776 tst gprs:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 00:14:30.918264 tst gprs:nanobts+band-1900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2366 gprs:nanobts+band-1900 cs_paging_gprs_active.py ---------------------------------------------- 00:14:30.976894 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:14:30.988926 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 00:14:31.032584 tst cs_paging_gprs_active.py: using LAC 24656 00:14:31.160509 tst cs_paging_gprs_active.py: using RAC 176 00:14:31.278721 tst cs_paging_gprs_active.py: using CellId 24656 00:14:31.397406 tst cs_paging_gprs_active.py: using BVCI 24657 00:14:31.507276 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:14:31.518725 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:14:31.529788 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:14:31.540901 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:14:31.552035 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:14:31.563375 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:14:31.574548 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:14:31.585872 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:14:31.597213 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 00:14:31.718415 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 00:14:31.854479 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 00:14:32.131723 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:14:32.458812 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1461): Launched 00:14:32.718774 run iperf3-srv_10.42.42.10(pid=1462): Launched 00:14:32.830344 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 00:14:33.041426 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:14:33.357853 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1463): Launched 00:14:33.636442 run iperf3-srv_10.42.42.10(pid=1464): Launched 00:14:33.757264 tst cs_paging_gprs_active.py:38: start network... 00:14:33.973226 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:14:34.468401 run create_hlr_db(pid=1465): Launched 00:14:34.589555 bus /sierra_2: Setting Powered False 00:14:35.652874 run create_hlr_db(pid=1465): Terminated: ok {rc=0} 00:14:36.081282 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1467): Launched 00:14:36.380119 run osmo-hlr_10.42.42.2(pid=1468): Launched 00:14:36.493735 run osmo-stp_10.42.42.5: Starting osmo-stp 00:14:37.018112 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1470): Launched 00:14:37.316765 run osmo-stp_10.42.42.5(pid=1471): Launched 00:14:37.430615 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:14:37.948094 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1473): Launched 00:14:38.062108 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:14:38.315002 run patchelf(pid=1474): Launched 00:14:38.480677 run osmo-stp_10.42.42.5(pid=1471): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1471)] 00:14:38.607165 run osmo-stp_10.42.42.5(pid=1471): stdout: | (launched: 2022-12-10_00:14:37.261804) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:14:38.735478 run osmo-stp_10.42.42.5(pid=1471): stderr: | 20221210001437433 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001437433 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001437433 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001437434 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001437434 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001437434 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001437434 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:14:38.864039 run osmo-stp_10.42.42.5(pid=1471): stdout: | (launched: 2022-12-10_00:14:37.261804) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:14:38.986185 run osmo-stp_10.42.42.5(pid=1471): stderr: | 20221210001437433 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001437433 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001437433 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001437434 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001437434 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001437434 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001437434 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:14:39.131211 run patchelf(pid=1474): Terminating (SIGINT) 00:14:39.299307 run patchelf(pid=1474): Terminated: ok {rc=0} 00:14:39.420563 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=1471): Process ended prematurely: osmo-stp_10.42.42.5(pid=1471) [trial-2366↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1471)] [trial-2366↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38] 00:14:39.430055 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 00:14:39.456716 run osmo-hlr_10.42.42.2(pid=1468): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1468)] 00:14:39.503626 run osmo-hlr_10.42.42.2(pid=1468): stdout: | (launched: 2022-12-10_00:14:36.325128) 00:14:39.552323 run osmo-hlr_10.42.42.2(pid=1468): stderr: | 20221210001436503 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210001436503 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210001436503 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210001436503 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210001436503 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210001436503 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210001436515 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:nanobts+band-1900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210001436524 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210001436524 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210001436524 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:14:39.601499 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1461): Terminating (SIGTERM) 00:14:39.640931 run iperf3-srv_10.42.42.10(pid=1462): Terminating (SIGTERM) 00:14:39.680247 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1463): Terminating (SIGTERM) 00:14:39.719655 run iperf3-srv_10.42.42.10(pid=1464): Terminating (SIGTERM) 00:14:39.759223 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1467): Terminating (SIGTERM) 00:14:39.798975 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1470): Terminating (SIGTERM) 00:14:39.838321 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1473): Terminating (SIGTERM) 00:14:39.877993 --- ParallelTerminationStrategy: PID 1461 died... 00:14:39.896904 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1461): Terminated: ok {rc=0} 00:14:39.940774 --- ParallelTerminationStrategy: PID 1462 died... 00:14:39.959412 run iperf3-srv_10.42.42.10(pid=1462): Terminated {rc=256} 00:14:40.002459 --- ParallelTerminationStrategy: PID 1463 died... 00:14:40.021098 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1463): Terminated: ok {rc=0} 00:14:40.065060 --- ParallelTerminationStrategy: PID 1464 died... 00:14:40.083549 run iperf3-srv_10.42.42.10(pid=1464): Terminated {rc=256} 00:14:40.127065 --- ParallelTerminationStrategy: PID 1467 died... 00:14:40.145607 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1467): Terminated: ok {rc=0} 00:14:40.189046 --- ParallelTerminationStrategy: PID 1470 died... 00:14:40.207514 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1470): Terminated: ok {rc=0} 00:14:40.250640 --- ParallelTerminationStrategy: PID 1473 died... 00:14:40.269227 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1473): Terminated: ok {rc=0} 00:14:40.350719 bus /gobi_0: Setting Powered False 00:14:41.444477 bus /gobi_0: Setting Powered False 00:14:42.558875 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:nanobts+band-1900 iperf3.py ---------------------------------------------- 00:14:43.703657 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:14:43.715091 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 00:14:43.753386 tst iperf3.py: using LAC 24657 00:14:43.870414 tst iperf3.py: using RAC 177 00:14:43.991683 tst iperf3.py: using CellId 24657 00:14:44.108388 tst iperf3.py: using BVCI 24658 00:14:44.216244 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:14:44.226868 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:14:44.237359 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:14:44.247762 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:14:44.258100 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:14:44.268408 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:14:44.278899 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:14:44.289348 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:14:44.299918 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 00:14:44.421469 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 00:14:44.636387 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:14:44.955750 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1475): Launched 00:14:45.232486 run iperf3-srv_10.42.42.10(pid=1476): Launched 00:14:45.351620 tst iperf3.py:8: start network... 00:14:45.566845 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:14:46.097814 run create_hlr_db(pid=1477): Launched 00:14:46.257266 bus /gobi_6: Setting Powered False 00:14:47.317666 run create_hlr_db(pid=1477): Terminated: ok {rc=0} 00:14:47.766348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1479): Launched 00:14:48.086380 run osmo-hlr_10.42.42.2(pid=1480): Launched 00:14:48.208279 run osmo-stp_10.42.42.5: Starting osmo-stp 00:14:48.760809 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1482): Launched 00:14:49.080455 run osmo-stp_10.42.42.5(pid=1483): Launched 00:14:49.202101 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:14:49.754136 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1485): Launched 00:14:49.876892 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:14:50.147437 run patchelf(pid=1486): Launched 00:14:50.324685 run osmo-stp_10.42.42.5(pid=1483): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1483)] 00:14:50.459606 run osmo-stp_10.42.42.5(pid=1483): stdout: | (launched: 2022-12-10_00:14:49.021076) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:14:50.596766 run osmo-stp_10.42.42.5(pid=1483): stderr: | 20221210001449212 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001449212 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001449212 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001449213 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001449213 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001449213 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001449213 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:14:50.734433 run osmo-stp_10.42.42.5(pid=1483): stdout: | (launched: 2022-12-10_00:14:49.021076) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:14:50.865140 run osmo-stp_10.42.42.5(pid=1483): stderr: | 20221210001449212 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001449212 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001449212 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001449213 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001449213 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001449213 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001449213 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:14:51.019863 run patchelf(pid=1486): Terminating (SIGINT) 00:14:51.199600 run patchelf(pid=1486): Terminated: ok {rc=0} 00:14:51.329232 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1483): Process ended prematurely: osmo-stp_10.42.42.5(pid=1483) [trial-2366↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1483)] [trial-2366↪gprs:nanobts+band-1900↪iperf3.py:8] 00:14:51.339456 tst iperf3.py:8: Test FAILED (7.7 sec) 00:14:51.368578 run osmo-hlr_10.42.42.2(pid=1480): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:nanobts+band-1900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1480)] 00:14:51.418739 run osmo-hlr_10.42.42.2(pid=1480): stdout: | (launched: 2022-12-10_00:14:48.028158) 00:14:51.470967 run osmo-hlr_10.42.42.2(pid=1480): stderr: | 20221210001448224 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210001448224 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210001448224 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210001448224 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210001448224 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210001448224 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210001448237 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:nanobts+band-1900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210001448245 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210001448245 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210001448245 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:14:51.523096 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1475): Terminating (SIGTERM) 00:14:51.565141 run iperf3-srv_10.42.42.10(pid=1476): Terminating (SIGTERM) 00:14:51.606958 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1479): Terminating (SIGTERM) 00:14:51.648753 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1482): Terminating (SIGTERM) 00:14:51.690627 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1485): Terminating (SIGTERM) 00:14:51.733166 --- ParallelTerminationStrategy: PID 1475 died... 00:14:51.753095 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1475): Terminated: ok {rc=0} 00:14:51.799647 --- ParallelTerminationStrategy: PID 1476 died... 00:14:51.819130 run iperf3-srv_10.42.42.10(pid=1476): Terminated {rc=256} 00:14:51.865456 --- ParallelTerminationStrategy: PID 1479 died... 00:14:51.884765 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1479): Terminated: ok {rc=0} 00:14:51.931210 --- ParallelTerminationStrategy: PID 1482 died... 00:14:51.950694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1482): Terminated: ok {rc=0} 00:14:51.997521 --- ParallelTerminationStrategy: PID 1485 died... 00:14:52.016992 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1485): Terminated: ok {rc=0} 00:14:52.105217 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:nanobts+band-1900 iperf3m4.py ---------------------------------------------- 00:14:53.257971 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:14:53.269552 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 00:14:53.307314 tst iperf3m4.py: using LAC 24658 00:14:53.433634 tst iperf3m4.py: using RAC 178 00:14:53.556272 tst iperf3m4.py: using CellId 24658 00:14:53.673027 tst iperf3m4.py: using BVCI 24659 00:14:53.781111 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:14:53.791724 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:14:53.802321 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:14:53.812742 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:14:53.823129 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:14:53.833504 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:14:53.844113 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:14:53.854419 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:14:53.864838 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 00:14:53.985554 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 00:14:54.107023 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 00:14:54.224326 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 00:14:54.343071 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 00:14:54.560519 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:14:54.883893 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1487): Launched 00:14:55.161586 run iperf3-srv_10.42.42.10(pid=1488): Launched 00:14:55.281887 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 00:14:55.497860 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:14:55.820719 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1489): Launched 00:14:56.098446 run iperf3-srv_10.42.42.10(pid=1490): Launched 00:14:56.218308 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 00:14:56.433700 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:14:56.755436 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1491): Launched 00:14:57.033954 run iperf3-srv_10.42.42.10(pid=1492): Launched 00:14:57.154159 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 00:14:57.369996 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:14:57.691973 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1493): Launched 00:14:57.970821 run iperf3-srv_10.42.42.10(pid=1494): Launched 00:14:58.090517 tst iperf3m4.py:8: start network... 00:14:58.306164 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:14:58.802307 run create_hlr_db(pid=1495): Launched 00:14:58.923044 bus /gobi_6: Setting Powered False 00:14:59.986607 run create_hlr_db(pid=1495): Terminated: ok {rc=0} 00:15:00.433203 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1497): Launched 00:15:00.754130 run osmo-hlr_10.42.42.2(pid=1498): Launched 00:15:00.913440 run osmo-stp_10.42.42.5: Starting osmo-stp 00:15:01.569294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1503): Launched 00:15:01.905971 run osmo-stp_10.42.42.5(pid=1504): Launched 00:15:02.273506 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:15:02.845775 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1506): Launched 00:15:02.969087 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:15:03.240841 run patchelf(pid=1507): Launched 00:15:03.420364 run osmo-stp_10.42.42.5(pid=1504): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1504)] 00:15:03.555676 run osmo-stp_10.42.42.5(pid=1504): stdout: | (launched: 2022-12-10_00:15:01.837395) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:15:03.693198 run osmo-stp_10.42.42.5(pid=1504): stderr: | 20221210001502157 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001502158 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001502158 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001502159 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001502161 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001502161 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001502161 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:15:03.831488 run osmo-stp_10.42.42.5(pid=1504): stdout: | (launched: 2022-12-10_00:15:01.837395) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:15:03.962796 run osmo-stp_10.42.42.5(pid=1504): stderr: | 20221210001502157 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001502158 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001502158 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001502159 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001502161 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001502161 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001502161 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:15:04.118154 run patchelf(pid=1507): Terminating (SIGINT) 00:15:04.298205 run patchelf(pid=1507): Terminated: ok {rc=0} 00:15:04.427941 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1504): Process ended prematurely: osmo-stp_10.42.42.5(pid=1504) [trial-2366↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1504)] [trial-2366↪gprs:nanobts+band-1900↪iperf3m4.py:8] 00:15:04.438227 tst iperf3m4.py:8: Test FAILED (11.2 sec) 00:15:04.467425 run osmo-hlr_10.42.42.2(pid=1498): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:nanobts+band-1900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1498)] 00:15:04.517486 run osmo-hlr_10.42.42.2(pid=1498): stdout: | (launched: 2022-12-10_00:15:00.694708) 00:15:04.569364 run osmo-hlr_10.42.42.2(pid=1498): stderr: | 20221210001500959 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210001500959 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210001500960 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210001500960 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210001500960 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210001500960 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210001500980 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:nanobts+band-1900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210001501003 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210001501003 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210001501003 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:15:04.621724 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1487): Terminating (SIGTERM) 00:15:04.663425 run iperf3-srv_10.42.42.10(pid=1488): Terminating (SIGTERM) 00:15:04.705234 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1489): Terminating (SIGTERM) 00:15:04.747345 run iperf3-srv_10.42.42.10(pid=1490): Terminating (SIGTERM) 00:15:04.789138 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1491): Terminating (SIGTERM) 00:15:04.831018 run iperf3-srv_10.42.42.10(pid=1492): Terminating (SIGTERM) 00:15:04.872658 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1493): Terminating (SIGTERM) 00:15:04.914501 run iperf3-srv_10.42.42.10(pid=1494): Terminating (SIGTERM) 00:15:04.956035 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1497): Terminating (SIGTERM) 00:15:04.997659 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1503): Terminating (SIGTERM) 00:15:05.039369 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1506): Terminating (SIGTERM) 00:15:05.081415 --- ParallelTerminationStrategy: PID 1487 died... 00:15:05.101360 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1487): Terminated: ok {rc=0} 00:15:05.147798 --- ParallelTerminationStrategy: PID 1488 died... 00:15:05.167355 run iperf3-srv_10.42.42.10(pid=1488): Terminated {rc=256} 00:15:05.213632 --- ParallelTerminationStrategy: PID 1489 died... 00:15:05.233084 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1489): Terminated: ok {rc=0} 00:15:05.279367 --- ParallelTerminationStrategy: PID 1490 died... 00:15:05.298788 run iperf3-srv_10.42.42.10(pid=1490): Terminated {rc=256} 00:15:05.344909 --- ParallelTerminationStrategy: PID 1491 died... 00:15:05.364394 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1491): Terminated: ok {rc=0} 00:15:05.410471 --- ParallelTerminationStrategy: PID 1492 died... 00:15:05.429981 run iperf3-srv_10.42.42.10(pid=1492): Terminated {rc=256} 00:15:05.476042 --- ParallelTerminationStrategy: PID 1493 died... 00:15:05.495545 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1493): Terminated: ok {rc=0} 00:15:05.541927 --- ParallelTerminationStrategy: PID 1494 died... 00:15:05.561443 run iperf3-srv_10.42.42.10(pid=1494): Terminated {rc=256} 00:15:05.607706 --- ParallelTerminationStrategy: PID 1497 died... 00:15:05.627256 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1497): Terminated: ok {rc=0} 00:15:05.673654 --- ParallelTerminationStrategy: PID 1503 died... 00:15:05.693148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1503): Terminated: ok {rc=0} 00:15:05.739575 --- ParallelTerminationStrategy: PID 1506 died... 00:15:05.759111 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1506): Terminated: ok {rc=0} 00:15:05.846938 bus /gobi_4: Setting Powered False 00:15:06.945836 bus /gobi_4: Setting Powered False 00:15:08.062048 bus /gobi_1: Setting Powered False 00:15:09.159526 bus /gobi_1: Setting Powered False 00:15:10.274599 bus /gobi_0: Setting Powered False 00:15:11.371837 bus /gobi_0: Setting Powered False 00:15:12.489487 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:nanobts+band-1900 ping.py ---------------------------------------------- 00:15:13.591769 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:13.603008 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 00:15:13.646072 tst ping.py: using LAC 24659 00:15:13.761969 tst ping.py: using RAC 179 00:15:13.875050 tst ping.py: using CellId 24659 00:15:13.989164 tst ping.py: using BVCI 24660 00:15:14.096193 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:14.106984 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:14.117645 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:14.128177 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:14.138683 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:14.149182 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:14.159742 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:14.170372 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 00:15:14.287044 tst ping.py:19: start network... 00:15:14.499652 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:15:14.988433 run create_hlr_db(pid=1508): Launched 00:15:15.109479 bus /gobi_6: Setting Powered False 00:15:16.178585 run create_hlr_db(pid=1508): Terminated: ok {rc=0} 00:15:16.686032 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1510): Launched 00:15:17.010036 run osmo-hlr_10.42.42.2(pid=1511): Launched 00:15:17.205754 run osmo-stp_10.42.42.5: Starting osmo-stp 00:15:17.750185 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1513): Launched 00:15:18.065768 run osmo-stp_10.42.42.5(pid=1514): Launched 00:15:18.186974 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:15:18.733556 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1516): Launched 00:15:18.854826 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:15:19.122584 run patchelf(pid=1517): Launched 00:15:19.298504 run osmo-stp_10.42.42.5(pid=1514): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1514)] 00:15:19.432555 run osmo-stp_10.42.42.5(pid=1514): stdout: | (launched: 2022-12-10_00:15:18.007774) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:15:19.568707 run osmo-stp_10.42.42.5(pid=1514): stderr: | 20221210001518201 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001518201 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001518201 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001518202 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001518202 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001518202 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001518202 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:15:19.705057 run osmo-stp_10.42.42.5(pid=1514): stdout: | (launched: 2022-12-10_00:15:18.007774) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:15:19.835865 run osmo-stp_10.42.42.5(pid=1514): stderr: | 20221210001518201 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001518201 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001518201 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001518202 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001518202 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001518202 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001518202 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:15:19.989528 run patchelf(pid=1517): Terminating (SIGINT) 00:15:20.167392 run patchelf(pid=1517): Terminated: ok {rc=0} 00:15:20.295392 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=1514): Process ended prematurely: osmo-stp_10.42.42.5(pid=1514) [trial-2366↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1514)] [trial-2366↪gprs:nanobts+band-1900↪ping.py:22] 00:15:20.304664 tst ping.py:22: Test FAILED (6.7 sec) 00:15:20.333603 run osmo-hlr_10.42.42.2(pid=1511): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:nanobts+band-1900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1511)] 00:15:20.384790 run osmo-hlr_10.42.42.2(pid=1511): stdout: | (launched: 2022-12-10_00:15:16.950881) 00:15:20.436916 run osmo-hlr_10.42.42.2(pid=1511): stderr: | 20221210001517212 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210001517212 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210001517212 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210001517212 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210001517212 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210001517212 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210001517224 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:nanobts+band-1900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210001517233 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210001517233 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210001517233 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:15:20.489458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1510): Terminating (SIGTERM) 00:15:20.531844 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1513): Terminating (SIGTERM) 00:15:20.574089 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1516): Terminating (SIGTERM) 00:15:20.616690 --- ParallelTerminationStrategy: PID 1510 died... 00:15:20.636863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1510): Terminated: ok {rc=0} 00:15:20.683653 --- ParallelTerminationStrategy: PID 1513 died... 00:15:20.703265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1513): Terminated: ok {rc=0} 00:15:20.750180 --- ParallelTerminationStrategy: PID 1516 died... 00:15:20.769683 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1516): Terminated: ok {rc=0} 00:15:20.857548 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:nanobts+band-1900 ping_idle_ping.py ---------------------------------------------- 00:15:21.943001 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:21.954285 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 00:15:21.993384 tst ping_idle_ping.py: using LAC 24660 00:15:22.111252 tst ping_idle_ping.py: using RAC 180 00:15:22.237476 tst ping_idle_ping.py: using CellId 24660 00:15:22.355407 tst ping_idle_ping.py: using BVCI 24661 00:15:22.464928 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:22.475605 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:22.486134 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:22.496761 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:22.507448 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:22.518154 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:22.528750 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 00:15:22.539296 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 00:15:22.655416 tst ping_idle_ping.py:24: start network... 00:15:22.869438 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:15:23.361536 run create_hlr_db(pid=1518): Launched 00:15:23.482404 bus /gobi_6: Setting Powered False 00:15:24.545547 run create_hlr_db(pid=1518): Terminated: ok {rc=0} 00:15:24.968368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1520): Launched 00:15:25.263624 run osmo-hlr_10.42.42.2(pid=1521): Launched 00:15:25.376471 run osmo-stp_10.42.42.5: Starting osmo-stp 00:15:25.897934 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1523): Launched 00:15:26.193538 run osmo-stp_10.42.42.5(pid=1524): Launched 00:15:26.306081 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:15:26.816889 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1526): Launched 00:15:26.929891 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:15:27.179616 run patchelf(pid=1527): Launched 00:15:27.343223 run osmo-stp_10.42.42.5(pid=1524): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1524)] 00:15:27.468436 run osmo-stp_10.42.42.5(pid=1524): stdout: | (launched: 2022-12-10_00:15:26.139068) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:15:27.596517 run osmo-stp_10.42.42.5(pid=1524): stderr: | 20221210001526307 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001526308 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001526308 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001526309 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001526311 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001526311 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001526311 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:15:27.723741 run osmo-stp_10.42.42.5(pid=1524): stdout: | (launched: 2022-12-10_00:15:26.139068) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:15:27.845108 run osmo-stp_10.42.42.5(pid=1524): stderr: | 20221210001526307 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001526308 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001526308 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001526309 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001526311 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001526311 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001526311 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:15:27.988230 run patchelf(pid=1527): Terminating (SIGINT) 00:15:28.154386 run patchelf(pid=1527): Terminated: ok {rc=0} 00:15:28.274045 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=1524): Process ended prematurely: osmo-stp_10.42.42.5(pid=1524) [trial-2366↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1524)] [trial-2366↪gprs:nanobts+band-1900↪ping_idle_ping.py:27] 00:15:28.282852 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 00:15:28.309640 run osmo-hlr_10.42.42.2(pid=1521): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:nanobts+band-1900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1521)] 00:15:28.357193 run osmo-hlr_10.42.42.2(pid=1521): stdout: | (launched: 2022-12-10_00:15:25.209374) 00:15:28.406281 run osmo-hlr_10.42.42.2(pid=1521): stderr: | 20221210001525384 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210001525384 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210001525384 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210001525384 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210001525385 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210001525385 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210001525396 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:nanobts+band-1900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210001525406 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210001525406 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210001525406 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:15:28.456207 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1520): Terminating (SIGTERM) 00:15:28.496124 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1523): Terminating (SIGTERM) 00:15:28.535721 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1526): Terminating (SIGTERM) 00:15:28.575495 --- ParallelTerminationStrategy: PID 1520 died... 00:15:28.594657 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1520): Terminated: ok {rc=0} 00:15:28.638507 --- ParallelTerminationStrategy: PID 1523 died... 00:15:28.657189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1523): Terminated: ok {rc=0} 00:15:28.701324 --- ParallelTerminationStrategy: PID 1526 died... 00:15:28.720316 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1526): Terminated: ok {rc=0} 00:15:28.803453 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2366 gprs:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 gprs:nanobts+band-1900+mod-bts0-egprs --------------------------------------------------------------------- 00:15:30.102620 tst gprs:nanobts+band-1900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:15:30.109694 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 00:15:30.137082 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 00:15:30.177084 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 00:15:30.265537 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 00:15:30.290100 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 00:15:30.330888 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 00:15:30.937494 tst gprs:nanobts+band-1900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2366 gprs:nanobts+band-1900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 00:15:30.995514 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:15:31.011819 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:15:31.055506 tst cs_paging_gprs_active.py: using LAC 24661 00:15:31.181456 tst cs_paging_gprs_active.py: using RAC 181 00:15:31.316199 tst cs_paging_gprs_active.py: using CellId 24661 00:15:31.443512 tst cs_paging_gprs_active.py: using BVCI 24662 00:15:31.556798 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:15:31.568804 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:15:31.582697 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:15:31.595311 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:15:31.607378 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:15:31.619680 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:15:31.632304 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:15:31.644670 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:15:31.657303 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:15:31.777954 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:15:31.903344 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 00:15:32.193854 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:15:32.526401 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1532): Launched 00:15:32.806006 run iperf3-srv_10.42.42.10(pid=1533): Launched 00:15:32.925904 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 00:15:33.142363 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:15:33.463918 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1534): Launched 00:15:33.742212 run iperf3-srv_10.42.42.10(pid=1535): Launched 00:15:33.862652 tst cs_paging_gprs_active.py:38: start network... 00:15:34.079290 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:15:34.576684 run create_hlr_db(pid=1536): Launched 00:15:34.698403 bus /gobi_6: Setting Powered False 00:15:35.762412 run create_hlr_db(pid=1536): Terminated: ok {rc=0} 00:15:36.210323 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1538): Launched 00:15:36.530327 run osmo-hlr_10.42.42.2(pid=1539): Launched 00:15:36.652434 run osmo-stp_10.42.42.5: Starting osmo-stp 00:15:37.206717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1541): Launched 00:15:37.527313 run osmo-stp_10.42.42.5(pid=1542): Launched 00:15:37.650110 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:15:38.204400 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1547): Launched 00:15:38.327182 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:15:38.598545 run patchelf(pid=1548): Launched 00:15:38.777158 run osmo-stp_10.42.42.5(pid=1542): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1542)] 00:15:38.913154 run osmo-stp_10.42.42.5(pid=1542): stdout: | (launched: 2022-12-10_00:15:37.468736) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:15:39.051099 run osmo-stp_10.42.42.5(pid=1542): stderr: | 20221210001537661 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001537661 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001537661 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001537662 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001537662 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001537662 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001537663 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:15:39.189359 run osmo-stp_10.42.42.5(pid=1542): stdout: | (launched: 2022-12-10_00:15:37.468736) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:15:39.321184 run osmo-stp_10.42.42.5(pid=1542): stderr: | 20221210001537661 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001537661 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001537661 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001537662 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001537662 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001537662 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001537663 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:15:39.477543 run patchelf(pid=1548): Terminating (SIGINT) 00:15:39.656940 run patchelf(pid=1548): Terminated: ok {rc=0} 00:15:39.787378 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=1542): Process ended prematurely: osmo-stp_10.42.42.5(pid=1542) [trial-2366↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1542)] [trial-2366↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 00:15:39.797591 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 00:15:39.826675 run osmo-hlr_10.42.42.2(pid=1539): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1539)] 00:15:39.876813 run osmo-hlr_10.42.42.2(pid=1539): stdout: | (launched: 2022-12-10_00:15:36.472092) 00:15:39.928786 run osmo-hlr_10.42.42.2(pid=1539): stderr: | 20221210001536671 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210001536671 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210001536671 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210001536671 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210001536671 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210001536671 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210001536685 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:nanobts+band-1900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210001536693 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210001536693 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210001536693 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:15:39.981474 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1532): Terminating (SIGTERM) 00:15:40.023529 run iperf3-srv_10.42.42.10(pid=1533): Terminating (SIGTERM) 00:15:40.065399 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1534): Terminating (SIGTERM) 00:15:40.107630 run iperf3-srv_10.42.42.10(pid=1535): Terminating (SIGTERM) 00:15:40.149512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1538): Terminating (SIGTERM) 00:15:40.191449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1541): Terminating (SIGTERM) 00:15:40.233355 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1547): Terminating (SIGTERM) 00:15:40.275543 --- ParallelTerminationStrategy: PID 1532 died... 00:15:40.295258 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1532): Terminated: ok {rc=0} 00:15:40.341984 --- ParallelTerminationStrategy: PID 1533 died... 00:15:40.361485 run iperf3-srv_10.42.42.10(pid=1533): Terminated {rc=256} 00:15:40.407611 --- ParallelTerminationStrategy: PID 1534 died... 00:15:40.427182 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1534): Terminated: ok {rc=0} 00:15:40.473526 --- ParallelTerminationStrategy: PID 1535 died... 00:15:40.493126 run iperf3-srv_10.42.42.10(pid=1535): Terminated {rc=256} 00:15:40.539232 --- ParallelTerminationStrategy: PID 1538 died... 00:15:40.558701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1538): Terminated: ok {rc=0} 00:15:40.605160 --- ParallelTerminationStrategy: PID 1541 died... 00:15:40.624563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1541): Terminated: ok {rc=0} 00:15:40.670974 --- ParallelTerminationStrategy: PID 1547 died... 00:15:40.690554 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1547): Terminated: ok {rc=0} 00:15:40.778501 bus /gobi_0: Setting Powered False 00:15:41.878302 bus /gobi_0: Setting Powered False 00:15:42.994595 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:nanobts+band-1900+mod-bts0-egprs iperf3.py ---------------------------------------------- 00:15:44.143762 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:15:44.155884 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:15:44.199102 tst iperf3.py: using LAC 24662 00:15:44.326265 tst iperf3.py: using RAC 182 00:15:44.455392 tst iperf3.py: using CellId 24662 00:15:44.580607 tst iperf3.py: using BVCI 24663 00:15:44.697110 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:15:44.708458 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:15:44.719612 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:15:44.731007 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:15:44.742414 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:15:44.753784 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:15:44.765813 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:15:44.777107 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:15:44.788577 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:15:44.904639 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 00:15:45.105774 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:15:45.406135 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1549): Launched 00:15:45.666879 run iperf3-srv_10.42.42.10(pid=1550): Launched 00:15:45.778769 tst iperf3.py:8: start network... 00:15:46.018724 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:15:46.511051 run create_hlr_db(pid=1551): Launched 00:15:46.658255 bus /gobi_6: Setting Powered False 00:15:47.718529 run create_hlr_db(pid=1551): Terminated: ok {rc=0} 00:15:48.156075 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1553): Launched 00:15:48.477305 run osmo-hlr_10.42.42.2(pid=1554): Launched 00:15:48.599779 run osmo-stp_10.42.42.5: Starting osmo-stp 00:15:49.157111 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1556): Launched 00:15:49.477565 run osmo-stp_10.42.42.5(pid=1557): Launched 00:15:49.600792 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:15:50.156739 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1559): Launched 00:15:50.279460 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:15:50.551340 run patchelf(pid=1560): Launched 00:15:50.729546 run osmo-stp_10.42.42.5(pid=1557): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1557)] 00:15:50.865667 run osmo-stp_10.42.42.5(pid=1557): stdout: | (launched: 2022-12-10_00:15:49.419294) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:15:51.003587 run osmo-stp_10.42.42.5(pid=1557): stderr: | 20221210001549613 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001549613 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001549613 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001549613 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001549614 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001549614 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001549614 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:15:51.141607 run osmo-stp_10.42.42.5(pid=1557): stdout: | (launched: 2022-12-10_00:15:49.419294) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:15:51.272906 run osmo-stp_10.42.42.5(pid=1557): stderr: | 20221210001549613 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001549613 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001549613 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001549613 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001549614 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001549614 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001549614 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:15:51.428818 run patchelf(pid=1560): Terminating (SIGINT) 00:15:51.609472 run patchelf(pid=1560): Terminated: ok {rc=0} 00:15:51.739028 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1557): Process ended prematurely: osmo-stp_10.42.42.5(pid=1557) [trial-2366↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1557)] [trial-2366↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8] 00:15:51.749341 tst iperf3.py:8: Test FAILED (7.6 sec) 00:15:51.778914 run osmo-hlr_10.42.42.2(pid=1554): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1554)] 00:15:51.829322 run osmo-hlr_10.42.42.2(pid=1554): stdout: | (launched: 2022-12-10_00:15:48.418881) 00:15:51.881469 run osmo-hlr_10.42.42.2(pid=1554): stderr: | 20221210001548619 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210001548619 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210001548619 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210001548619 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210001548619 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210001548619 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210001548635 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210001548645 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210001548645 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210001548645 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:15:51.933894 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1549): Terminating (SIGTERM) 00:15:51.976054 run iperf3-srv_10.42.42.10(pid=1550): Terminating (SIGTERM) 00:15:52.018088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1553): Terminating (SIGTERM) 00:15:52.060229 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1556): Terminating (SIGTERM) 00:15:52.102447 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1559): Terminating (SIGTERM) 00:15:52.144633 --- ParallelTerminationStrategy: PID 1549 died... 00:15:52.164654 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1549): Terminated: ok {rc=0} 00:15:52.211299 --- ParallelTerminationStrategy: PID 1550 died... 00:15:52.230769 run iperf3-srv_10.42.42.10(pid=1550): Terminated {rc=256} 00:15:52.277214 --- ParallelTerminationStrategy: PID 1553 died... 00:15:52.297063 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1553): Terminated: ok {rc=0} 00:15:52.343908 --- ParallelTerminationStrategy: PID 1556 died... 00:15:52.363637 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1556): Terminated: ok {rc=0} 00:15:52.409983 --- ParallelTerminationStrategy: PID 1559 died... 00:15:52.429484 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1559): Terminated: ok {rc=0} 00:15:52.516795 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:nanobts+band-1900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 00:15:53.666901 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:15:53.679267 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:15:53.720535 tst iperf3m4.py: using LAC 24663 00:15:53.848041 tst iperf3m4.py: using RAC 183 00:15:53.973376 tst iperf3m4.py: using CellId 24663 00:15:54.099660 tst iperf3m4.py: using BVCI 24664 00:15:54.218038 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:15:54.229535 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:15:54.240682 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:15:54.252130 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:15:54.263560 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:15:54.274954 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:15:54.286590 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:15:54.298079 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:15:54.309827 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:15:54.427029 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:15:54.549308 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:15:54.672692 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:15:54.794634 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 00:15:54.997286 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:15:55.299648 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1561): Launched 00:15:55.561640 run iperf3-srv_10.42.42.10(pid=1562): Launched 00:15:55.674608 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 00:15:55.876805 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:15:56.179364 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1563): Launched 00:15:56.441016 run iperf3-srv_10.42.42.10(pid=1564): Launched 00:15:56.553099 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 00:15:56.754288 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:15:57.055802 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1565): Launched 00:15:57.316833 run iperf3-srv_10.42.42.10(pid=1566): Launched 00:15:57.428394 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 00:15:57.629149 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:15:57.929819 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1567): Launched 00:15:58.190171 run iperf3-srv_10.42.42.10(pid=1568): Launched 00:15:58.302449 tst iperf3m4.py:8: start network... 00:15:58.503567 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:15:58.967035 run create_hlr_db(pid=1569): Launched 00:15:59.092727 bus /gobi_6: Setting Powered False 00:16:00.156856 run create_hlr_db(pid=1569): Terminated: ok {rc=0} 00:16:00.587283 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1571): Launched 00:16:00.897817 run osmo-hlr_10.42.42.2(pid=1572): Launched 00:16:01.158113 run osmo-stp_10.42.42.5: Starting osmo-stp 00:16:01.841786 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1574): Launched 00:16:02.187569 run osmo-stp_10.42.42.5(pid=1575): Launched 00:16:02.371357 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:16:02.999967 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1577): Launched 00:16:03.122895 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:16:03.394676 run patchelf(pid=1578): Launched 00:16:03.572474 run osmo-stp_10.42.42.5(pid=1575): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1575)] 00:16:03.707834 run osmo-stp_10.42.42.5(pid=1575): stdout: | (launched: 2022-12-10_00:16:02.129941) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:16:03.846071 run osmo-stp_10.42.42.5(pid=1575): stderr: | 20221210001602463 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001602463 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001602463 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001602464 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001602464 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001602464 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001602464 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:16:03.983545 run osmo-stp_10.42.42.5(pid=1575): stdout: | (launched: 2022-12-10_00:16:02.129941) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:16:04.114893 run osmo-stp_10.42.42.5(pid=1575): stderr: | 20221210001602463 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001602463 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001602463 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001602464 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001602464 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001602464 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001602464 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:16:04.270192 run patchelf(pid=1578): Terminating (SIGINT) 00:16:04.450957 run patchelf(pid=1578): Terminated: ok {rc=0} 00:16:04.581102 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1575): Process ended prematurely: osmo-stp_10.42.42.5(pid=1575) [trial-2366↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1575)] [trial-2366↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8] 00:16:04.591230 tst iperf3m4.py:8: Test FAILED (11.0 sec) 00:16:04.620475 run osmo-hlr_10.42.42.2(pid=1572): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1572)] 00:16:04.670426 run osmo-hlr_10.42.42.2(pid=1572): stdout: | (launched: 2022-12-10_00:16:00.837464) 00:16:04.722056 run osmo-hlr_10.42.42.2(pid=1572): stderr: | 20221210001601135 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210001601135 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210001601135 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210001601135 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210001601135 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210001601135 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210001601154 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210001601175 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210001601175 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210001601175 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:16:04.774283 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1561): Terminating (SIGTERM) 00:16:04.816100 run iperf3-srv_10.42.42.10(pid=1562): Terminating (SIGTERM) 00:16:04.857873 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1563): Terminating (SIGTERM) 00:16:04.899544 run iperf3-srv_10.42.42.10(pid=1564): Terminating (SIGTERM) 00:16:04.942490 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1565): Terminating (SIGTERM) 00:16:04.984365 run iperf3-srv_10.42.42.10(pid=1566): Terminating (SIGTERM) 00:16:05.025811 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1567): Terminating (SIGTERM) 00:16:05.067295 run iperf3-srv_10.42.42.10(pid=1568): Terminating (SIGTERM) 00:16:05.108656 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1571): Terminating (SIGTERM) 00:16:05.150304 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1574): Terminating (SIGTERM) 00:16:05.191756 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1577): Terminating (SIGTERM) 00:16:05.233582 --- ParallelTerminationStrategy: PID 1561 died... 00:16:05.253502 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1561): Terminated: ok {rc=0} 00:16:05.299913 --- ParallelTerminationStrategy: PID 1562 died... 00:16:05.319306 run iperf3-srv_10.42.42.10(pid=1562): Terminated {rc=256} 00:16:05.365255 --- ParallelTerminationStrategy: PID 1563 died... 00:16:05.384525 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1563): Terminated: ok {rc=0} 00:16:05.430594 --- ParallelTerminationStrategy: PID 1564 died... 00:16:05.449925 run iperf3-srv_10.42.42.10(pid=1564): Terminated {rc=256} 00:16:05.495981 --- ParallelTerminationStrategy: PID 1565 died... 00:16:05.515403 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1565): Terminated: ok {rc=0} 00:16:05.561927 --- ParallelTerminationStrategy: PID 1566 died... 00:16:05.581259 run iperf3-srv_10.42.42.10(pid=1566): Terminated {rc=256} 00:16:05.627451 --- ParallelTerminationStrategy: PID 1567 died... 00:16:05.646816 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1567): Terminated: ok {rc=0} 00:16:05.692909 --- ParallelTerminationStrategy: PID 1568 died... 00:16:05.712204 run iperf3-srv_10.42.42.10(pid=1568): Terminated {rc=256} 00:16:05.758313 --- ParallelTerminationStrategy: PID 1571 died... 00:16:05.778051 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1571): Terminated: ok {rc=0} 00:16:05.824329 --- ParallelTerminationStrategy: PID 1574 died... 00:16:05.843873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1574): Terminated: ok {rc=0} 00:16:05.890046 --- ParallelTerminationStrategy: PID 1577 died... 00:16:05.909504 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1577): Terminated: ok {rc=0} 00:16:05.997096 bus /gobi_4: Setting Powered False 00:16:07.095456 bus /gobi_4: Setting Powered False 00:16:08.211848 bus /gobi_1: Setting Powered False 00:16:09.309933 bus /gobi_1: Setting Powered False 00:16:10.423514 bus /gobi_0: Setting Powered False 00:16:11.521406 bus /gobi_0: Setting Powered False 00:16:12.638831 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:nanobts+band-1900+mod-bts0-egprs ping.py ---------------------------------------------- 00:16:13.742257 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:13.754255 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:16:13.797560 tst ping.py: using LAC 24664 00:16:13.923188 tst ping.py: using RAC 184 00:16:14.046611 tst ping.py: using CellId 24664 00:16:14.170106 tst ping.py: using BVCI 24665 00:16:14.286275 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:14.297689 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:14.308918 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:14.320478 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:14.331909 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:14.343339 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:14.354886 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:14.366280 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:16:14.484366 tst ping.py:19: start network... 00:16:14.697235 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:16:15.183518 run create_hlr_db(pid=1579): Launched 00:16:15.302245 bus /gobi_6: Setting Powered False 00:16:16.378736 run create_hlr_db(pid=1579): Terminated: ok {rc=0} 00:16:16.911233 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1581): Launched 00:16:17.289798 run osmo-hlr_10.42.42.2(pid=1582): Launched 00:16:17.401598 run osmo-stp_10.42.42.5: Starting osmo-stp 00:16:17.928309 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1584): Launched 00:16:18.220864 run osmo-stp_10.42.42.5(pid=1585): Launched 00:16:18.332411 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:16:18.841562 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1587): Launched 00:16:18.954369 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:16:19.203585 run patchelf(pid=1588): Launched 00:16:19.367058 run osmo-stp_10.42.42.5(pid=1585): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1585)] 00:16:19.491158 run osmo-stp_10.42.42.5(pid=1585): stdout: | (launched: 2022-12-10_00:16:18.166913) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:16:19.617253 run osmo-stp_10.42.42.5(pid=1585): stderr: | 20221210001618335 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001618335 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001618335 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001618336 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001618338 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001618338 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001618338 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:16:19.743487 run osmo-stp_10.42.42.5(pid=1585): stdout: | (launched: 2022-12-10_00:16:18.166913) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:16:19.864044 run osmo-stp_10.42.42.5(pid=1585): stderr: | 20221210001618335 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001618335 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001618335 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001618336 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001618338 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001618338 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001618338 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:16:20.006460 run patchelf(pid=1588): Terminating (SIGINT) 00:16:20.171200 run patchelf(pid=1588): Terminated: ok {rc=0} 00:16:20.290055 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=1585): Process ended prematurely: osmo-stp_10.42.42.5(pid=1585) [trial-2366↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1585)] [trial-2366↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22] 00:16:20.298886 tst ping.py:22: Test FAILED (6.5 sec) 00:16:20.325583 run osmo-hlr_10.42.42.2(pid=1582): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1582)] 00:16:20.373156 run osmo-hlr_10.42.42.2(pid=1582): stdout: | (launched: 2022-12-10_00:16:17.232119) 00:16:20.422758 run osmo-hlr_10.42.42.2(pid=1582): stderr: | 20221210001617411 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210001617411 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210001617411 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210001617412 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210001617412 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210001617412 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210001617424 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:nanobts+band-1900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210001617433 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210001617433 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210001617433 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:16:20.472391 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1581): Terminating (SIGTERM) 00:16:20.511995 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1584): Terminating (SIGTERM) 00:16:20.551444 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1587): Terminating (SIGTERM) 00:16:20.591378 --- ParallelTerminationStrategy: PID 1581 died... 00:16:20.610506 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1581): Terminated: ok {rc=0} 00:16:20.654120 --- ParallelTerminationStrategy: PID 1584 died... 00:16:20.672648 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1584): Terminated: ok {rc=0} 00:16:20.716107 --- ParallelTerminationStrategy: PID 1587 died... 00:16:20.734582 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1587): Terminated: ok {rc=0} 00:16:20.816910 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:nanobts+band-1900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 00:16:21.903625 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:21.916113 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:16:21.959177 tst ping_idle_ping.py: using LAC 24665 00:16:22.085512 tst ping_idle_ping.py: using RAC 185 00:16:22.202217 tst ping_idle_ping.py: using CellId 24665 00:16:22.319841 tst ping_idle_ping.py: using BVCI 24666 00:16:22.426993 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:22.438047 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:22.448734 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:22.459506 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:22.470218 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:22.480812 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:22.491698 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:16:22.502434 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:16:22.619979 tst ping_idle_ping.py:24: start network... 00:16:22.833355 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:16:23.328517 run create_hlr_db(pid=1589): Launched 00:16:23.449901 bus /gobi_6: Setting Powered False 00:16:24.513267 run create_hlr_db(pid=1589): Terminated: ok {rc=0} 00:16:24.954997 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1591): Launched 00:16:25.270375 run osmo-hlr_10.42.42.2(pid=1592): Launched 00:16:25.391665 run osmo-stp_10.42.42.5: Starting osmo-stp 00:16:25.934029 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1594): Launched 00:16:26.247786 run osmo-stp_10.42.42.5(pid=1595): Launched 00:16:26.367815 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:16:26.913240 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1597): Launched 00:16:27.033872 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:16:27.300481 run patchelf(pid=1598): Launched 00:16:27.476003 run osmo-stp_10.42.42.5(pid=1595): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1595)] 00:16:27.609639 run osmo-stp_10.42.42.5(pid=1595): stdout: | (launched: 2022-12-10_00:16:26.190560) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:16:27.745411 run osmo-stp_10.42.42.5(pid=1595): stderr: | 20221210001626380 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001626381 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001626381 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001626381 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001626382 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001626382 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001626382 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:16:27.881565 run osmo-stp_10.42.42.5(pid=1595): stdout: | (launched: 2022-12-10_00:16:26.190560) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:16:28.011161 run osmo-stp_10.42.42.5(pid=1595): stderr: | 20221210001626380 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001626381 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001626381 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001626381 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001626382 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001626382 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001626382 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:16:28.164518 run patchelf(pid=1598): Terminating (SIGINT) 00:16:28.341765 run patchelf(pid=1598): Terminated: ok {rc=0} 00:16:28.469442 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=1595): Process ended prematurely: osmo-stp_10.42.42.5(pid=1595) [trial-2366↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1595)] [trial-2366↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27] 00:16:28.478892 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 00:16:28.507337 run osmo-hlr_10.42.42.2(pid=1592): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1592)] 00:16:28.557478 run osmo-hlr_10.42.42.2(pid=1592): stdout: | (launched: 2022-12-10_00:16:25.212745) 00:16:28.609209 run osmo-hlr_10.42.42.2(pid=1592): stderr: | 20221210001625409 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210001625409 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210001625409 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210001625409 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210001625409 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210001625409 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210001625421 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:nanobts+band-1900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210001625430 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210001625430 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210001625430 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:16:28.661535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1591): Terminating (SIGTERM) 00:16:28.703461 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1594): Terminating (SIGTERM) 00:16:28.745271 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1597): Terminating (SIGTERM) 00:16:28.787482 --- ParallelTerminationStrategy: PID 1591 died... 00:16:28.807361 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1591): Terminated: ok {rc=0} 00:16:28.854177 --- ParallelTerminationStrategy: PID 1594 died... 00:16:28.873598 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1594): Terminated: ok {rc=0} 00:16:28.920142 --- ParallelTerminationStrategy: PID 1597 died... 00:16:28.939739 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1597): Terminated: ok {rc=0} 00:16:29.028152 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2366 gprs:nanobts+band-1900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 gprs:nanobts+band-1900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 00:16:30.329232 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:16:30.336503 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 00:16:30.361471 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 00:16:30.400908 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 00:16:30.487778 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 00:16:30.511840 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 00:16:30.551498 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 00:16:31.154615 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2366 gprs:nanobts+band-1900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 00:16:31.210183 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:16:31.222633 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:16:31.284565 tst cs_paging_gprs_active.py: using LAC 24666 00:16:31.410690 tst cs_paging_gprs_active.py: using RAC 186 00:16:31.565381 tst cs_paging_gprs_active.py: using CellId 24666 00:16:31.724298 tst cs_paging_gprs_active.py: using BVCI 24667 00:16:31.847576 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:16:31.859433 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:16:31.870895 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:16:31.883304 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:16:31.896153 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:16:31.908036 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:16:31.920173 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:16:31.931785 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:16:31.943506 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:16:32.063789 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:16:32.199209 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 00:16:32.402157 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:16:32.704076 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1602): Launched 00:16:32.964068 run iperf3-srv_10.42.42.10(pid=1603): Launched 00:16:33.075848 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 00:16:33.276862 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:16:33.576416 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1604): Launched 00:16:33.836615 run iperf3-srv_10.42.42.10(pid=1605): Launched 00:16:33.948882 tst cs_paging_gprs_active.py:38: start network... 00:16:34.150097 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:16:34.613465 run create_hlr_db(pid=1606): Launched 00:16:34.736049 bus /gobi_6: Setting Powered False 00:16:35.795891 run create_hlr_db(pid=1606): Terminated: ok {rc=0} 00:16:36.212822 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1608): Launched 00:16:36.512852 run osmo-hlr_10.42.42.2(pid=1609): Launched 00:16:36.626714 run osmo-stp_10.42.42.5: Starting osmo-stp 00:16:37.140684 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1611): Launched 00:16:37.438795 run osmo-stp_10.42.42.5(pid=1612): Launched 00:16:37.553725 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:16:38.069719 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1614): Launched 00:16:38.184147 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:16:38.437719 run patchelf(pid=1615): Launched 00:16:38.603861 run osmo-stp_10.42.42.5(pid=1612): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1612)] 00:16:38.731380 run osmo-stp_10.42.42.5(pid=1612): stdout: | (launched: 2022-12-10_00:16:37.384087) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:16:38.859863 run osmo-stp_10.42.42.5(pid=1612): stderr: | 20221210001637555 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001637555 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001637555 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001637556 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001637556 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001637556 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001637556 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:16:38.988391 run osmo-stp_10.42.42.5(pid=1612): stdout: | (launched: 2022-12-10_00:16:37.384087) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:16:39.110874 run osmo-stp_10.42.42.5(pid=1612): stderr: | 20221210001637555 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001637555 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001637555 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001637556 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001637556 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001637556 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001637556 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:16:39.256847 run patchelf(pid=1615): Terminating (SIGINT) 00:16:39.424603 run patchelf(pid=1615): Terminated: ok {rc=0} 00:16:39.545924 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=1612): Process ended prematurely: osmo-stp_10.42.42.5(pid=1612) [trial-2366↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1612)] [trial-2366↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 00:16:39.555302 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 00:16:39.582381 run osmo-hlr_10.42.42.2(pid=1609): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1609)] 00:16:39.629662 run osmo-hlr_10.42.42.2(pid=1609): stdout: | (launched: 2022-12-10_00:16:36.458202) 00:16:39.678665 run osmo-hlr_10.42.42.2(pid=1609): stderr: | 20221210001636633 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210001636633 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210001636633 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210001636633 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210001636634 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210001636634 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210001636649 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210001636659 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210001636659 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210001636660 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:16:39.728155 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1602): Terminating (SIGTERM) 00:16:39.767796 run iperf3-srv_10.42.42.10(pid=1603): Terminating (SIGTERM) 00:16:39.807131 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1604): Terminating (SIGTERM) 00:16:39.846777 run iperf3-srv_10.42.42.10(pid=1605): Terminating (SIGTERM) 00:16:39.886115 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1608): Terminating (SIGTERM) 00:16:39.925680 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1611): Terminating (SIGTERM) 00:16:39.965057 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1614): Terminating (SIGTERM) 00:16:40.004681 --- ParallelTerminationStrategy: PID 1602 died... 00:16:40.023953 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1602): Terminated: ok {rc=0} 00:16:40.067855 --- ParallelTerminationStrategy: PID 1603 died... 00:16:40.086578 run iperf3-srv_10.42.42.10(pid=1603): Terminated {rc=256} 00:16:40.129964 --- ParallelTerminationStrategy: PID 1604 died... 00:16:40.148615 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1604): Terminated: ok {rc=0} 00:16:40.192676 --- ParallelTerminationStrategy: PID 1605 died... 00:16:40.211265 run iperf3-srv_10.42.42.10(pid=1605): Terminated {rc=256} 00:16:40.255322 --- ParallelTerminationStrategy: PID 1608 died... 00:16:40.273873 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1608): Terminated: ok {rc=0} 00:16:40.317389 --- ParallelTerminationStrategy: PID 1611 died... 00:16:40.335803 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1611): Terminated: ok {rc=0} 00:16:40.379703 --- ParallelTerminationStrategy: PID 1614 died... 00:16:40.398311 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1614): Terminated: ok {rc=0} 00:16:40.480888 bus /gobi_0: Setting Powered False 00:16:41.577294 bus /gobi_0: Setting Powered False 00:16:42.691561 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 00:16:43.837922 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:16:43.849596 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:16:43.911848 tst iperf3.py: using LAC 24667 00:16:44.028368 tst iperf3.py: using RAC 187 00:16:44.150975 tst iperf3.py: using CellId 24667 00:16:44.268379 tst iperf3.py: using BVCI 24668 00:16:44.376472 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:16:44.387427 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:16:44.398429 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:16:44.409167 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:16:44.419743 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:16:44.430474 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:16:44.441342 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:16:44.451930 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:16:44.462747 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:16:44.578362 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 00:16:44.780121 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:16:45.079727 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1616): Launched 00:16:45.339805 run iperf3-srv_10.42.42.10(pid=1617): Launched 00:16:45.451529 tst iperf3.py:8: start network... 00:16:45.651920 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:16:46.151506 run create_hlr_db(pid=1618): Launched 00:16:46.304292 bus /gobi_6: Setting Powered False 00:16:47.362884 run create_hlr_db(pid=1618): Terminated: ok {rc=0} 00:16:47.800244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1620): Launched 00:16:48.120224 run osmo-hlr_10.42.42.2(pid=1621): Launched 00:16:48.241985 run osmo-stp_10.42.42.5: Starting osmo-stp 00:16:48.798170 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1623): Launched 00:16:49.118446 run osmo-stp_10.42.42.5(pid=1624): Launched 00:16:49.240311 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:16:49.791210 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1626): Launched 00:16:49.914030 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:16:50.184223 run patchelf(pid=1627): Launched 00:16:50.362244 run osmo-stp_10.42.42.5(pid=1624): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1624)] 00:16:50.498084 run osmo-stp_10.42.42.5(pid=1624): stdout: | (launched: 2022-12-10_00:16:49.060249) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:16:50.635476 run osmo-stp_10.42.42.5(pid=1624): stderr: | 20221210001649251 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001649252 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001649252 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001649252 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001649253 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001649253 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001649253 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:16:50.773554 run osmo-stp_10.42.42.5(pid=1624): stdout: | (launched: 2022-12-10_00:16:49.060249) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:16:50.905910 run osmo-stp_10.42.42.5(pid=1624): stderr: | 20221210001649251 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001649252 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001649252 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001649252 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001649253 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001649253 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001649253 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:16:51.061833 run patchelf(pid=1627): Terminating (SIGINT) 00:16:51.242132 run patchelf(pid=1627): Terminated: ok {rc=0} 00:16:51.372031 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1624): Process ended prematurely: osmo-stp_10.42.42.5(pid=1624) [trial-2366↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1624)] [trial-2366↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8] 00:16:51.382454 tst iperf3.py:8: Test FAILED (7.6 sec) 00:16:51.411763 run osmo-hlr_10.42.42.2(pid=1621): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1621)] 00:16:51.461737 run osmo-hlr_10.42.42.2(pid=1621): stdout: | (launched: 2022-12-10_00:16:48.062344) 00:16:51.513694 run osmo-hlr_10.42.42.2(pid=1621): stderr: | 20221210001648262 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210001648262 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210001648262 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210001648262 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210001648262 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210001648262 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210001648275 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210001648285 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210001648286 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210001648286 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:16:51.566062 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1616): Terminating (SIGTERM) 00:16:51.608089 run iperf3-srv_10.42.42.10(pid=1617): Terminating (SIGTERM) 00:16:51.650236 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1620): Terminating (SIGTERM) 00:16:51.692231 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1623): Terminating (SIGTERM) 00:16:51.734659 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1626): Terminating (SIGTERM) 00:16:51.776781 --- ParallelTerminationStrategy: PID 1616 died... 00:16:51.797076 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1616): Terminated: ok {rc=0} 00:16:51.844056 --- ParallelTerminationStrategy: PID 1617 died... 00:16:51.863613 run iperf3-srv_10.42.42.10(pid=1617): Terminated {rc=256} 00:16:51.910407 --- ParallelTerminationStrategy: PID 1620 died... 00:16:51.929885 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1620): Terminated: ok {rc=0} 00:16:51.976488 --- ParallelTerminationStrategy: PID 1623 died... 00:16:51.996362 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1623): Terminated: ok {rc=0} 00:16:52.042974 --- ParallelTerminationStrategy: PID 1626 died... 00:16:52.062735 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1626): Terminated: ok {rc=0} 00:16:52.150765 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 00:16:53.301376 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:16:53.313627 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:16:53.374261 tst iperf3m4.py: using LAC 24668 00:16:53.490841 tst iperf3m4.py: using RAC 188 00:16:53.607342 tst iperf3m4.py: using CellId 24668 00:16:53.723556 tst iperf3m4.py: using BVCI 24669 00:16:53.833071 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:16:53.844081 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:16:53.854959 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:16:53.866526 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:16:53.877878 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:16:53.889268 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:16:53.900618 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:16:53.912040 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:16:53.923800 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:16:54.046471 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:16:54.164772 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:16:54.285521 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:16:54.407269 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 00:16:54.625260 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:16:54.948158 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1628): Launched 00:16:55.226990 run iperf3-srv_10.42.42.10(pid=1629): Launched 00:16:55.347032 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 00:16:55.563193 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:16:55.886507 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1630): Launched 00:16:56.165584 run iperf3-srv_10.42.42.10(pid=1631): Launched 00:16:56.286002 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 00:16:56.503781 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:16:56.826784 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1632): Launched 00:16:57.106420 run iperf3-srv_10.42.42.10(pid=1633): Launched 00:16:57.226213 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 00:16:57.442920 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:16:57.765685 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1634): Launched 00:16:58.044081 run iperf3-srv_10.42.42.10(pid=1635): Launched 00:16:58.164156 tst iperf3m4.py:8: start network... 00:16:58.380693 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:16:58.880020 run create_hlr_db(pid=1636): Launched 00:16:59.004250 bus /gobi_6: Setting Powered False 00:17:00.063785 run create_hlr_db(pid=1636): Terminated: ok {rc=0} 00:17:00.502736 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1638): Launched 00:17:00.825044 run osmo-hlr_10.42.42.2(pid=1639): Launched 00:17:01.122856 run osmo-stp_10.42.42.5: Starting osmo-stp 00:17:01.814667 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1644): Launched 00:17:02.131160 run osmo-stp_10.42.42.5(pid=1645): Launched 00:17:02.365712 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:17:02.938309 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1647): Launched 00:17:03.060721 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:17:03.332373 run patchelf(pid=1648): Launched 00:17:03.510687 run osmo-stp_10.42.42.5(pid=1645): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1645)] 00:17:03.646586 run osmo-stp_10.42.42.5(pid=1645): stdout: | (launched: 2022-12-10_00:17:02.067276) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:17:03.784363 run osmo-stp_10.42.42.5(pid=1645): stderr: | 20221210001702267 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001702268 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001702268 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001702268 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001702269 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001702269 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001702269 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:17:03.923094 run osmo-stp_10.42.42.5(pid=1645): stdout: | (launched: 2022-12-10_00:17:02.067276) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:17:04.054524 run osmo-stp_10.42.42.5(pid=1645): stderr: | 20221210001702267 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001702268 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001702268 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001702268 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001702269 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001702269 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001702269 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:17:04.210732 run patchelf(pid=1648): Terminating (SIGINT) 00:17:04.391384 run patchelf(pid=1648): Terminated: ok {rc=0} 00:17:04.521259 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1645): Process ended prematurely: osmo-stp_10.42.42.5(pid=1645) [trial-2366↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1645)] [trial-2366↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 00:17:04.531541 tst iperf3m4.py:8: Test FAILED (11.3 sec) 00:17:04.560836 run osmo-hlr_10.42.42.2(pid=1639): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1639)] 00:17:04.611159 run osmo-hlr_10.42.42.2(pid=1639): stdout: | (launched: 2022-12-10_00:17:00.765944) 00:17:04.663455 run osmo-hlr_10.42.42.2(pid=1639): stderr: | 20221210001701040 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210001701040 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210001701040 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210001701040 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210001701045 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210001701045 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210001701059 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210001701076 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210001701076 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210001701076 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:17:04.716089 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1628): Terminating (SIGTERM) 00:17:04.758813 run iperf3-srv_10.42.42.10(pid=1629): Terminating (SIGTERM) 00:17:04.801483 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1630): Terminating (SIGTERM) 00:17:04.844253 run iperf3-srv_10.42.42.10(pid=1631): Terminating (SIGTERM) 00:17:04.886534 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1632): Terminating (SIGTERM) 00:17:04.929182 run iperf3-srv_10.42.42.10(pid=1633): Terminating (SIGTERM) 00:17:04.971276 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1634): Terminating (SIGTERM) 00:17:05.013298 run iperf3-srv_10.42.42.10(pid=1635): Terminating (SIGTERM) 00:17:05.055201 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1638): Terminating (SIGTERM) 00:17:05.097143 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1644): Terminating (SIGTERM) 00:17:05.138799 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1647): Terminating (SIGTERM) 00:17:05.180697 --- ParallelTerminationStrategy: PID 1628 died... 00:17:05.200742 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1628): Terminated: ok {rc=0} 00:17:05.247624 --- ParallelTerminationStrategy: PID 1629 died... 00:17:05.267190 run iperf3-srv_10.42.42.10(pid=1629): Terminated {rc=256} 00:17:05.313688 --- ParallelTerminationStrategy: PID 1630 died... 00:17:05.333620 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1630): Terminated: ok {rc=0} 00:17:05.380290 --- ParallelTerminationStrategy: PID 1631 died... 00:17:05.400098 run iperf3-srv_10.42.42.10(pid=1631): Terminated {rc=256} 00:17:05.446538 --- ParallelTerminationStrategy: PID 1632 died... 00:17:05.466256 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1632): Terminated: ok {rc=0} 00:17:05.512704 --- ParallelTerminationStrategy: PID 1633 died... 00:17:05.532360 run iperf3-srv_10.42.42.10(pid=1633): Terminated {rc=256} 00:17:05.578648 --- ParallelTerminationStrategy: PID 1634 died... 00:17:05.598770 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1634): Terminated: ok {rc=0} 00:17:05.645396 --- ParallelTerminationStrategy: PID 1635 died... 00:17:05.664906 run iperf3-srv_10.42.42.10(pid=1635): Terminated {rc=256} 00:17:05.711540 --- ParallelTerminationStrategy: PID 1638 died... 00:17:05.731213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1638): Terminated: ok {rc=0} 00:17:05.777603 --- ParallelTerminationStrategy: PID 1644 died... 00:17:05.797669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1644): Terminated: ok {rc=0} 00:17:05.843933 --- ParallelTerminationStrategy: PID 1647 died... 00:17:05.863683 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1647): Terminated: ok {rc=0} 00:17:05.951180 bus /gobi_4: Setting Powered False 00:17:07.050992 bus /gobi_4: Setting Powered False 00:17:08.167254 bus /gobi_1: Setting Powered False 00:17:09.265157 bus /gobi_1: Setting Powered False 00:17:10.380780 bus /gobi_0: Setting Powered False 00:17:11.478025 bus /gobi_0: Setting Powered False 00:17:12.594177 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 00:17:13.693342 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:13.705066 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:17:13.769434 tst ping.py: using LAC 24669 00:17:13.886429 tst ping.py: using RAC 189 00:17:14.000912 tst ping.py: using CellId 24669 00:17:14.116193 tst ping.py: using BVCI 24670 00:17:14.222881 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:14.234034 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:14.244810 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:14.255685 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:14.266617 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:14.277480 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:14.288341 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:14.299198 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:17:14.416753 tst ping.py:19: start network... 00:17:14.631903 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:17:15.122938 run create_hlr_db(pid=1649): Launched 00:17:15.242860 bus /gobi_6: Setting Powered False 00:17:16.306059 run create_hlr_db(pid=1649): Terminated: ok {rc=0} 00:17:16.758881 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1651): Launched 00:17:17.085810 run osmo-hlr_10.42.42.2(pid=1652): Launched 00:17:17.225658 run osmo-stp_10.42.42.5: Starting osmo-stp 00:17:17.742601 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1654): Launched 00:17:18.036359 run osmo-stp_10.42.42.5(pid=1655): Launched 00:17:18.148246 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:17:18.653914 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1657): Launched 00:17:18.765899 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:17:19.013709 run patchelf(pid=1658): Launched 00:17:19.176901 run osmo-stp_10.42.42.5(pid=1655): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1655)] 00:17:19.300915 run osmo-stp_10.42.42.5(pid=1655): stdout: | (launched: 2022-12-10_00:17:17.982540) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:17:19.427361 run osmo-stp_10.42.42.5(pid=1655): stderr: | 20221210001718152 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001718152 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001718152 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001718153 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001718155 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001718155 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001718155 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:17:19.553551 run osmo-stp_10.42.42.5(pid=1655): stdout: | (launched: 2022-12-10_00:17:17.982540) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:17:19.674391 run osmo-stp_10.42.42.5(pid=1655): stderr: | 20221210001718152 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001718152 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001718152 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001718153 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001718155 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001718155 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001718155 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:17:19.817759 run patchelf(pid=1658): Terminating (SIGINT) 00:17:19.982504 run patchelf(pid=1658): Terminated: ok {rc=0} 00:17:20.101179 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=1655): Process ended prematurely: osmo-stp_10.42.42.5(pid=1655) [trial-2366↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1655)] [trial-2366↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22] 00:17:20.110097 tst ping.py:22: Test FAILED (6.4 sec) 00:17:20.136399 run osmo-hlr_10.42.42.2(pid=1652): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1652)] 00:17:20.183750 run osmo-hlr_10.42.42.2(pid=1652): stdout: | (launched: 2022-12-10_00:17:17.023130) 00:17:20.232634 run osmo-hlr_10.42.42.2(pid=1652): stderr: | 20221210001717228 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210001717228 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210001717229 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210001717229 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210001717229 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210001717229 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210001717241 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210001717249 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210001717250 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210001717250 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:17:20.282117 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1651): Terminating (SIGTERM) 00:17:20.321439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1654): Terminating (SIGTERM) 00:17:20.360558 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1657): Terminating (SIGTERM) 00:17:20.400003 --- ParallelTerminationStrategy: PID 1651 died... 00:17:20.418993 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1651): Terminated: ok {rc=0} 00:17:20.462686 --- ParallelTerminationStrategy: PID 1654 died... 00:17:20.481238 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1654): Terminated: ok {rc=0} 00:17:20.524898 --- ParallelTerminationStrategy: PID 1657 died... 00:17:20.543575 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1657): Terminated: ok {rc=0} 00:17:20.628133 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 00:17:21.716656 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:21.728674 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:17:21.789410 tst ping_idle_ping.py: using LAC 24670 00:17:21.914989 tst ping_idle_ping.py: using RAC 190 00:17:22.030483 tst ping_idle_ping.py: using CellId 24670 00:17:22.147411 tst ping_idle_ping.py: using BVCI 24671 00:17:22.253457 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:22.264425 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:22.275199 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:22.285959 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:22.296626 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:22.307450 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:22.318326 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:17:22.329011 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:17:22.442178 tst ping_idle_ping.py:24: start network... 00:17:22.641039 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:17:23.099766 run create_hlr_db(pid=1659): Launched 00:17:23.219535 bus /gobi_6: Setting Powered False 00:17:24.278771 run create_hlr_db(pid=1659): Terminated: ok {rc=0} 00:17:24.709927 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1661): Launched 00:17:25.024787 run osmo-hlr_10.42.42.2(pid=1662): Launched 00:17:25.146216 run osmo-stp_10.42.42.5: Starting osmo-stp 00:17:25.687903 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1664): Launched 00:17:26.001777 run osmo-stp_10.42.42.5(pid=1665): Launched 00:17:26.121858 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:17:26.664653 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1667): Launched 00:17:26.785156 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:17:27.051784 run patchelf(pid=1668): Launched 00:17:27.227103 run osmo-stp_10.42.42.5(pid=1665): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1665)] 00:17:27.360116 run osmo-stp_10.42.42.5(pid=1665): stdout: | (launched: 2022-12-10_00:17:25.944524) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:17:27.496432 run osmo-stp_10.42.42.5(pid=1665): stderr: | 20221210001726137 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001726137 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001726137 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001726138 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001726138 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001726138 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001726138 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:17:27.631986 run osmo-stp_10.42.42.5(pid=1665): stdout: | (launched: 2022-12-10_00:17:25.944524) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:17:27.761599 run osmo-stp_10.42.42.5(pid=1665): stderr: | 20221210001726137 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001726137 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001726137 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001726138 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001726138 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001726138 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001726138 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:17:27.915455 run patchelf(pid=1668): Terminating (SIGINT) 00:17:28.092831 run patchelf(pid=1668): Terminated: ok {rc=0} 00:17:28.220562 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=1665): Process ended prematurely: osmo-stp_10.42.42.5(pid=1665) [trial-2366↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1665)] [trial-2366↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 00:17:28.230298 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 00:17:28.258506 run osmo-hlr_10.42.42.2(pid=1662): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1662)] 00:17:28.308600 run osmo-hlr_10.42.42.2(pid=1662): stdout: | (launched: 2022-12-10_00:17:24.967538) 00:17:28.360291 run osmo-hlr_10.42.42.2(pid=1662): stderr: | 20221210001725166 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210001725166 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210001725166 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210001725166 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210001725167 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210001725167 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210001725179 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210001725190 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210001725190 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210001725190 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:17:28.412447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1661): Terminating (SIGTERM) 00:17:28.454411 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1664): Terminating (SIGTERM) 00:17:28.496279 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1667): Terminating (SIGTERM) 00:17:28.538388 --- ParallelTerminationStrategy: PID 1661 died... 00:17:28.558383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1661): Terminated: ok {rc=0} 00:17:28.604708 --- ParallelTerminationStrategy: PID 1664 died... 00:17:28.624252 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1664): Terminated: ok {rc=0} 00:17:28.670333 --- ParallelTerminationStrategy: PID 1667 died... 00:17:28.689660 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1667): Terminated: ok {rc=0} 00:17:28.776359 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2366 gprs:nanobts+band-1900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 00:17:30.071689 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:17:30.080210 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 00:17:30.105516 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 00:17:30.140995 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 00:17:30.195241 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 00:17:30.219969 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 00:17:30.256070 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 00:17:30.818867 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2366 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 00:17:30.824131 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:17:30.836597 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 00:17:30.901821 tst switch_tch_pdch.py: using LAC 24671 00:17:31.030953 tst switch_tch_pdch.py: using RAC 191 00:17:31.158383 tst switch_tch_pdch.py: using CellId 24671 00:17:31.276064 tst switch_tch_pdch.py: using BVCI 24672 00:17:31.387584 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:17:31.400395 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:17:31.413911 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:17:31.427311 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:17:31.439833 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:17:31.453272 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:17:31.467425 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:17:31.480340 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:17:31.628069 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:17:31.784137 tst switch_tch_pdch.py:51: start network... 00:17:32.020199 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:17:32.488010 run create_hlr_db(pid=1673): Launched 00:17:32.609782 bus /gobi_6: Setting Powered False 00:17:33.669515 run create_hlr_db(pid=1673): Terminated: ok {rc=0} 00:17:34.079750 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1675): Launched 00:17:34.372837 run osmo-hlr_10.42.42.2(pid=1676): Launched 00:17:34.485348 run osmo-stp_10.42.42.5: Starting osmo-stp 00:17:35.003924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1678): Launched 00:17:35.298264 run osmo-stp_10.42.42.5(pid=1679): Launched 00:17:35.410431 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:17:35.922839 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1682): Launched 00:17:36.035491 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:17:36.283115 run patchelf(pid=1683): Launched 00:17:36.459490 run osmo-stp_10.42.42.5(pid=1679): ERR: Terminated: ERROR {rc=1} [trial-2366↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1679)] 00:17:36.593261 run osmo-stp_10.42.42.5(pid=1679): stdout: | (launched: 2022-12-10_00:17:35.244133) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:17:36.728297 run osmo-stp_10.42.42.5(pid=1679): stderr: | 20221210001735413 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001735413 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001735413 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001735414 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001735414 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001735414 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001735415 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:17:36.863719 run osmo-stp_10.42.42.5(pid=1679): stdout: | (launched: 2022-12-10_00:17:35.244133) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:17:36.992508 run osmo-stp_10.42.42.5(pid=1679): stderr: | 20221210001735413 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001735413 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001735413 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001735414 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001735414 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001735414 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001735415 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:17:37.145929 run patchelf(pid=1683): Terminating (SIGINT) 00:17:37.322968 run patchelf(pid=1683): Terminated: ok {rc=0} 00:17:37.449916 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=1679): Process ended prematurely: osmo-stp_10.42.42.5(pid=1679) [trial-2366↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1679)] [trial-2366↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 00:17:37.459468 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 00:17:37.489111 run osmo-hlr_10.42.42.2(pid=1676): ERR: Terminated: ERROR {rc=237} [trial-2366↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1676)] 00:17:37.539125 run osmo-hlr_10.42.42.2(pid=1676): stdout: | (launched: 2022-12-10_00:17:34.318933) 00:17:37.590987 run osmo-hlr_10.42.42.2(pid=1676): stderr: | 20221210001734496 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210001734496 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210001734496 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210001734496 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210001734496 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210001734496 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210001734508 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210001734517 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210001734517 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210001734517 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:17:37.643327 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1675): Terminating (SIGTERM) 00:17:37.684991 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1678): Terminating (SIGTERM) 00:17:37.726646 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1682): Terminating (SIGTERM) 00:17:37.768600 --- ParallelTerminationStrategy: PID 1675 died... 00:17:37.788396 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1675): Terminated: ok {rc=0} 00:17:37.835719 --- ParallelTerminationStrategy: PID 1678 died... 00:17:37.855271 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1678): Terminated: ok {rc=0} 00:17:37.901460 --- ParallelTerminationStrategy: PID 1682 died... 00:17:37.920896 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1682): Terminated: ok {rc=0} 00:17:38.008083 bus /gobi_0: Setting Powered False 00:17:39.106942 bus /gobi_0: Setting Powered False 00:17:40.222974 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2366 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 sms:nanobts+band-900 --------------------------------------------------------------------- 00:17:41.468509 tst sms:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:17:41.473837 tst sms:nanobts+band-900: Verifying 1 x bts (candidates: 11) 00:17:41.507252 tst sms:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 00:17:41.534454 tst sms:nanobts+band-900: Verifying 2 x modem (candidates: 12) 00:17:41.586329 tst sms:nanobts+band-900: Reserving 1 x bts (candidates: 11) 00:17:41.619631 tst sms:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 00:17:41.646962 tst sms:nanobts+band-900: Reserving 2 x modem (candidates: 12) 00:17:42.195284 tst sms:nanobts+band-900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 sms:nanobts+band-900 mo_mt_sms.py ---------------------------------------------- 00:17:42.200419 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 00:17:42.211851 tst sms:nanobts+band-900: Using 1 x bts (candidates: 1) 00:17:42.258610 tst mo_mt_sms.py: using LAC 24672 00:17:42.384291 tst mo_mt_sms.py: using RAC 192 00:17:42.507058 tst mo_mt_sms.py: using CellId 24672 00:17:42.630842 tst mo_mt_sms.py: using BVCI 24673 00:17:42.745329 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 00:17:42.756408 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 00:17:42.767465 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 00:17:42.778580 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 00:17:42.789859 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 00:17:42.800867 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 00:17:42.917245 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 00:17:43.031010 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:17:43.488030 run create_hlr_db(pid=1687): Launched 00:17:43.609738 bus /gobi_6: Setting Powered False 00:17:44.669398 run create_hlr_db(pid=1687): Terminated: ok {rc=0} 00:17:45.080185 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1689): Launched 00:17:45.374056 run osmo-hlr_10.42.42.2(pid=1690): Launched 00:17:45.485884 run osmo-stp_10.42.42.5: Starting osmo-stp 00:17:46.001643 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1692): Launched 00:17:46.310713 run osmo-stp_10.42.42.5(pid=1693): Launched 00:17:46.436343 run osmo-msc_10.42.42.6: Starting osmo-msc 00:17:47.147191 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1695): Launched 00:17:47.482128 run osmo-msc_10.42.42.6(pid=1696): Launched 00:17:47.659561 run osmo-stp_10.42.42.5(pid=1693): ERR: Terminated: ERROR {rc=1} [trial-2366↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1693)] 00:17:47.795333 run osmo-stp_10.42.42.5(pid=1693): stdout: | (launched: 2022-12-10_00:17:46.249076) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:17:47.931673 run osmo-stp_10.42.42.5(pid=1693): stderr: | 20221210001746590 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001746591 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001746591 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001746591 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001746592 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001746592 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001746592 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:17:48.065064 run osmo-stp_10.42.42.5(pid=1693): stdout: | (launched: 2022-12-10_00:17:46.249076) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:17:48.190987 run osmo-stp_10.42.42.5(pid=1693): stderr: | 20221210001746590 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001746591 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001746591 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001746591 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001746592 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001746592 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001746592 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:17:48.341135 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=1693): Process ended prematurely: osmo-stp_10.42.42.5(pid=1693) [trial-2366↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1693)] [trial-2366↪sms:nanobts+band-900↪mo_mt_sms.py:16] 00:17:48.350005 tst mo_mt_sms.py:16: Test FAILED (6.1 sec) 00:17:48.377590 run osmo-hlr_10.42.42.2(pid=1690): ERR: Terminated: ERROR {rc=237} [trial-2366↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1690)] 00:17:48.427777 run osmo-hlr_10.42.42.2(pid=1690): stdout: | (launched: 2022-12-10_00:17:45.320218) 00:17:48.479545 run osmo-hlr_10.42.42.2(pid=1690): stderr: | 20221210001745495 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210001745495 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210001745495 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210001745495 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210001745495 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210001745495 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210001745507 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/sms:nanobts+band-900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210001745516 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210001745516 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210001745516 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:17:48.551478 run osmo-msc_10.42.42.6(pid=1696): ERR: Terminated: ERROR {rc=2} [trial-2366↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1696)] 00:17:48.601266 run osmo-msc_10.42.42.6(pid=1696): stdout: | (launched: 2022-12-10_00:17:47.423309) 00:17:48.652598 run osmo-msc_10.42.42.6(pid=1696): stderr: | 20221210001747742 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210001747742 DLGLOBAL DEBUG validating counter group 0x7fd47ef8bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210001747742 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210001747742 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210001747742 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210001747743 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210001747744 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210001747745 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210001747745 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210001747745 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:17:48.705028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1689): Terminating (SIGTERM) 00:17:48.746693 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1692): Terminating (SIGTERM) 00:17:48.788388 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1695): Terminating (SIGTERM) 00:17:48.830791 --- ParallelTerminationStrategy: PID 1689 died... 00:17:48.850516 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1689): Terminated: ok {rc=0} 00:17:48.897172 --- ParallelTerminationStrategy: PID 1692 died... 00:17:48.916607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1692): Terminated: ok {rc=0} 00:17:48.962616 --- ParallelTerminationStrategy: PID 1695 died... 00:17:48.982086 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1695): Terminated: ok {rc=0} 00:17:49.070099 bus /sierra_3: Setting Powered False 00:17:50.168611 bus /sierra_3: Setting Powered False 00:17:51.285123 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 sms:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 nitb_ussd:nanobts+band-900 --------------------------------------------------------------------- 00:17:52.517039 tst nitb_ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:17:52.522167 tst nitb_ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 00:17:52.556194 tst nitb_ussd:nanobts+band-900: Verifying 1 x ip_address (candidates: 9) 00:17:52.563172 tst nitb_ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 00:17:52.598203 tst nitb_ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 00:17:52.631817 tst nitb_ussd:nanobts+band-900: Reserving 1 x ip_address (candidates: 9) 00:17:52.638900 tst nitb_ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 00:17:53.160075 tst nitb_ussd:nanobts+band-900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2366 nitb_ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 00:17:53.165546 tst nitb_ussd:nanobts+band-900: Using 1 x ip_address (candidates: 1) 00:17:53.176885 tst nitb_ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 00:17:53.227227 tst assert_extension.py: using LAC 24673 00:17:53.353285 tst assert_extension.py: using RAC 193 00:17:53.475173 tst assert_extension.py: using CellId 24673 00:17:53.597306 tst assert_extension.py: using BVCI 24674 00:17:53.711147 tst nitb_ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 00:17:53.825097 tst assert_extension.py:10: start nitb and bts... 00:17:54.021626 run osmo-nitb_10.42.42.2: Starting osmo-nitb 00:17:54.620882 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1701): Launched 00:17:54.914890 run osmo-nitb_10.42.42.2(pid=1702): Launched 00:17:55.077963 run osmo-nitb_10.42.42.2(pid=1702): ERR: Terminated: ERROR {rc=2} [trial-2366↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1702)] 00:17:55.210112 run osmo-nitb_10.42.42.2(pid=1702): stdout: | (launched: 2022-12-10_00:17:54.860824) 00:17:55.344685 run osmo-nitb_10.42.42.2(pid=1702): stderr: | (launched: 2022-12-10_00:17:54.904586) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:17:55.478426 run osmo-nitb_10.42.42.2(pid=1702): stdout: | (launched: 2022-12-10_00:17:54.860824) 00:17:55.606425 run osmo-nitb_10.42.42.2(pid=1702): stderr: | (launched: 2022-12-10_00:17:54.904586) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=1702): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1702) [trial-2366↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1702)] 00:17:56.025500 tst osmo-nitb_10.42.42.2(pid=1702): stdout: | (launched: 2022-12-10_00:17:54.860824) 00:17:56.145167 tst osmo-nitb_10.42.42.2(pid=1702): stderr: | (launched: 2022-12-10_00:17:54.904586) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:17:56.285617 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=1702): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1702) [trial-2366↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1702)] [trial-2366↪nitb_ussd:nanobts+band-900↪assert_extension.py:12] 00:17:56.293868 tst assert_extension.py:12: Test FAILED (3.1 sec) 00:17:56.300333 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1701): Terminating (SIGTERM) 00:17:56.508515 --- ParallelTerminationStrategy: PID 1701 died... 00:17:56.528811 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1701): Terminated: ok {rc=0} 00:17:56.614356 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 nitb_ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 ussd:nanobts+band-900 --------------------------------------------------------------------- 00:17:57.787146 tst ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:17:57.791903 tst ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 00:17:57.827239 tst ussd:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 00:17:57.855066 tst ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 00:17:57.890806 tst ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 00:17:57.923809 tst ussd:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 00:17:57.951572 tst ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 00:17:58.480581 tst ussd:nanobts+band-900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2366 ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 00:17:58.487932 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 00:17:58.500108 tst ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 00:17:58.545960 tst assert_extension.py: using LAC 24674 00:17:58.661311 tst assert_extension.py: using RAC 194 00:17:58.776434 tst assert_extension.py: using CellId 24674 00:17:58.891651 tst assert_extension.py: using BVCI 24675 00:17:59.007873 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 00:17:59.019170 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 00:17:59.030463 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 00:17:59.042361 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 00:17:59.054265 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 00:17:59.066040 tst ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 00:17:59.180668 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:17:59.636145 run create_hlr_db(pid=1706): Launched 00:17:59.756739 bus /sierra_2: Setting Powered False 00:18:00.816460 run create_hlr_db(pid=1706): Terminated: ok {rc=0} 00:18:01.305867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1708): Launched 00:18:01.641652 run osmo-hlr_10.42.42.2(pid=1709): Launched 00:18:01.774737 run osmo-stp_10.42.42.5: Starting osmo-stp 00:18:02.493713 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1711): Launched 00:18:02.808388 run osmo-stp_10.42.42.5(pid=1712): Launched 00:18:02.929815 run osmo-msc_10.42.42.6: Starting osmo-msc 00:18:03.497468 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1714): Launched 00:18:03.812459 run osmo-msc_10.42.42.6(pid=1715): Launched 00:18:03.989235 run osmo-stp_10.42.42.5(pid=1712): ERR: Terminated: ERROR {rc=1} [trial-2366↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1712)] 00:18:04.122417 run osmo-stp_10.42.42.5(pid=1712): stdout: | (launched: 2022-12-10_00:18:02.751002) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:18:04.255841 run osmo-stp_10.42.42.5(pid=1712): stderr: | 20221210001802942 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001802942 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001802942 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001802943 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001802943 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001802943 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001802943 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:18:04.388616 run osmo-stp_10.42.42.5(pid=1712): stdout: | (launched: 2022-12-10_00:18:02.751002) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:18:04.514496 run osmo-stp_10.42.42.5(pid=1712): stderr: | 20221210001802942 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001802942 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001802942 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001802943 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001802943 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001802943 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001802943 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:18:04.664873 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=1712): Process ended prematurely: osmo-stp_10.42.42.5(pid=1712) [trial-2366↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1712)] [trial-2366↪ussd:nanobts+band-900↪assert_extension.py:17] 00:18:04.673944 tst assert_extension.py:17: Test FAILED (6.2 sec) 00:18:04.701439 run osmo-hlr_10.42.42.2(pid=1709): ERR: Terminated: ERROR {rc=237} [trial-2366↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1709)] 00:18:04.751721 run osmo-hlr_10.42.42.2(pid=1709): stdout: | (launched: 2022-12-10_00:18:01.572718) 00:18:04.803325 run osmo-hlr_10.42.42.2(pid=1709): stderr: | 20221210001802013 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210001802013 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210001802013 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210001802013 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210001802013 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210001802013 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210001802041 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/ussd:nanobts+band-900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210001802062 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210001802063 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210001802063 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:18:04.875791 run osmo-msc_10.42.42.6(pid=1715): ERR: Terminated: ERROR {rc=2} [trial-2366↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1715)] 00:18:04.925656 run osmo-msc_10.42.42.6(pid=1715): stdout: | (launched: 2022-12-10_00:18:03.754890) 00:18:04.977254 run osmo-msc_10.42.42.6(pid=1715): stderr: | 20221210001804074 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210001804075 DLGLOBAL DEBUG validating counter group 0x7f7c643d0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210001804075 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210001804075 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210001804075 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210001804075 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210001804077 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210001804077 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210001804078 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210001804078 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:18:05.029378 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1708): Terminating (SIGTERM) 00:18:05.071071 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1711): Terminating (SIGTERM) 00:18:05.112798 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1714): Terminating (SIGTERM) 00:18:05.155343 --- ParallelTerminationStrategy: PID 1708 died... 00:18:05.175177 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1708): Terminated: ok {rc=0} 00:18:05.221597 --- ParallelTerminationStrategy: PID 1711 died... 00:18:05.240837 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1711): Terminated: ok {rc=0} 00:18:05.287184 --- ParallelTerminationStrategy: PID 1714 died... 00:18:05.306631 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1714): Terminated: ok {rc=0} 00:18:05.394824 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 00:18:06.604688 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:18:06.612681 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 00:18:06.646405 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 00:18:06.674347 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 00:18:06.727495 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 00:18:06.761070 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 00:18:06.788841 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 00:18:07.340693 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 00:18:07.393796 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:18:07.405466 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 00:18:07.473199 tst mo_mt_call.py: using LAC 24675 00:18:07.599599 tst mo_mt_call.py: using RAC 195 00:18:07.724862 tst mo_mt_call.py: using CellId 24675 00:18:07.852212 tst mo_mt_call.py: using BVCI 24676 00:18:07.968554 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:18:07.980147 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:18:07.991605 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:18:08.003340 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:18:08.015373 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:18:08.026814 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 00:18:08.145036 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 00:18:08.261336 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:18:08.724855 run create_hlr_db(pid=1720): Launched 00:18:08.847534 bus /sierra_2: Setting Powered False 00:18:09.912109 run create_hlr_db(pid=1720): Terminated: ok {rc=0} 00:18:10.359410 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1722): Launched 00:18:10.678832 run osmo-hlr_10.42.42.2(pid=1723): Launched 00:18:10.800045 run osmo-stp_10.42.42.5: Starting osmo-stp 00:18:11.357644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1725): Launched 00:18:11.678302 run osmo-stp_10.42.42.5(pid=1726): Launched 00:18:11.799389 run osmo-msc_10.42.42.6: Starting osmo-msc 00:18:12.378192 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1728): Launched 00:18:12.697146 run osmo-msc_10.42.42.6(pid=1729): Launched 00:18:12.876445 run osmo-stp_10.42.42.5(pid=1726): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1726)] 00:18:13.011820 run osmo-stp_10.42.42.5(pid=1726): stdout: | (launched: 2022-12-10_00:18:11.620123) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:18:13.147773 run osmo-stp_10.42.42.5(pid=1726): stderr: | 20221210001811813 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001811813 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001811813 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001811813 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001811814 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001811814 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001811814 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:18:13.283222 run osmo-stp_10.42.42.5(pid=1726): stdout: | (launched: 2022-12-10_00:18:11.620123) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:18:13.410627 run osmo-stp_10.42.42.5(pid=1726): stderr: | 20221210001811813 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001811813 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001811813 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001811813 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001811814 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001811814 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001811814 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:18:13.563575 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1726): Process ended prematurely: osmo-stp_10.42.42.5(pid=1726) [trial-2366↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1726)] [trial-2366↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 00:18:13.573094 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 00:18:13.601447 run osmo-hlr_10.42.42.2(pid=1723): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1723)] 00:18:13.651656 run osmo-hlr_10.42.42.2(pid=1723): stdout: | (launched: 2022-12-10_00:18:10.620610) 00:18:13.703560 run osmo-hlr_10.42.42.2(pid=1723): stderr: | 20221210001810820 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210001810820 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210001810820 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210001810821 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210001810821 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210001810821 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210001810834 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210001810842 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210001810842 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210001810842 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:18:13.775860 run osmo-msc_10.42.42.6(pid=1729): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1729)] 00:18:13.825630 run osmo-msc_10.42.42.6(pid=1729): stdout: | (launched: 2022-12-10_00:18:12.639070) 00:18:13.877296 run osmo-msc_10.42.42.6(pid=1729): stderr: | 20221210001812960 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210001812960 DLGLOBAL DEBUG validating counter group 0x7fdd6cc30c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210001812960 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210001812960 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210001812960 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210001812960 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210001812962 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210001812962 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210001812963 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210001812963 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:18:13.929127 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1722): Terminating (SIGTERM) 00:18:13.970681 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1725): Terminating (SIGTERM) 00:18:14.012200 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1728): Terminating (SIGTERM) 00:18:14.054177 --- ParallelTerminationStrategy: PID 1722 died... 00:18:14.074137 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1722): Terminated: ok {rc=0} 00:18:14.120379 --- ParallelTerminationStrategy: PID 1725 died... 00:18:14.139858 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1725): Terminated: ok {rc=0} 00:18:14.186043 --- ParallelTerminationStrategy: PID 1728 died... 00:18:14.205473 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1728): Terminated: ok {rc=0} 00:18:14.292373 bus /sierra_3: Setting Powered False 00:18:15.391293 bus /sierra_3: Setting Powered False 00:18:16.507255 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 00:18:17.669963 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:18:17.682387 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 00:18:17.751523 tst mo_mt_call_osmux.py: using LAC 24676 00:18:17.879013 tst mo_mt_call_osmux.py: using RAC 196 00:18:18.004921 tst mo_mt_call_osmux.py: using CellId 24676 00:18:18.130794 tst mo_mt_call_osmux.py: using BVCI 24677 00:18:18.248624 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:18:18.260357 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:18:18.271921 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:18:18.283619 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:18:18.296184 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 00:18:18.308012 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 00:18:18.425197 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 00:18:18.546567 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:18:19.044585 run create_hlr_db(pid=1731): Launched 00:18:19.166324 bus /sierra_2: Setting Powered False 00:18:20.230089 run create_hlr_db(pid=1731): Terminated: ok {rc=0} 00:18:20.658720 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1733): Launched 00:18:20.981071 run osmo-hlr_10.42.42.2(pid=1734): Launched 00:18:21.102680 run osmo-stp_10.42.42.5: Starting osmo-stp 00:18:21.658632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1736): Launched 00:18:21.979192 run osmo-stp_10.42.42.5(pid=1737): Launched 00:18:22.101121 run osmo-msc_10.42.42.6: Starting osmo-msc 00:18:22.679907 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1739): Launched 00:18:23.001572 run osmo-msc_10.42.42.6(pid=1740): Launched 00:18:23.180844 run osmo-stp_10.42.42.5(pid=1737): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1737)] 00:18:23.317220 run osmo-stp_10.42.42.5(pid=1737): stdout: | (launched: 2022-12-10_00:18:21.920654) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:18:23.453761 run osmo-stp_10.42.42.5(pid=1737): stderr: | 20221210001822114 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001822114 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001822114 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001822115 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001822115 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001822115 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001822115 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:18:23.589649 run osmo-stp_10.42.42.5(pid=1737): stdout: | (launched: 2022-12-10_00:18:21.920654) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:18:23.717793 run osmo-stp_10.42.42.5(pid=1737): stderr: | 20221210001822114 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001822114 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001822114 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001822115 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001822115 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001822115 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001822115 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:18:23.871528 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1737): Process ended prematurely: osmo-stp_10.42.42.5(pid=1737) [trial-2366↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1737)] [trial-2366↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 00:18:23.881168 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 00:18:23.909564 run osmo-hlr_10.42.42.2(pid=1734): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1734)] 00:18:23.959286 run osmo-hlr_10.42.42.2(pid=1734): stdout: | (launched: 2022-12-10_00:18:20.922796) 00:18:24.010730 run osmo-hlr_10.42.42.2(pid=1734): stderr: | 20221210001821124 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210001821124 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210001821124 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210001821124 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210001821125 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210001821125 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210001821138 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210001821148 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210001821149 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210001821149 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:18:24.082626 run osmo-msc_10.42.42.6(pid=1740): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1740)] 00:18:24.132297 run osmo-msc_10.42.42.6(pid=1740): stdout: | (launched: 2022-12-10_00:18:22.943247) 00:18:24.183478 run osmo-msc_10.42.42.6(pid=1740): stderr: | 20221210001823264 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210001823264 DLGLOBAL DEBUG validating counter group 0x7f55bb833c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210001823264 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210001823264 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210001823264 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210001823265 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210001823266 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210001823267 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210001823267 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210001823267 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:18:24.235087 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1733): Terminating (SIGTERM) 00:18:24.276840 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1736): Terminating (SIGTERM) 00:18:24.318198 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1739): Terminating (SIGTERM) 00:18:24.360000 --- ParallelTerminationStrategy: PID 1733 died... 00:18:24.379840 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1733): Terminated: ok {rc=0} 00:18:24.426564 --- ParallelTerminationStrategy: PID 1736 died... 00:18:24.445961 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1736): Terminated: ok {rc=0} 00:18:24.491953 --- ParallelTerminationStrategy: PID 1739 died... 00:18:24.511249 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1739): Terminated: ok {rc=0} 00:18:24.598674 bus /sierra_3: Setting Powered False 00:18:25.697291 bus /sierra_3: Setting Powered False 00:18:26.811144 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 00:18:28.068590 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:18:28.076785 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 00:18:28.110167 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 00:18:28.137366 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 00:18:28.191143 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 00:18:28.224684 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 00:18:28.252281 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 00:18:28.803228 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 00:18:28.855482 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:18:28.867101 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 00:18:28.934475 tst mo_mt_call.py: using LAC 24677 00:18:29.061437 tst mo_mt_call.py: using RAC 197 00:18:29.181291 tst mo_mt_call.py: using CellId 24677 00:18:29.298490 tst mo_mt_call.py: using BVCI 24678 00:18:29.408312 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:18:29.419742 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:18:29.430930 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:18:29.441945 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:18:29.453225 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:18:29.464462 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 00:18:29.578056 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 00:18:29.695253 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:18:30.192767 run create_hlr_db(pid=1745): Launched 00:18:30.315395 bus /sierra_2: Setting Powered False 00:18:31.375357 run create_hlr_db(pid=1745): Terminated: ok {rc=0} 00:18:31.856524 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1747): Launched 00:18:32.186683 run osmo-hlr_10.42.42.2(pid=1748): Launched 00:18:32.338570 run osmo-stp_10.42.42.5: Starting osmo-stp 00:18:32.892236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1750): Launched 00:18:33.212809 run osmo-stp_10.42.42.5(pid=1751): Launched 00:18:33.335274 run osmo-msc_10.42.42.6: Starting osmo-msc 00:18:33.917250 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1753): Launched 00:18:34.236282 run osmo-msc_10.42.42.6(pid=1754): Launched 00:18:34.414619 run osmo-stp_10.42.42.5(pid=1751): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1751)] 00:18:34.549871 run osmo-stp_10.42.42.5(pid=1751): stdout: | (launched: 2022-12-10_00:18:33.154532) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:18:34.685617 run osmo-stp_10.42.42.5(pid=1751): stderr: | 20221210001833348 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001833349 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001833349 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001833349 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001833350 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001833350 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001833350 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:18:34.820527 run osmo-stp_10.42.42.5(pid=1751): stdout: | (launched: 2022-12-10_00:18:33.154532) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:18:34.948729 run osmo-stp_10.42.42.5(pid=1751): stderr: | 20221210001833348 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001833349 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001833349 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001833349 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001833350 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001833350 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001833350 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:18:35.101644 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1751): Process ended prematurely: osmo-stp_10.42.42.5(pid=1751) [trial-2366↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1751)] [trial-2366↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 00:18:35.111341 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 00:18:35.139848 run osmo-hlr_10.42.42.2(pid=1748): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1748)] 00:18:35.189825 run osmo-hlr_10.42.42.2(pid=1748): stdout: | (launched: 2022-12-10_00:18:32.120196) 00:18:35.241275 run osmo-hlr_10.42.42.2(pid=1748): stderr: | 20221210001832340 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210001832340 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210001832340 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210001832340 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210001832340 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210001832340 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210001832353 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210001832361 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210001832362 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210001832362 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:18:35.313038 run osmo-msc_10.42.42.6(pid=1754): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1754)] 00:18:35.362863 run osmo-msc_10.42.42.6(pid=1754): stdout: | (launched: 2022-12-10_00:18:34.178325) 00:18:35.414651 run osmo-msc_10.42.42.6(pid=1754): stderr: | 20221210001834499 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210001834499 DLGLOBAL DEBUG validating counter group 0x7f6f2e6a0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210001834499 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210001834500 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210001834500 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210001834500 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210001834503 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210001834504 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210001834504 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210001834504 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:18:35.466546 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1747): Terminating (SIGTERM) 00:18:35.507938 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1750): Terminating (SIGTERM) 00:18:35.549723 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1753): Terminating (SIGTERM) 00:18:35.591758 --- ParallelTerminationStrategy: PID 1747 died... 00:18:35.611649 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1747): Terminated: ok {rc=0} 00:18:35.658934 --- ParallelTerminationStrategy: PID 1750 died... 00:18:35.678694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1750): Terminated: ok {rc=0} 00:18:35.725202 --- ParallelTerminationStrategy: PID 1753 died... 00:18:35.744581 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1753): Terminated: ok {rc=0} 00:18:35.832313 bus /sierra_3: Setting Powered False 00:18:36.930401 bus /sierra_3: Setting Powered False 00:18:38.046903 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 00:18:39.193057 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:18:39.205030 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 00:18:39.276655 tst mo_mt_call_osmux.py: using LAC 24678 00:18:39.394935 tst mo_mt_call_osmux.py: using RAC 198 00:18:39.511813 tst mo_mt_call_osmux.py: using CellId 24678 00:18:39.629095 tst mo_mt_call_osmux.py: using BVCI 24679 00:18:39.738327 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:18:39.749719 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:18:39.760612 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:18:39.772075 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:18:39.783662 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 00:18:39.795192 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 00:18:39.910956 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 00:18:40.031306 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:18:40.531420 run create_hlr_db(pid=1756): Launched 00:18:40.653680 bus /sierra_2: Setting Powered False 00:18:41.718055 run create_hlr_db(pid=1756): Terminated: ok {rc=0} 00:18:42.149015 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1758): Launched 00:18:42.449470 run osmo-hlr_10.42.42.2(pid=1759): Launched 00:18:42.564396 run osmo-stp_10.42.42.5: Starting osmo-stp 00:18:43.082104 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1761): Launched 00:18:43.379880 run osmo-stp_10.42.42.5(pid=1762): Launched 00:18:43.493122 run osmo-msc_10.42.42.6: Starting osmo-msc 00:18:44.035743 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1764): Launched 00:18:44.334177 run osmo-msc_10.42.42.6(pid=1765): Launched 00:18:44.515584 run osmo-stp_10.42.42.5(pid=1762): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1762)] 00:18:44.652336 run osmo-stp_10.42.42.5(pid=1762): stdout: | (launched: 2022-12-10_00:18:43.325262) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:18:44.791993 run osmo-stp_10.42.42.5(pid=1762): stderr: | 20221210001843498 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001843498 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001843499 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001843499 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001843499 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001843499 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001843499 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:18:44.928362 run osmo-stp_10.42.42.5(pid=1762): stdout: | (launched: 2022-12-10_00:18:43.325262) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:18:45.056720 run osmo-stp_10.42.42.5(pid=1762): stderr: | 20221210001843498 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001843498 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001843499 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001843499 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001843499 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001843499 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001843499 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:18:45.210360 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1762): Process ended prematurely: osmo-stp_10.42.42.5(pid=1762) [trial-2366↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1762)] [trial-2366↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 00:18:45.220034 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 00:18:45.248592 run osmo-hlr_10.42.42.2(pid=1759): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1759)] 00:18:45.299966 run osmo-hlr_10.42.42.2(pid=1759): stdout: | (launched: 2022-12-10_00:18:42.394556) 00:18:45.352387 run osmo-hlr_10.42.42.2(pid=1759): stderr: | 20221210001842569 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210001842569 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210001842569 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210001842569 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210001842569 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210001842569 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210001842582 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210001842591 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210001842591 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210001842591 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:18:45.424662 run osmo-msc_10.42.42.6(pid=1765): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1765)] 00:18:45.474634 run osmo-msc_10.42.42.6(pid=1765): stdout: | (launched: 2022-12-10_00:18:44.279127) 00:18:45.526237 run osmo-msc_10.42.42.6(pid=1765): stderr: | 20221210001844598 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210001844598 DLGLOBAL DEBUG validating counter group 0x7fd7b68d7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210001844598 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210001844598 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210001844598 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210001844599 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210001844600 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210001844601 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210001844601 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210001844601 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:18:45.578300 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1758): Terminating (SIGTERM) 00:18:45.620212 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1761): Terminating (SIGTERM) 00:18:45.662031 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1764): Terminating (SIGTERM) 00:18:45.704257 --- ParallelTerminationStrategy: PID 1758 died... 00:18:45.724197 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1758): Terminated: ok {rc=0} 00:18:45.771450 --- ParallelTerminationStrategy: PID 1761 died... 00:18:45.791135 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1761): Terminated: ok {rc=0} 00:18:45.842580 --- ParallelTerminationStrategy: PID 1764 died... 00:18:45.864574 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1764): Terminated: ok {rc=0} 00:18:45.974802 bus /sierra_3: Setting Powered False 00:18:47.070713 bus /sierra_3: Setting Powered False 00:18:48.184383 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 00:18:49.436638 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:18:49.445140 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 00:18:49.479450 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 00:18:49.507164 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 00:18:49.559594 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 00:18:49.592551 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 00:18:49.620263 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 00:18:50.173658 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 00:18:50.226289 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:18:50.238303 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 00:18:50.305354 tst mo_mt_call.py: using LAC 24679 00:18:50.430568 tst mo_mt_call.py: using RAC 199 00:18:50.555879 tst mo_mt_call.py: using CellId 24679 00:18:50.684569 tst mo_mt_call.py: using BVCI 24680 00:18:50.802534 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:18:50.814185 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:18:50.825657 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:18:50.837450 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:18:50.849431 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:18:50.861546 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 00:18:50.976506 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 00:18:51.096615 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:18:51.593651 run create_hlr_db(pid=1771): Launched 00:18:51.716286 bus /sierra_2: Setting Powered False 00:18:52.780756 run create_hlr_db(pid=1771): Terminated: ok {rc=0} 00:18:53.210521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1773): Launched 00:18:53.510150 run osmo-hlr_10.42.42.2(pid=1774): Launched 00:18:53.625188 run osmo-stp_10.42.42.5: Starting osmo-stp 00:18:54.139901 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1776): Launched 00:18:54.437722 run osmo-stp_10.42.42.5(pid=1777): Launched 00:18:54.550516 run osmo-msc_10.42.42.6: Starting osmo-msc 00:18:55.092520 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1780): Launched 00:18:55.391489 run osmo-msc_10.42.42.6(pid=1781): Launched 00:18:55.559218 run osmo-stp_10.42.42.5(pid=1777): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1777)] 00:18:55.686161 run osmo-stp_10.42.42.5(pid=1777): stdout: | (launched: 2022-12-10_00:18:54.382980) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:18:55.813392 run osmo-stp_10.42.42.5(pid=1777): stderr: | 20221210001854553 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001854553 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001854554 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001854554 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001854554 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001854555 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001854555 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:18:55.937969 run osmo-stp_10.42.42.5(pid=1777): stdout: | (launched: 2022-12-10_00:18:54.382980) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:18:56.057075 run osmo-stp_10.42.42.5(pid=1777): stderr: | 20221210001854553 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001854553 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001854554 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001854554 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001854554 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001854555 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001854555 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:18:56.199233 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1777): Process ended prematurely: osmo-stp_10.42.42.5(pid=1777) [trial-2366↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1777)] [trial-2366↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 00:18:56.208044 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 00:18:56.234255 run osmo-hlr_10.42.42.2(pid=1774): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1774)] 00:18:56.281326 run osmo-hlr_10.42.42.2(pid=1774): stdout: | (launched: 2022-12-10_00:18:53.455474) 00:18:56.330190 run osmo-hlr_10.42.42.2(pid=1774): stderr: | 20221210001853632 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210001853632 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210001853632 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210001853632 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210001853632 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210001853632 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210001853644 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210001853653 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210001853653 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210001853653 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:18:56.398615 run osmo-msc_10.42.42.6(pid=1781): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1781)] 00:18:56.445818 run osmo-msc_10.42.42.6(pid=1781): stdout: | (launched: 2022-12-10_00:18:55.336470) 00:18:56.494652 run osmo-msc_10.42.42.6(pid=1781): stderr: | 20221210001855611 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210001855611 DLGLOBAL DEBUG validating counter group 0x7f97ac690c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210001855611 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210001855611 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210001855611 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210001855611 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210001855613 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210001855614 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210001855614 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210001855614 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:18:56.543827 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1773): Terminating (SIGTERM) 00:18:56.583544 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1776): Terminating (SIGTERM) 00:18:56.622421 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1780): Terminating (SIGTERM) 00:18:56.661743 --- ParallelTerminationStrategy: PID 1773 died... 00:18:56.680634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1773): Terminated: ok {rc=0} 00:18:56.724125 --- ParallelTerminationStrategy: PID 1776 died... 00:18:56.742765 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1776): Terminated: ok {rc=0} 00:18:56.786237 --- ParallelTerminationStrategy: PID 1780 died... 00:18:56.804711 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1780): Terminated: ok {rc=0} 00:18:56.889235 bus /sierra_3: Setting Powered False 00:18:57.988579 bus /sierra_3: Setting Powered False 00:18:59.104280 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 00:19:00.251435 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:19:00.263840 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 00:19:00.332834 tst mo_mt_call_osmux.py: using LAC 24680 00:19:00.460319 tst mo_mt_call_osmux.py: using RAC 200 00:19:00.586718 tst mo_mt_call_osmux.py: using CellId 24680 00:19:00.706169 tst mo_mt_call_osmux.py: using BVCI 24681 00:19:00.817549 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:19:00.828698 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:19:00.845582 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:19:00.865133 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:19:00.879011 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 00:19:00.892755 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 00:19:01.049223 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 00:19:01.199816 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:19:01.745325 run create_hlr_db(pid=1783): Launched 00:19:01.916922 bus /sierra_2: Setting Powered False 00:19:02.980793 run create_hlr_db(pid=1783): Terminated: ok {rc=0} 00:19:03.480776 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1785): Launched 00:19:03.782289 run osmo-hlr_10.42.42.2(pid=1786): Launched 00:19:03.898156 run osmo-stp_10.42.42.5: Starting osmo-stp 00:19:04.428411 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1788): Launched 00:19:04.727959 run osmo-stp_10.42.42.5(pid=1789): Launched 00:19:04.841350 run osmo-msc_10.42.42.6: Starting osmo-msc 00:19:05.382222 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1791): Launched 00:19:05.681975 run osmo-msc_10.42.42.6(pid=1792): Launched 00:19:05.849255 run osmo-stp_10.42.42.5(pid=1789): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1789)] 00:19:05.977127 run osmo-stp_10.42.42.5(pid=1789): stdout: | (launched: 2022-12-10_00:19:04.672936) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:19:06.104234 run osmo-stp_10.42.42.5(pid=1789): stderr: | 20221210001904841 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001904841 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001904841 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001904842 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001904844 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001904844 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001904844 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:19:06.228845 run osmo-stp_10.42.42.5(pid=1789): stdout: | (launched: 2022-12-10_00:19:04.672936) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:19:06.348101 run osmo-stp_10.42.42.5(pid=1789): stderr: | 20221210001904841 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001904841 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001904841 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001904842 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001904844 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001904844 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001904844 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:19:06.490923 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1789): Process ended prematurely: osmo-stp_10.42.42.5(pid=1789) [trial-2366↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1789)] [trial-2366↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 00:19:06.499886 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 00:19:06.526236 run osmo-hlr_10.42.42.2(pid=1786): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1786)] 00:19:06.573572 run osmo-hlr_10.42.42.2(pid=1786): stdout: | (launched: 2022-12-10_00:19:03.726897) 00:19:06.622161 run osmo-hlr_10.42.42.2(pid=1786): stderr: | 20221210001903902 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210001903902 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210001903902 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210001903902 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210001903902 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210001903902 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210001903915 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210001903924 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210001903924 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210001903924 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:19:06.690567 run osmo-msc_10.42.42.6(pid=1792): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1792)] 00:19:06.737481 run osmo-msc_10.42.42.6(pid=1792): stdout: | (launched: 2022-12-10_00:19:05.626874) 00:19:06.786119 run osmo-msc_10.42.42.6(pid=1792): stderr: | 20221210001905900 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210001905900 DLGLOBAL DEBUG validating counter group 0x7f12537fdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210001905900 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210001905900 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210001905900 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210001905901 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210001905902 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210001905903 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210001905903 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210001905903 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:19:06.835065 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1785): Terminating (SIGTERM) 00:19:06.874628 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1788): Terminating (SIGTERM) 00:19:06.914252 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1791): Terminating (SIGTERM) 00:19:06.954075 --- ParallelTerminationStrategy: PID 1785 died... 00:19:06.972934 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1785): Terminated: ok {rc=0} 00:19:07.017318 --- ParallelTerminationStrategy: PID 1788 died... 00:19:07.035960 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1788): Terminated: ok {rc=0} 00:19:07.079722 --- ParallelTerminationStrategy: PID 1791 died... 00:19:07.098392 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1791): Terminated: ok {rc=0} 00:19:07.184077 bus /sierra_3: Setting Powered False 00:19:08.283962 bus /sierra_3: Setting Powered False 00:19:09.397543 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 00:19:10.644620 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:19:10.651734 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 00:19:10.683285 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 00:19:10.709405 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 00:19:10.762199 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 00:19:10.793988 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 00:19:10.820064 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 00:19:11.372009 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 00:19:11.419852 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:19:11.431143 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 00:19:11.496793 tst mo_mt_call.py: using LAC 24681 00:19:11.613360 tst mo_mt_call.py: using RAC 201 00:19:11.730860 tst mo_mt_call.py: using CellId 24681 00:19:11.851036 tst mo_mt_call.py: using BVCI 24682 00:19:11.962052 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:19:11.973328 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:19:11.984321 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:19:11.995576 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:19:12.006695 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:19:12.018118 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 00:19:12.136363 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 00:19:12.254119 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:19:12.719108 run create_hlr_db(pid=1797): Launched 00:19:12.842121 bus /sierra_2: Setting Powered False 00:19:13.902581 run create_hlr_db(pid=1797): Terminated: ok {rc=0} 00:19:14.342044 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1799): Launched 00:19:14.663683 run osmo-hlr_10.42.42.2(pid=1800): Launched 00:19:14.787642 run osmo-stp_10.42.42.5: Starting osmo-stp 00:19:15.344358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1802): Launched 00:19:15.665435 run osmo-stp_10.42.42.5(pid=1803): Launched 00:19:15.788583 run osmo-msc_10.42.42.6: Starting osmo-msc 00:19:16.503468 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1805): Launched 00:19:16.843090 run osmo-msc_10.42.42.6(pid=1806): Launched 00:19:17.181127 run osmo-stp_10.42.42.5(pid=1803): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1803)] 00:19:17.317600 run osmo-stp_10.42.42.5(pid=1803): stdout: | (launched: 2022-12-10_00:19:15.607009) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:19:17.454016 run osmo-stp_10.42.42.5(pid=1803): stderr: | 20221210001915799 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001915799 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001915799 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001915800 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001915800 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001915800 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001915800 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:19:17.589255 run osmo-stp_10.42.42.5(pid=1803): stdout: | (launched: 2022-12-10_00:19:15.607009) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:19:17.717726 run osmo-stp_10.42.42.5(pid=1803): stderr: | 20221210001915799 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001915799 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001915799 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001915800 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001915800 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001915800 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001915800 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:19:17.871240 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1803): Process ended prematurely: osmo-stp_10.42.42.5(pid=1803) [trial-2366↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1803)] [trial-2366↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 00:19:17.880839 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 00:19:17.909606 run osmo-hlr_10.42.42.2(pid=1800): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1800)] 00:19:17.959929 run osmo-hlr_10.42.42.2(pid=1800): stdout: | (launched: 2022-12-10_00:19:14.605408) 00:19:18.012063 run osmo-hlr_10.42.42.2(pid=1800): stderr: | 20221210001914802 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210001914802 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210001914802 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210001914802 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210001914802 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210001914802 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210001914817 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210001914826 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210001914826 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210001914826 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:19:18.084538 run osmo-msc_10.42.42.6(pid=1806): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1806)] 00:19:18.134727 run osmo-msc_10.42.42.6(pid=1806): stdout: | (launched: 2022-12-10_00:19:16.779843) 00:19:18.186694 run osmo-msc_10.42.42.6(pid=1806): stderr: | 20221210001917227 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210001917228 DLGLOBAL DEBUG validating counter group 0x7f5333066c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210001917228 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210001917228 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210001917228 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210001917228 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210001917230 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210001917230 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210001917230 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210001917231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:19:18.238730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1799): Terminating (SIGTERM) 00:19:18.280641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1802): Terminating (SIGTERM) 00:19:18.322874 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1805): Terminating (SIGTERM) 00:19:18.365389 --- ParallelTerminationStrategy: PID 1799 died... 00:19:18.385634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1799): Terminated: ok {rc=0} 00:19:18.432937 --- ParallelTerminationStrategy: PID 1802 died... 00:19:18.452785 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1802): Terminated: ok {rc=0} 00:19:18.499807 --- ParallelTerminationStrategy: PID 1805 died... 00:19:18.519632 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1805): Terminated: ok {rc=0} 00:19:18.609052 bus /sierra_3: Setting Powered False 00:19:19.706552 bus /sierra_3: Setting Powered False 00:19:20.821774 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 00:19:21.970395 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:19:21.982866 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 00:19:22.055237 tst mo_mt_call_osmux.py: using LAC 24682 00:19:22.180751 tst mo_mt_call_osmux.py: using RAC 202 00:19:22.305170 tst mo_mt_call_osmux.py: using CellId 24682 00:19:22.432524 tst mo_mt_call_osmux.py: using BVCI 24683 00:19:22.550112 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:19:22.561795 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:19:22.573224 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:19:22.585404 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:19:22.597614 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 00:19:22.609821 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 00:19:22.732114 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 00:19:22.849879 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:19:23.317137 run create_hlr_db(pid=1808): Launched 00:19:23.439988 bus /sierra_2: Setting Powered False 00:19:24.500613 run create_hlr_db(pid=1808): Terminated: ok {rc=0} 00:19:24.940214 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1810): Launched 00:19:25.261170 run osmo-hlr_10.42.42.2(pid=1811): Launched 00:19:25.383482 run osmo-stp_10.42.42.5: Starting osmo-stp 00:19:25.941465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1813): Launched 00:19:26.262643 run osmo-stp_10.42.42.5(pid=1815): Launched 00:19:26.384920 run osmo-msc_10.42.42.6: Starting osmo-msc 00:19:26.964529 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1817): Launched 00:19:27.285123 run osmo-msc_10.42.42.6(pid=1818): Launched 00:19:27.463281 run osmo-stp_10.42.42.5(pid=1815): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1815)] 00:19:27.600439 run osmo-stp_10.42.42.5(pid=1815): stdout: | (launched: 2022-12-10_00:19:26.204130) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:19:27.736772 run osmo-stp_10.42.42.5(pid=1815): stderr: | 20221210001926396 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001926396 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001926397 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001926397 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001926397 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001926398 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001926398 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:19:27.872497 run osmo-stp_10.42.42.5(pid=1815): stdout: | (launched: 2022-12-10_00:19:26.204130) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:19:28.000725 run osmo-stp_10.42.42.5(pid=1815): stderr: | 20221210001926396 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001926396 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001926397 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001926397 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001926397 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001926398 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001926398 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:19:28.154473 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1815): Process ended prematurely: osmo-stp_10.42.42.5(pid=1815) [trial-2366↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1815)] [trial-2366↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 00:19:28.164140 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 00:19:28.192562 run osmo-hlr_10.42.42.2(pid=1811): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1811)] 00:19:28.242647 run osmo-hlr_10.42.42.2(pid=1811): stdout: | (launched: 2022-12-10_00:19:25.202499) 00:19:28.294117 run osmo-hlr_10.42.42.2(pid=1811): stderr: | 20221210001925403 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210001925403 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210001925403 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210001925403 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210001925403 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210001925403 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210001925415 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210001925423 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210001925424 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210001925424 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:19:28.366159 run osmo-msc_10.42.42.6(pid=1818): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1818)] 00:19:28.415819 run osmo-msc_10.42.42.6(pid=1818): stdout: | (launched: 2022-12-10_00:19:27.226542) 00:19:28.467472 run osmo-msc_10.42.42.6(pid=1818): stderr: | 20221210001927551 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210001927551 DLGLOBAL DEBUG validating counter group 0x7f46d90b3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210001927551 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210001927551 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210001927551 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210001927552 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210001927553 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210001927554 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210001927554 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210001927554 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:19:28.519425 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1810): Terminating (SIGTERM) 00:19:28.561453 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1813): Terminating (SIGTERM) 00:19:28.603459 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1817): Terminating (SIGTERM) 00:19:28.645639 --- ParallelTerminationStrategy: PID 1810 died... 00:19:28.665635 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1810): Terminated: ok {rc=0} 00:19:28.712550 --- ParallelTerminationStrategy: PID 1813 died... 00:19:28.732297 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1813): Terminated: ok {rc=0} 00:19:28.778784 --- ParallelTerminationStrategy: PID 1817 died... 00:19:28.798416 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1817): Terminated: ok {rc=0} 00:19:28.886300 bus /sierra_3: Setting Powered False 00:19:29.984735 bus /sierra_3: Setting Powered False 00:19:31.098344 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 00:19:32.352235 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:19:32.359539 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 00:19:32.391511 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 00:19:32.418088 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 00:19:32.467364 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 00:19:32.499147 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 00:19:32.525571 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 00:19:33.084823 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 00:19:33.138872 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:19:33.150814 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 00:19:33.218119 tst mo_mt_call.py: using LAC 24683 00:19:33.342747 tst mo_mt_call.py: using RAC 203 00:19:33.470499 tst mo_mt_call.py: using CellId 24683 00:19:33.598869 tst mo_mt_call.py: using BVCI 24684 00:19:33.715744 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:19:33.727408 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:19:33.738924 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:19:33.751249 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:19:33.763540 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:19:33.776838 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:19:33.895710 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:19:34.017505 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:19:34.514268 run create_hlr_db(pid=1824): Launched 00:19:34.635392 bus /sierra_2: Setting Powered False 00:19:35.700067 run create_hlr_db(pid=1824): Terminated: ok {rc=0} 00:19:36.129505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1826): Launched 00:19:36.430035 run osmo-hlr_10.42.42.2(pid=1827): Launched 00:19:36.544279 run osmo-stp_10.42.42.5: Starting osmo-stp 00:19:37.078454 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1829): Launched 00:19:37.377378 run osmo-stp_10.42.42.5(pid=1830): Launched 00:19:37.491090 run osmo-msc_10.42.42.6: Starting osmo-msc 00:19:38.034597 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1832): Launched 00:19:38.333426 run osmo-msc_10.42.42.6(pid=1833): Launched 00:19:38.502893 run osmo-stp_10.42.42.5(pid=1830): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1830)] 00:19:38.630271 run osmo-stp_10.42.42.5(pid=1830): stdout: | (launched: 2022-12-10_00:19:37.322243) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:19:38.756767 run osmo-stp_10.42.42.5(pid=1830): stderr: | 20221210001937494 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001937494 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001937494 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001937495 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001937495 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001937495 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001937495 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:19:38.881152 run osmo-stp_10.42.42.5(pid=1830): stdout: | (launched: 2022-12-10_00:19:37.322243) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:19:39.000130 run osmo-stp_10.42.42.5(pid=1830): stderr: | 20221210001937494 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001937494 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001937494 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001937495 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001937495 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001937495 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001937495 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:19:39.142782 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1830): Process ended prematurely: osmo-stp_10.42.42.5(pid=1830) [trial-2366↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1830)] [trial-2366↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 00:19:39.151401 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 00:19:39.177466 run osmo-hlr_10.42.42.2(pid=1827): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1827)] 00:19:39.224093 run osmo-hlr_10.42.42.2(pid=1827): stdout: | (launched: 2022-12-10_00:19:36.375323) 00:19:39.272295 run osmo-hlr_10.42.42.2(pid=1827): stderr: | 20221210001936550 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210001936550 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210001936550 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210001936550 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210001936550 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210001936550 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210001936562 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210001936571 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210001936572 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210001936572 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:19:39.340366 run osmo-msc_10.42.42.6(pid=1833): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1833)] 00:19:39.387094 run osmo-msc_10.42.42.6(pid=1833): stdout: | (launched: 2022-12-10_00:19:38.278503) 00:19:39.435436 run osmo-msc_10.42.42.6(pid=1833): stderr: | 20221210001938548 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210001938548 DLGLOBAL DEBUG validating counter group 0x7fa702e15c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210001938549 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210001938549 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210001938549 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210001938549 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210001938551 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210001938551 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210001938551 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210001938551 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:19:39.484520 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1826): Terminating (SIGTERM) 00:19:39.523395 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1829): Terminating (SIGTERM) 00:19:39.562105 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1832): Terminating (SIGTERM) 00:19:39.601426 --- ParallelTerminationStrategy: PID 1826 died... 00:19:39.620213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1826): Terminated: ok {rc=0} 00:19:39.663418 --- ParallelTerminationStrategy: PID 1829 died... 00:19:39.681895 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1829): Terminated: ok {rc=0} 00:19:39.725190 --- ParallelTerminationStrategy: PID 1832 died... 00:19:39.743508 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1832): Terminated: ok {rc=0} 00:19:39.827859 bus /sierra_3: Setting Powered False 00:19:40.928420 bus /sierra_3: Setting Powered False 00:19:42.044296 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 00:19:43.190330 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:19:43.202117 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 00:19:43.268514 tst mo_mt_call_osmux.py: using LAC 24684 00:19:43.386431 tst mo_mt_call_osmux.py: using RAC 204 00:19:43.505281 tst mo_mt_call_osmux.py: using CellId 24684 00:19:43.622959 tst mo_mt_call_osmux.py: using BVCI 24685 00:19:43.733603 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:19:43.744875 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:19:43.755913 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:19:43.766850 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:19:43.777909 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 00:19:43.788926 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:19:43.903154 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:19:44.022162 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:19:44.487957 run create_hlr_db(pid=1835): Launched 00:19:44.610008 bus /sierra_2: Setting Powered False 00:19:45.670240 run create_hlr_db(pid=1835): Terminated: ok {rc=0} 00:19:46.120834 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1837): Launched 00:19:46.437666 run osmo-hlr_10.42.42.2(pid=1838): Launched 00:19:46.660217 run osmo-stp_10.42.42.5: Starting osmo-stp 00:19:47.382660 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1840): Launched 00:19:47.713230 run osmo-stp_10.42.42.5(pid=1841): Launched 00:19:47.836088 run osmo-msc_10.42.42.6: Starting osmo-msc 00:19:48.416900 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1843): Launched 00:19:48.736857 run osmo-msc_10.42.42.6(pid=1844): Launched 00:19:48.915551 run osmo-stp_10.42.42.5(pid=1841): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1841)] 00:19:49.051559 run osmo-stp_10.42.42.5(pid=1841): stdout: | (launched: 2022-12-10_00:19:47.654191) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:19:49.187954 run osmo-stp_10.42.42.5(pid=1841): stderr: | 20221210001947844 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001947845 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001947845 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001947845 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001947846 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001947846 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001947846 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:19:49.323566 run osmo-stp_10.42.42.5(pid=1841): stdout: | (launched: 2022-12-10_00:19:47.654191) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:19:49.451478 run osmo-stp_10.42.42.5(pid=1841): stderr: | 20221210001947844 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001947845 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001947845 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001947845 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001947846 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001947846 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001947846 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:19:49.605207 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1841): Process ended prematurely: osmo-stp_10.42.42.5(pid=1841) [trial-2366↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1841)] [trial-2366↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 00:19:49.615030 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 00:19:49.643751 run osmo-hlr_10.42.42.2(pid=1838): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1838)] 00:19:49.694211 run osmo-hlr_10.42.42.2(pid=1838): stdout: | (launched: 2022-12-10_00:19:46.373956) 00:19:49.746399 run osmo-hlr_10.42.42.2(pid=1838): stderr: | 20221210001946616 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210001946616 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210001946616 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210001946616 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210001946616 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210001946616 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210001946631 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210001946652 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210001946658 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210001946660 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:19:49.819064 run osmo-msc_10.42.42.6(pid=1844): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1844)] 00:19:49.869458 run osmo-msc_10.42.42.6(pid=1844): stdout: | (launched: 2022-12-10_00:19:48.678445) 00:19:49.921686 run osmo-msc_10.42.42.6(pid=1844): stderr: | 20221210001948998 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210001948998 DLGLOBAL DEBUG validating counter group 0x7f330575fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210001948998 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210001948998 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210001948998 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210001948999 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210001949000 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210001949001 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210001949001 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210001949001 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:19:49.974201 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1837): Terminating (SIGTERM) 00:19:50.016026 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1840): Terminating (SIGTERM) 00:19:50.058017 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1843): Terminating (SIGTERM) 00:19:50.100225 --- ParallelTerminationStrategy: PID 1837 died... 00:19:50.120252 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1837): Terminated: ok {rc=0} 00:19:50.167131 --- ParallelTerminationStrategy: PID 1840 died... 00:19:50.186816 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1840): Terminated: ok {rc=0} 00:19:50.233377 --- ParallelTerminationStrategy: PID 1843 died... 00:19:50.253358 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1843): Terminated: ok {rc=0} 00:19:50.341716 bus /sierra_3: Setting Powered False 00:19:51.440407 bus /sierra_3: Setting Powered False 00:19:52.557862 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 00:19:53.806665 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:19:53.813624 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 00:19:53.845453 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 00:19:53.871897 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 00:19:53.922523 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 00:19:53.954205 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 00:19:53.980484 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 00:19:54.534835 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 00:19:54.582877 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 00:19:54.594258 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 00:19:54.643073 tst mo_mt_call.py: using LAC 24685 00:19:54.761729 tst mo_mt_call.py: using RAC 205 00:19:54.879177 tst mo_mt_call.py: using CellId 24685 00:19:55.006874 tst mo_mt_call.py: using BVCI 24686 00:19:55.123431 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 00:19:55.135438 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 00:19:55.147219 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 00:19:55.159119 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 00:19:55.171140 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 00:19:55.182875 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 00:19:55.297565 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 00:19:55.414009 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:19:55.878183 run create_hlr_db(pid=1850): Launched 00:19:56.000331 bus /sierra_2: Setting Powered False 00:19:57.061108 run create_hlr_db(pid=1850): Terminated: ok {rc=0} 00:19:57.500690 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1852): Launched 00:19:57.821606 run osmo-hlr_10.42.42.2(pid=1853): Launched 00:19:57.944891 run osmo-stp_10.42.42.5: Starting osmo-stp 00:19:58.498825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1855): Launched 00:19:58.818644 run osmo-stp_10.42.42.5(pid=1856): Launched 00:19:58.941334 run osmo-msc_10.42.42.6: Starting osmo-msc 00:19:59.524269 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1858): Launched 00:19:59.844422 run osmo-msc_10.42.42.6(pid=1859): Launched 00:20:00.023520 run osmo-stp_10.42.42.5(pid=1856): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1856)] 00:20:00.160307 run osmo-stp_10.42.42.5(pid=1856): stdout: | (launched: 2022-12-10_00:19:58.760534) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:20:00.297468 run osmo-stp_10.42.42.5(pid=1856): stderr: | 20221210001958953 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001958953 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001958953 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001958954 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001958954 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001958954 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001958954 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:20:00.433536 run osmo-stp_10.42.42.5(pid=1856): stdout: | (launched: 2022-12-10_00:19:58.760534) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:20:00.561879 run osmo-stp_10.42.42.5(pid=1856): stderr: | 20221210001958953 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210001958953 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210001958953 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210001958954 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210001958954 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210001958954 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210001958954 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:20:00.715508 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1856): Process ended prematurely: osmo-stp_10.42.42.5(pid=1856) [trial-2366↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1856)] [trial-2366↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 00:20:00.725074 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 00:20:00.753481 run osmo-hlr_10.42.42.2(pid=1853): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1853)] 00:20:00.803798 run osmo-hlr_10.42.42.2(pid=1853): stdout: | (launched: 2022-12-10_00:19:57.763411) 00:20:00.858144 run osmo-hlr_10.42.42.2(pid=1853): stderr: | 20221210001957960 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210001957960 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210001957960 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210001957960 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210001957960 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210001957960 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210001957977 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210001957986 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210001957986 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210001957986 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:20:00.947280 run osmo-msc_10.42.42.6(pid=1859): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1859)] 00:20:00.998838 run osmo-msc_10.42.42.6(pid=1859): stdout: | (launched: 2022-12-10_00:19:59.785932) 00:20:01.050540 run osmo-msc_10.42.42.6(pid=1859): stderr: | 20221210002000107 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210002000107 DLGLOBAL DEBUG validating counter group 0x7fe469613c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210002000107 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210002000107 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210002000107 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210002000108 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210002000109 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210002000110 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210002000110 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210002000110 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:20:01.103084 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1852): Terminating (SIGTERM) 00:20:01.145345 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1855): Terminating (SIGTERM) 00:20:01.188843 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1858): Terminating (SIGTERM) 00:20:01.233742 --- ParallelTerminationStrategy: PID 1852 died... 00:20:01.253252 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1852): Terminated: ok {rc=0} 00:20:01.302389 --- ParallelTerminationStrategy: PID 1855 died... 00:20:01.322069 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1855): Terminated: ok {rc=0} 00:20:01.369834 --- ParallelTerminationStrategy: PID 1858 died... 00:20:01.389596 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1858): Terminated: ok {rc=0} 00:20:01.482050 bus /sierra_3: Setting Powered False 00:20:02.591247 bus /sierra_3: Setting Powered False 00:20:03.708941 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 00:20:04.857731 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 00:20:04.870325 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 00:20:04.922807 tst mo_mt_call_osmux.py: using LAC 24686 00:20:05.050286 tst mo_mt_call_osmux.py: using RAC 206 00:20:05.178231 tst mo_mt_call_osmux.py: using CellId 24686 00:20:05.304159 tst mo_mt_call_osmux.py: using BVCI 24687 00:20:05.422773 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 00:20:05.434789 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 00:20:05.446535 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 00:20:05.458450 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 00:20:05.470567 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 00:20:05.482502 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 00:20:05.602917 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 00:20:05.724135 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:20:06.222067 run create_hlr_db(pid=1864): Launched 00:20:06.343624 bus /sierra_2: Setting Powered False 00:20:07.408098 run create_hlr_db(pid=1864): Terminated: ok {rc=0} 00:20:07.838668 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1866): Launched 00:20:08.138666 run osmo-hlr_10.42.42.2(pid=1867): Launched 00:20:08.252858 run osmo-stp_10.42.42.5: Starting osmo-stp 00:20:08.783514 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1869): Launched 00:20:09.081944 run osmo-stp_10.42.42.5(pid=1870): Launched 00:20:09.196896 run osmo-msc_10.42.42.6: Starting osmo-msc 00:20:09.738548 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1872): Launched 00:20:10.037956 run osmo-msc_10.42.42.6(pid=1873): Launched 00:20:10.205168 run osmo-stp_10.42.42.5(pid=1870): ERR: Terminated: ERROR {rc=1} [trial-2366↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1870)] 00:20:10.331511 run osmo-stp_10.42.42.5(pid=1870): stdout: | (launched: 2022-12-10_00:20:09.026953) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:20:10.458612 run osmo-stp_10.42.42.5(pid=1870): stderr: | 20221210002009196 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002009197 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002009197 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002009197 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002009199 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002009200 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002009200 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:20:10.583279 run osmo-stp_10.42.42.5(pid=1870): stdout: | (launched: 2022-12-10_00:20:09.026953) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:20:10.702313 run osmo-stp_10.42.42.5(pid=1870): stderr: | 20221210002009196 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002009197 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002009197 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002009197 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002009199 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002009200 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002009200 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:20:10.844915 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1870): Process ended prematurely: osmo-stp_10.42.42.5(pid=1870) [trial-2366↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1870)] [trial-2366↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 00:20:10.853903 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 00:20:10.880203 run osmo-hlr_10.42.42.2(pid=1867): ERR: Terminated: ERROR {rc=237} [trial-2366↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1867)] 00:20:10.927605 run osmo-hlr_10.42.42.2(pid=1867): stdout: | (launched: 2022-12-10_00:20:08.083451) 00:20:10.976849 run osmo-hlr_10.42.42.2(pid=1867): stderr: | 20221210002008261 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210002008261 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210002008261 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210002008261 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210002008261 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210002008261 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210002008273 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210002008282 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210002008282 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210002008282 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:20:11.045791 run osmo-msc_10.42.42.6(pid=1873): ERR: Terminated: ERROR {rc=2} [trial-2366↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1873)] 00:20:11.093337 run osmo-msc_10.42.42.6(pid=1873): stdout: | (launched: 2022-12-10_00:20:09.982511) 00:20:11.142214 run osmo-msc_10.42.42.6(pid=1873): stderr: | 20221210002010255 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210002010257 DLGLOBAL DEBUG validating counter group 0x7f095e80dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210002010257 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210002010257 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210002010257 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210002010257 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210002010259 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210002010259 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210002010260 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210002010260 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:20:11.191636 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1866): Terminating (SIGTERM) 00:20:11.231157 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1869): Terminating (SIGTERM) 00:20:11.270614 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1872): Terminating (SIGTERM) 00:20:11.310441 --- ParallelTerminationStrategy: PID 1866 died... 00:20:11.329543 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1866): Terminated: ok {rc=0} 00:20:11.373418 --- ParallelTerminationStrategy: PID 1869 died... 00:20:11.391875 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1869): Terminated: ok {rc=0} 00:20:11.435932 --- ParallelTerminationStrategy: PID 1872 died... 00:20:11.454488 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1872): Terminated: ok {rc=0} 00:20:11.537850 bus /sierra_3: Setting Powered False 00:20:12.635396 bus /sierra_3: Setting Powered False 00:20:13.751483 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 emergency:nanobts+band-900 --------------------------------------------------------------------- 00:20:15.011198 tst emergency:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:20:15.016848 tst emergency:nanobts+band-900: Verifying 1 x bts (candidates: 11) 00:20:15.051010 tst emergency:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 00:20:15.078415 tst emergency:nanobts+band-900: Verifying 4 x modem (candidates: 12) 00:20:15.165786 tst emergency:nanobts+band-900: Reserving 1 x bts (candidates: 11) 00:20:15.199473 tst emergency:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 00:20:15.227137 tst emergency:nanobts+band-900: Reserving 4 x modem (candidates: 12) 00:20:15.807055 tst emergency:nanobts+band-900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2366 emergency:nanobts+band-900 emergency_mo_mt_call.py ---------------------------------------------- 00:20:15.811877 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 00:20:15.822756 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 00:20:15.886379 tst emergency_mo_mt_call.py: using LAC 24687 00:20:16.024192 tst emergency_mo_mt_call.py: using RAC 207 00:20:16.153201 tst emergency_mo_mt_call.py: using CellId 24687 00:20:16.279515 tst emergency_mo_mt_call.py: using BVCI 24688 00:20:16.425758 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 00:20:16.438774 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 00:20:16.452311 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 00:20:16.465414 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 00:20:16.477423 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 00:20:16.490231 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 00:20:16.607899 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 00:20:16.731444 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:20:17.228190 run create_hlr_db(pid=1878): Launched 00:20:17.385830 bus /sierra_2: Setting Powered False 00:20:18.448690 run create_hlr_db(pid=1878): Terminated: ok {rc=0} 00:20:18.872789 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1880): Launched 00:20:19.167301 run osmo-hlr_10.42.42.2(pid=1881): Launched 00:20:19.278593 run osmo-stp_10.42.42.5: Starting osmo-stp 00:20:19.785574 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1883): Launched 00:20:20.080462 run osmo-stp_10.42.42.5(pid=1884): Launched 00:20:20.207619 tst emergency_mo_mt_call.py: using MSISDN 7448 00:20:20.359708 run osmo-msc_10.42.42.6: Starting osmo-msc 00:20:20.892722 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1886): Launched 00:20:21.186988 run osmo-msc_10.42.42.6(pid=1887): Launched 00:20:21.351597 run osmo-stp_10.42.42.5(pid=1884): ERR: Terminated: ERROR {rc=1} [trial-2366↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1884)] 00:20:21.475858 run osmo-stp_10.42.42.5(pid=1884): stdout: | (launched: 2022-12-10_00:20:20.026241) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:20:21.599939 run osmo-stp_10.42.42.5(pid=1884): stderr: | 20221210002020197 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002020197 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002020197 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002020198 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002020198 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002020198 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002020198 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:20:21.721685 run osmo-stp_10.42.42.5(pid=1884): stdout: | (launched: 2022-12-10_00:20:20.026241) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:20:21.838832 run osmo-stp_10.42.42.5(pid=1884): stderr: | 20221210002020197 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002020197 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002020197 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002020198 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002020198 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002020198 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002020198 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:20:21.978848 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=1884): Process ended prematurely: osmo-stp_10.42.42.5(pid=1884) [trial-2366↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1884)] [trial-2366↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19] 00:20:21.987085 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 00:20:22.013001 run osmo-hlr_10.42.42.2(pid=1881): ERR: Terminated: ERROR {rc=237} [trial-2366↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1881)] 00:20:22.060263 run osmo-hlr_10.42.42.2(pid=1881): stdout: | (launched: 2022-12-10_00:20:19.113350) 00:20:22.109212 run osmo-hlr_10.42.42.2(pid=1881): stderr: | 20221210002019287 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210002019287 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210002019287 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210002019287 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210002019287 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210002019287 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210002019301 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/emergency:nanobts+band-900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210002019310 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210002019310 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210002019310 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:20:22.177872 run osmo-msc_10.42.42.6(pid=1887): ERR: Terminated: ERROR {rc=2} [trial-2366↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1887)] 00:20:22.225367 run osmo-msc_10.42.42.6(pid=1887): stdout: | (launched: 2022-12-10_00:20:21.132432) 00:20:22.274285 run osmo-msc_10.42.42.6(pid=1887): stderr: | 20221210002021405 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210002021405 DLGLOBAL DEBUG validating counter group 0x7f3ee7d3ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210002021405 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210002021406 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210002021406 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210002021406 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210002021408 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210002021408 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210002021408 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210002021408 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:20:22.323497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1880): Terminating (SIGTERM) 00:20:22.362789 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1883): Terminating (SIGTERM) 00:20:22.401953 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1886): Terminating (SIGTERM) 00:20:22.441756 --- ParallelTerminationStrategy: PID 1880 died... 00:20:22.460596 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1880): Terminated: ok {rc=0} 00:20:22.504170 --- ParallelTerminationStrategy: PID 1883 died... 00:20:22.522660 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1883): Terminated: ok {rc=0} 00:20:22.566060 --- ParallelTerminationStrategy: PID 1886 died... 00:20:22.584528 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1886): Terminated: ok {rc=0} 00:20:22.669537 bus /sierra_3: Setting Powered False 00:20:23.769539 bus /sierra_3: Setting Powered False 00:20:24.885586 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 emergency:nanobts+band-900 emergency_preemptive_call.py ---------------------------------------------- 00:20:25.971773 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 00:20:25.983507 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 00:20:26.034297 tst emergency_preemptive_call.py: using LAC 24688 00:20:26.159974 tst emergency_preemptive_call.py: using RAC 208 00:20:26.284323 tst emergency_preemptive_call.py: using CellId 24688 00:20:26.408374 tst emergency_preemptive_call.py: using BVCI 24689 00:20:26.523932 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 00:20:26.535263 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 00:20:26.546472 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 00:20:26.557761 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 00:20:26.569444 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 00:20:26.580839 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 00:20:26.700731 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 00:20:26.815762 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 00:20:26.930467 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 00:20:27.048321 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:20:27.540856 run create_hlr_db(pid=1889): Launched 00:20:27.661330 bus /sierra_2: Setting Powered False 00:20:28.724793 run create_hlr_db(pid=1889): Terminated: ok {rc=0} 00:20:29.167288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1891): Launched 00:20:29.483859 run osmo-hlr_10.42.42.2(pid=1892): Launched 00:20:29.605598 run osmo-stp_10.42.42.5: Starting osmo-stp 00:20:30.153134 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1894): Launched 00:20:30.468098 run osmo-stp_10.42.42.5(pid=1895): Launched 00:20:30.599402 tst emergency_preemptive_call.py: using MSISDN 7449 00:20:30.762131 run osmo-msc_10.42.42.6: Starting osmo-msc 00:20:31.339293 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1897): Launched 00:20:31.717034 run osmo-msc_10.42.42.6(pid=1898): Launched 00:20:31.925134 run osmo-stp_10.42.42.5(pid=1895): ERR: Terminated: ERROR {rc=1} [trial-2366↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1895)] 00:20:32.215315 run osmo-stp_10.42.42.5(pid=1895): stdout: | (launched: 2022-12-10_00:20:30.410583) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:20:32.439780 run osmo-stp_10.42.42.5(pid=1895): stderr: | 20221210002030604 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002030604 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002030604 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002030605 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002030605 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002030605 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002030605 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:20:32.564419 run osmo-stp_10.42.42.5(pid=1895): stdout: | (launched: 2022-12-10_00:20:30.410583) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:20:32.682453 run osmo-stp_10.42.42.5(pid=1895): stderr: | 20221210002030604 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002030604 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002030604 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002030605 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002030605 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002030605 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002030605 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:20:32.823834 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=1895): Process ended prematurely: osmo-stp_10.42.42.5(pid=1895) [trial-2366↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1895)] [trial-2366↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32] 00:20:32.832117 tst emergency_preemptive_call.py:32: Test FAILED (6.9 sec) 00:20:32.858625 run osmo-hlr_10.42.42.2(pid=1892): ERR: Terminated: ERROR {rc=237} [trial-2366↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1892)] 00:20:32.906796 run osmo-hlr_10.42.42.2(pid=1892): stdout: | (launched: 2022-12-10_00:20:29.426282) 00:20:32.956848 run osmo-hlr_10.42.42.2(pid=1892): stderr: | 20221210002029626 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210002029626 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210002029627 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210002029627 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210002029627 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210002029627 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210002029638 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/emergency:nanobts+band-900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210002029646 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210002029646 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210002029647 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:20:33.027161 run osmo-msc_10.42.42.6(pid=1898): ERR: Terminated: ERROR {rc=2} [trial-2366↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1898)] 00:20:33.075422 run osmo-msc_10.42.42.6(pid=1898): stdout: | (launched: 2022-12-10_00:20:31.653405) 00:20:33.125428 run osmo-msc_10.42.42.6(pid=1898): stderr: | 20221210002032278 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210002032278 DLGLOBAL DEBUG validating counter group 0x7f08a72cdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210002032278 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210002032278 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210002032278 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210002032279 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210002032280 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210002032281 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210002032281 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210002032281 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:20:33.175824 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1891): Terminating (SIGTERM) 00:20:33.215885 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1894): Terminating (SIGTERM) 00:20:33.256283 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1897): Terminating (SIGTERM) 00:20:33.296735 --- ParallelTerminationStrategy: PID 1891 died... 00:20:33.316132 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1891): Terminated: ok {rc=0} 00:20:33.360415 --- ParallelTerminationStrategy: PID 1894 died... 00:20:33.379189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1894): Terminated: ok {rc=0} 00:20:33.423056 --- ParallelTerminationStrategy: PID 1897 died... 00:20:33.441814 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1897): Terminated: ok {rc=0} 00:20:33.528273 bus /sierra_9: Setting Powered False 00:20:34.625804 bus /sierra_9: Setting Powered False 00:20:35.740782 bus /sierra_8: Setting Powered False 00:20:36.840478 bus /sierra_8: Setting Powered False 00:20:37.954064 bus /sierra_3: Setting Powered False 00:20:39.052608 bus /sierra_3: Setting Powered False 00:20:40.167927 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 emergency:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 gprs:nanobts+band-900 --------------------------------------------------------------------- 00:20:41.442425 tst gprs:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:20:41.447428 tst gprs:nanobts+band-900: Verifying 1 x bts (candidates: 11) 00:20:41.480225 tst gprs:nanobts+band-900: Verifying 9 x ip_address (candidates: 9) 00:20:41.519144 tst gprs:nanobts+band-900: Verifying 4 x modem (candidates: 12) 00:20:41.605643 tst gprs:nanobts+band-900: Reserving 1 x bts (candidates: 11) 00:20:41.637732 tst gprs:nanobts+band-900: Reserving 9 x ip_address (candidates: 9) 00:20:41.676339 tst gprs:nanobts+band-900: Reserving 4 x modem (candidates: 12) 00:20:42.266143 tst gprs:nanobts+band-900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2366 gprs:nanobts+band-900 cs_paging_gprs_active.py ---------------------------------------------- 00:20:42.316044 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:20:42.326744 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 00:20:42.374456 tst cs_paging_gprs_active.py: using LAC 24689 00:20:42.494962 tst cs_paging_gprs_active.py: using RAC 209 00:20:42.623256 tst cs_paging_gprs_active.py: using CellId 24689 00:20:42.750265 tst cs_paging_gprs_active.py: using BVCI 24690 00:20:42.867269 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:20:42.878526 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:20:42.889842 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:20:42.901041 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:20:42.912495 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:20:42.923687 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:20:42.935062 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:20:42.946149 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:20:42.957609 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 00:20:43.079212 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 00:20:43.202081 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 00:20:43.420464 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:20:43.742987 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1903): Launched 00:20:44.023153 run iperf3-srv_10.42.42.10(pid=1904): Launched 00:20:44.143421 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 00:20:44.360698 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:20:44.683346 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1905): Launched 00:20:44.963056 run iperf3-srv_10.42.42.10(pid=1906): Launched 00:20:45.083427 tst cs_paging_gprs_active.py:38: start network... 00:20:45.300861 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:20:45.798304 run create_hlr_db(pid=1907): Launched 00:20:45.930579 bus /sierra_2: Setting Powered False 00:20:47.016618 run create_hlr_db(pid=1907): Terminated: ok {rc=0} 00:20:47.502562 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1909): Launched 00:20:47.824215 run osmo-hlr_10.42.42.2(pid=1910): Launched 00:20:47.947325 run osmo-stp_10.42.42.5: Starting osmo-stp 00:20:48.502744 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1912): Launched 00:20:48.823875 run osmo-stp_10.42.42.5(pid=1913): Launched 00:20:48.946919 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:20:49.501166 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1915): Launched 00:20:49.624034 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:20:49.895442 run patchelf(pid=1916): Launched 00:20:50.074614 run osmo-stp_10.42.42.5(pid=1913): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1913)] 00:20:50.210928 run osmo-stp_10.42.42.5(pid=1913): stdout: | (launched: 2022-12-10_00:20:48.765491) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:20:50.349231 run osmo-stp_10.42.42.5(pid=1913): stderr: | 20221210002048957 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002048957 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002048957 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002048958 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002048960 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002048960 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002048960 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:20:50.487234 run osmo-stp_10.42.42.5(pid=1913): stdout: | (launched: 2022-12-10_00:20:48.765491) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:20:50.618991 run osmo-stp_10.42.42.5(pid=1913): stderr: | 20221210002048957 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002048957 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002048957 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002048958 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002048960 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002048960 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002048960 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:20:50.775512 run patchelf(pid=1916): Terminating (SIGINT) 00:20:50.956122 run patchelf(pid=1916): Terminated: ok {rc=0} 00:20:51.086668 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=1913): Process ended prematurely: osmo-stp_10.42.42.5(pid=1913) [trial-2366↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1913)] [trial-2366↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38] 00:20:51.096690 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 00:20:51.125905 run osmo-hlr_10.42.42.2(pid=1910): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:nanobts+band-900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1910)] 00:20:51.175862 run osmo-hlr_10.42.42.2(pid=1910): stdout: | (launched: 2022-12-10_00:20:47.765479) 00:20:51.227680 run osmo-hlr_10.42.42.2(pid=1910): stderr: | 20221210002047964 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210002047964 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210002047964 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210002047964 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210002047964 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210002047964 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210002047975 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:nanobts+band-900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210002047984 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210002047984 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210002047984 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:20:51.279930 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1903): Terminating (SIGTERM) 00:20:51.321807 run iperf3-srv_10.42.42.10(pid=1904): Terminating (SIGTERM) 00:20:51.363435 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1905): Terminating (SIGTERM) 00:20:51.405076 run iperf3-srv_10.42.42.10(pid=1906): Terminating (SIGTERM) 00:20:51.446597 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1909): Terminating (SIGTERM) 00:20:51.488221 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1912): Terminating (SIGTERM) 00:20:51.529993 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1915): Terminating (SIGTERM) 00:20:51.571802 --- ParallelTerminationStrategy: PID 1903 died... 00:20:51.591752 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1903): Terminated: ok {rc=0} 00:20:51.638412 --- ParallelTerminationStrategy: PID 1904 died... 00:20:51.657745 run iperf3-srv_10.42.42.10(pid=1904): Terminated {rc=256} 00:20:51.703838 --- ParallelTerminationStrategy: PID 1905 died... 00:20:51.723310 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1905): Terminated: ok {rc=0} 00:20:51.769401 --- ParallelTerminationStrategy: PID 1906 died... 00:20:51.788637 run iperf3-srv_10.42.42.10(pid=1906): Terminated {rc=256} 00:20:51.834703 --- ParallelTerminationStrategy: PID 1909 died... 00:20:51.854032 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1909): Terminated: ok {rc=0} 00:20:51.900413 --- ParallelTerminationStrategy: PID 1912 died... 00:20:51.920140 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1912): Terminated: ok {rc=0} 00:20:51.966829 --- ParallelTerminationStrategy: PID 1915 died... 00:20:51.986558 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1915): Terminated: ok {rc=0} 00:20:52.074747 bus /gobi_0: Setting Powered False 00:20:53.173666 bus /gobi_0: Setting Powered False 00:20:54.289065 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:nanobts+band-900 iperf3.py ---------------------------------------------- 00:20:55.437101 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:20:55.448714 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 00:20:55.500515 tst iperf3.py: using LAC 24690 00:20:55.626512 tst iperf3.py: using RAC 210 00:20:55.754688 tst iperf3.py: using CellId 24690 00:20:55.882263 tst iperf3.py: using BVCI 24691 00:20:56.000024 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:20:56.011274 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:20:56.022285 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:20:56.033533 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:20:56.044586 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:20:56.055690 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:20:56.067097 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:20:56.078256 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:20:56.089492 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 00:20:56.206031 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 00:20:56.408682 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:20:56.710722 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1917): Launched 00:20:56.972491 run iperf3-srv_10.42.42.10(pid=1918): Launched 00:20:57.084375 tst iperf3.py:8: start network... 00:20:57.285054 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:20:57.749002 run create_hlr_db(pid=1919): Launched 00:20:57.871648 bus /gobi_6: Setting Powered False 00:20:58.931213 run create_hlr_db(pid=1919): Terminated: ok {rc=0} 00:20:59.371297 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1921): Launched 00:20:59.693327 run osmo-hlr_10.42.42.2(pid=1922): Launched 00:20:59.815397 run osmo-stp_10.42.42.5: Starting osmo-stp 00:21:00.373848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1924): Launched 00:21:00.695145 run osmo-stp_10.42.42.5(pid=1925): Launched 00:21:00.817406 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:21:01.527948 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1927): Launched 00:21:01.661150 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:21:01.947614 run patchelf(pid=1928): Launched 00:21:02.142795 run osmo-stp_10.42.42.5(pid=1925): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1925)] 00:21:02.279815 run osmo-stp_10.42.42.5(pid=1925): stdout: | (launched: 2022-12-10_00:21:00.636599) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:21:02.418356 run osmo-stp_10.42.42.5(pid=1925): stderr: | 20221210002100837 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002100837 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002100838 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002100838 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002100838 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002100849 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002100849 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:21:02.557165 run osmo-stp_10.42.42.5(pid=1925): stdout: | (launched: 2022-12-10_00:21:00.636599) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:21:02.689424 run osmo-stp_10.42.42.5(pid=1925): stderr: | 20221210002100837 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002100837 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002100838 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002100838 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002100838 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002100849 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002100849 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:21:02.846547 run patchelf(pid=1928): Terminating (SIGINT) 00:21:03.028219 run patchelf(pid=1928): Terminated: ok {rc=0} 00:21:03.158821 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1925): Process ended prematurely: osmo-stp_10.42.42.5(pid=1925) [trial-2366↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1925)] [trial-2366↪gprs:nanobts+band-900↪iperf3.py:8] 00:21:03.169138 tst iperf3.py:8: Test FAILED (7.8 sec) 00:21:03.198476 run osmo-hlr_10.42.42.2(pid=1922): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:nanobts+band-900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1922)] 00:21:03.248931 run osmo-hlr_10.42.42.2(pid=1922): stdout: | (launched: 2022-12-10_00:20:59.634613) 00:21:03.301291 run osmo-hlr_10.42.42.2(pid=1922): stderr: | 20221210002059834 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210002059834 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210002059834 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210002059834 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210002059834 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210002059834 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210002059847 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:nanobts+band-900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210002059855 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210002059856 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210002059856 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:21:03.354023 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1917): Terminating (SIGTERM) 00:21:03.396556 run iperf3-srv_10.42.42.10(pid=1918): Terminating (SIGTERM) 00:21:03.438946 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1921): Terminating (SIGTERM) 00:21:03.481233 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1924): Terminating (SIGTERM) 00:21:03.523482 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1927): Terminating (SIGTERM) 00:21:03.566029 --- ParallelTerminationStrategy: PID 1917 died... 00:21:03.586299 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1917): Terminated: ok {rc=0} 00:21:03.633330 --- ParallelTerminationStrategy: PID 1918 died... 00:21:03.653099 run iperf3-srv_10.42.42.10(pid=1918): Terminated {rc=256} 00:21:03.699634 --- ParallelTerminationStrategy: PID 1921 died... 00:21:03.719404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1921): Terminated: ok {rc=0} 00:21:03.766204 --- ParallelTerminationStrategy: PID 1924 died... 00:21:03.786019 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1924): Terminated: ok {rc=0} 00:21:03.832798 --- ParallelTerminationStrategy: PID 1927 died... 00:21:03.853036 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1927): Terminated: ok {rc=0} 00:21:03.942002 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:nanobts+band-900 iperf3m4.py ---------------------------------------------- 00:21:05.091754 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:05.103493 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 00:21:05.152114 tst iperf3m4.py: using LAC 24691 00:21:05.283153 tst iperf3m4.py: using RAC 211 00:21:05.408391 tst iperf3m4.py: using CellId 24691 00:21:05.532846 tst iperf3m4.py: using BVCI 24692 00:21:05.650107 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:05.661325 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:05.672293 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:05.683439 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:05.694666 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:05.705799 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:05.717129 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:05.728057 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:05.739315 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 00:21:05.855322 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 00:21:05.977228 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 00:21:06.098436 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 00:21:06.217759 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 00:21:06.435544 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:21:06.758261 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1931): Launched 00:21:07.038965 run iperf3-srv_10.42.42.10(pid=1932): Launched 00:21:07.158967 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 00:21:07.376263 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:21:07.699555 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1933): Launched 00:21:07.979755 run iperf3-srv_10.42.42.10(pid=1934): Launched 00:21:08.100187 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 00:21:08.317563 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:21:08.640847 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1935): Launched 00:21:08.920297 run iperf3-srv_10.42.42.10(pid=1936): Launched 00:21:09.040680 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 00:21:09.257442 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:21:09.580211 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1937): Launched 00:21:09.859602 run iperf3-srv_10.42.42.10(pid=1938): Launched 00:21:09.981124 tst iperf3m4.py:8: start network... 00:21:10.199059 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:21:10.700502 run create_hlr_db(pid=1939): Launched 00:21:10.823453 bus /gobi_6: Setting Powered False 00:21:11.884484 run create_hlr_db(pid=1939): Terminated: ok {rc=0} 00:21:12.314013 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1941): Launched 00:21:12.615901 run osmo-hlr_10.42.42.2(pid=1942): Launched 00:21:12.729931 run osmo-stp_10.42.42.5: Starting osmo-stp 00:21:13.262924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1944): Launched 00:21:13.564121 run osmo-stp_10.42.42.5(pid=1945): Launched 00:21:13.678415 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:21:14.197733 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1947): Launched 00:21:14.312143 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:21:14.566110 run patchelf(pid=1948): Launched 00:21:14.732646 run osmo-stp_10.42.42.5(pid=1945): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1945)] 00:21:14.859707 run osmo-stp_10.42.42.5(pid=1945): stdout: | (launched: 2022-12-10_00:21:13.508228) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:21:14.989202 run osmo-stp_10.42.42.5(pid=1945): stderr: | 20221210002113680 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002113680 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002113680 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002113680 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002113681 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002113681 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002113681 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:21:15.118410 run osmo-stp_10.42.42.5(pid=1945): stdout: | (launched: 2022-12-10_00:21:13.508228) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:21:15.241245 run osmo-stp_10.42.42.5(pid=1945): stderr: | 20221210002113680 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002113680 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002113680 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002113680 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002113681 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002113681 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002113681 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:21:15.387040 run patchelf(pid=1948): Terminating (SIGINT) 00:21:15.556280 run patchelf(pid=1948): Terminated: ok {rc=0} 00:21:15.677586 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1945): Process ended prematurely: osmo-stp_10.42.42.5(pid=1945) [trial-2366↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1945)] [trial-2366↪gprs:nanobts+band-900↪iperf3m4.py:8] 00:21:15.686979 tst iperf3m4.py:8: Test FAILED (10.6 sec) 00:21:15.716164 run osmo-hlr_10.42.42.2(pid=1942): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:nanobts+band-900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1942)] 00:21:15.762961 run osmo-hlr_10.42.42.2(pid=1942): stdout: | (launched: 2022-12-10_00:21:12.560468) 00:21:15.811659 run osmo-hlr_10.42.42.2(pid=1942): stderr: | 20221210002112740 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210002112740 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210002112740 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210002112740 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210002112740 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210002112740 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210002112752 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:nanobts+band-900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210002112763 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210002112763 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210002112763 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:21:15.880553 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1931): Terminating (SIGTERM) 00:21:15.930312 run iperf3-srv_10.42.42.10(pid=1932): Terminating (SIGTERM) 00:21:15.975062 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1933): Terminating (SIGTERM) 00:21:16.020317 run iperf3-srv_10.42.42.10(pid=1934): Terminating (SIGTERM) 00:21:16.075795 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1935): Terminating (SIGTERM) 00:21:16.121191 run iperf3-srv_10.42.42.10(pid=1936): Terminating (SIGTERM) 00:21:16.165819 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1937): Terminating (SIGTERM) 00:21:16.210204 run iperf3-srv_10.42.42.10(pid=1938): Terminating (SIGTERM) 00:21:16.254113 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1941): Terminating (SIGTERM) 00:21:16.300212 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1944): Terminating (SIGTERM) 00:21:16.347442 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1947): Terminating (SIGTERM) 00:21:16.393823 --- ParallelTerminationStrategy: PID 1931 died... 00:21:16.414965 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1931): Terminated: ok {rc=0} 00:21:16.467083 --- ParallelTerminationStrategy: PID 1932 died... 00:21:16.487775 run iperf3-srv_10.42.42.10(pid=1932): Terminated {rc=256} 00:21:16.538801 --- ParallelTerminationStrategy: PID 1933 died... 00:21:16.560066 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1933): Terminated: ok {rc=0} 00:21:16.608367 --- ParallelTerminationStrategy: PID 1934 died... 00:21:16.629943 run iperf3-srv_10.42.42.10(pid=1934): Terminated {rc=256} 00:21:16.680029 --- ParallelTerminationStrategy: PID 1935 died... 00:21:16.701666 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1935): Terminated: ok {rc=0} 00:21:16.751639 --- ParallelTerminationStrategy: PID 1936 died... 00:21:16.772302 run iperf3-srv_10.42.42.10(pid=1936): Terminated {rc=256} 00:21:16.821998 --- ParallelTerminationStrategy: PID 1937 died... 00:21:16.842563 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1937): Terminated: ok {rc=0} 00:21:16.891998 --- ParallelTerminationStrategy: PID 1938 died... 00:21:16.913829 run iperf3-srv_10.42.42.10(pid=1938): Terminated {rc=256} 00:21:16.963821 --- ParallelTerminationStrategy: PID 1941 died... 00:21:16.984461 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1941): Terminated: ok {rc=0} 00:21:17.033952 --- ParallelTerminationStrategy: PID 1944 died... 00:21:17.054597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1944): Terminated: ok {rc=0} 00:21:17.105643 --- ParallelTerminationStrategy: PID 1947 died... 00:21:17.126302 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1947): Terminated: ok {rc=0} 00:21:17.218364 bus /gobi_4: Setting Powered False 00:21:18.316606 bus /gobi_4: Setting Powered False 00:21:19.435504 bus /gobi_1: Setting Powered False 00:21:20.537493 bus /gobi_1: Setting Powered False 00:21:21.653408 bus /gobi_0: Setting Powered False 00:21:22.748712 bus /gobi_0: Setting Powered False 00:21:23.864301 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:nanobts+band-900 ping.py ---------------------------------------------- 00:21:24.966930 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:24.978651 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 00:21:25.026083 tst ping.py: using LAC 24692 00:21:25.148458 tst ping.py: using RAC 212 00:21:25.264465 tst ping.py: using CellId 24692 00:21:25.379559 tst ping.py: using BVCI 24693 00:21:25.486396 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:25.497173 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:25.507649 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:25.518077 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:25.528346 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:25.538725 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:25.549384 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:25.559825 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 00:21:25.676466 tst ping.py:19: start network... 00:21:25.891522 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:21:26.382949 run create_hlr_db(pid=1949): Launched 00:21:26.503673 bus /gobi_6: Setting Powered False 00:21:27.566078 run create_hlr_db(pid=1949): Terminated: ok {rc=0} 00:21:28.007036 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1951): Launched 00:21:28.321959 run osmo-hlr_10.42.42.2(pid=1952): Launched 00:21:28.443264 run osmo-stp_10.42.42.5: Starting osmo-stp 00:21:28.989551 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1954): Launched 00:21:29.306387 run osmo-stp_10.42.42.5(pid=1955): Launched 00:21:29.426905 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:21:29.971052 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1957): Launched 00:21:30.092049 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:21:30.358649 run patchelf(pid=1958): Launched 00:21:30.533529 run osmo-stp_10.42.42.5(pid=1955): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1955)] 00:21:30.667303 run osmo-stp_10.42.42.5(pid=1955): stdout: | (launched: 2022-12-10_00:21:29.248593) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:21:30.803046 run osmo-stp_10.42.42.5(pid=1955): stderr: | 20221210002129439 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002129439 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002129440 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002129440 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002129440 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002129440 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002129440 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:21:30.943635 run osmo-stp_10.42.42.5(pid=1955): stdout: | (launched: 2022-12-10_00:21:29.248593) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:21:31.076872 run osmo-stp_10.42.42.5(pid=1955): stderr: | 20221210002129439 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002129439 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002129440 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002129440 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002129440 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002129440 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002129440 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:21:31.234705 run patchelf(pid=1958): Terminating (SIGINT) 00:21:31.415881 run patchelf(pid=1958): Terminated: ok {rc=0} 00:21:31.546940 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=1955): Process ended prematurely: osmo-stp_10.42.42.5(pid=1955) [trial-2366↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1955)] [trial-2366↪gprs:nanobts+band-900↪ping.py:22] 00:21:31.557433 tst ping.py:22: Test FAILED (6.6 sec) 00:21:31.587918 run osmo-hlr_10.42.42.2(pid=1952): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:nanobts+band-900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1952)] 00:21:31.641456 run osmo-hlr_10.42.42.2(pid=1952): stdout: | (launched: 2022-12-10_00:21:28.264238) 00:21:31.695412 run osmo-hlr_10.42.42.2(pid=1952): stderr: | 20221210002128460 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210002128460 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210002128460 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210002128460 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210002128460 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210002128460 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210002128472 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:nanobts+band-900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210002128481 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210002128481 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210002128481 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:21:31.750060 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1951): Terminating (SIGTERM) 00:21:31.794160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1954): Terminating (SIGTERM) 00:21:31.838592 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1957): Terminating (SIGTERM) 00:21:31.884096 --- ParallelTerminationStrategy: PID 1951 died... 00:21:31.904932 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1951): Terminated: ok {rc=0} 00:21:31.954864 --- ParallelTerminationStrategy: PID 1954 died... 00:21:31.975576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1954): Terminated: ok {rc=0} 00:21:32.025212 --- ParallelTerminationStrategy: PID 1957 died... 00:21:32.045926 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1957): Terminated: ok {rc=0} 00:21:32.138931 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:nanobts+band-900 ping_idle_ping.py ---------------------------------------------- 00:21:33.231112 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:33.242710 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 00:21:33.291644 tst ping_idle_ping.py: using LAC 24693 00:21:33.417621 tst ping_idle_ping.py: using RAC 213 00:21:33.542620 tst ping_idle_ping.py: using CellId 24693 00:21:33.668346 tst ping_idle_ping.py: using BVCI 24694 00:21:33.777593 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:33.788468 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:33.799298 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:33.810018 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:33.820656 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:33.831412 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:33.842269 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 00:21:33.852797 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 00:21:33.969916 tst ping_idle_ping.py:24: start network... 00:21:34.184184 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:21:34.678001 run create_hlr_db(pid=1959): Launched 00:21:34.799137 bus /gobi_6: Setting Powered False 00:21:35.862168 run create_hlr_db(pid=1959): Terminated: ok {rc=0} 00:21:36.287028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1961): Launched 00:21:36.583874 run osmo-hlr_10.42.42.2(pid=1962): Launched 00:21:36.697288 run osmo-stp_10.42.42.5: Starting osmo-stp 00:21:37.212305 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1965): Launched 00:21:37.508588 run osmo-stp_10.42.42.5(pid=1966): Launched 00:21:37.622172 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:21:38.132467 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1968): Launched 00:21:38.245424 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:21:38.495707 run patchelf(pid=1969): Launched 00:21:38.660148 run osmo-stp_10.42.42.5(pid=1966): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1966)] 00:21:38.784748 run osmo-stp_10.42.42.5(pid=1966): stdout: | (launched: 2022-12-10_00:21:37.453986) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:21:38.911513 run osmo-stp_10.42.42.5(pid=1966): stderr: | 20221210002137625 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002137625 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002137625 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002137626 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002137626 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002137626 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002137626 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:21:39.038397 run osmo-stp_10.42.42.5(pid=1966): stdout: | (launched: 2022-12-10_00:21:37.453986) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:21:39.160410 run osmo-stp_10.42.42.5(pid=1966): stderr: | 20221210002137625 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002137625 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002137625 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002137626 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002137626 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002137626 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002137626 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:21:39.303966 run patchelf(pid=1969): Terminating (SIGINT) 00:21:39.470525 run patchelf(pid=1969): Terminated: ok {rc=0} 00:21:39.590292 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=1966): Process ended prematurely: osmo-stp_10.42.42.5(pid=1966) [trial-2366↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1966)] [trial-2366↪gprs:nanobts+band-900↪ping_idle_ping.py:27] 00:21:39.599141 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 00:21:39.625897 run osmo-hlr_10.42.42.2(pid=1962): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:nanobts+band-900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1962)] 00:21:39.672908 run osmo-hlr_10.42.42.2(pid=1962): stdout: | (launched: 2022-12-10_00:21:36.528617) 00:21:39.721713 run osmo-hlr_10.42.42.2(pid=1962): stderr: | 20221210002136706 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210002136706 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210002136707 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210002136707 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210002136707 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210002136707 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210002136719 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:nanobts+band-900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210002136728 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210002136728 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210002136728 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:21:39.770709 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1961): Terminating (SIGTERM) 00:21:39.809867 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1965): Terminating (SIGTERM) 00:21:39.849348 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1968): Terminating (SIGTERM) 00:21:39.889566 --- ParallelTerminationStrategy: PID 1961 died... 00:21:39.908346 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1961): Terminated: ok {rc=0} 00:21:39.953204 --- ParallelTerminationStrategy: PID 1965 died... 00:21:39.971606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1965): Terminated: ok {rc=0} 00:21:40.015523 --- ParallelTerminationStrategy: PID 1968 died... 00:21:40.034217 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1968): Terminated: ok {rc=0} 00:21:40.120239 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2366 gprs:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 gprs:nanobts+band-900+mod-bts0-egprs --------------------------------------------------------------------- 00:21:41.420552 tst gprs:nanobts+band-900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:21:41.427232 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 00:21:41.460119 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 00:21:41.498017 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 00:21:41.583132 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 00:21:41.614892 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 00:21:41.653217 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 00:21:42.258548 tst gprs:nanobts+band-900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2366 gprs:nanobts+band-900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 00:21:42.313193 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:21:42.324559 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:21:42.374835 tst cs_paging_gprs_active.py: using LAC 24694 00:21:42.503362 tst cs_paging_gprs_active.py: using RAC 214 00:21:42.629424 tst cs_paging_gprs_active.py: using CellId 24694 00:21:42.755499 tst cs_paging_gprs_active.py: using BVCI 24695 00:21:42.865992 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:21:42.876862 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:21:42.888055 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:21:42.898790 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:21:42.909846 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:21:42.920500 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:21:42.931241 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:21:42.941837 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:21:42.952583 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:21:43.070800 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:21:43.192172 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 00:21:43.410882 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:21:43.734657 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1973): Launched 00:21:44.015564 run iperf3-srv_10.42.42.10(pid=1974): Launched 00:21:44.136671 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 00:21:44.354650 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:21:44.669076 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1975): Launched 00:21:44.931712 run iperf3-srv_10.42.42.10(pid=1976): Launched 00:21:45.044024 tst cs_paging_gprs_active.py:38: start network... 00:21:45.246350 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:21:45.712678 run create_hlr_db(pid=1977): Launched 00:21:45.843455 bus /gobi_6: Setting Powered False 00:21:46.903776 run create_hlr_db(pid=1977): Terminated: ok {rc=0} 00:21:47.405632 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1979): Launched 00:21:47.731131 run osmo-hlr_10.42.42.2(pid=1980): Launched 00:21:47.854769 run osmo-stp_10.42.42.5: Starting osmo-stp 00:21:48.409025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1982): Launched 00:21:48.730560 run osmo-stp_10.42.42.5(pid=1983): Launched 00:21:48.853824 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:21:49.410547 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1985): Launched 00:21:49.534360 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:21:49.806791 run patchelf(pid=1986): Launched 00:21:49.986447 run osmo-stp_10.42.42.5(pid=1983): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1983)] 00:21:50.123470 run osmo-stp_10.42.42.5(pid=1983): stdout: | (launched: 2022-12-10_00:21:48.671791) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:21:50.262193 run osmo-stp_10.42.42.5(pid=1983): stderr: | 20221210002148861 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002148862 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002148862 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002148862 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002148863 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002148863 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002148863 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:21:50.400586 run osmo-stp_10.42.42.5(pid=1983): stdout: | (launched: 2022-12-10_00:21:48.671791) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:21:50.532872 run osmo-stp_10.42.42.5(pid=1983): stderr: | 20221210002148861 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002148862 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002148862 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002148862 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002148863 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002148863 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002148863 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:21:50.689801 run patchelf(pid=1986): Terminating (SIGINT) 00:21:50.870897 run patchelf(pid=1986): Terminated: ok {rc=0} 00:21:51.002008 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=1983): Process ended prematurely: osmo-stp_10.42.42.5(pid=1983) [trial-2366↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1983)] [trial-2366↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 00:21:51.012241 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 00:21:51.041413 run osmo-hlr_10.42.42.2(pid=1980): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1980)] 00:21:51.091718 run osmo-hlr_10.42.42.2(pid=1980): stdout: | (launched: 2022-12-10_00:21:47.672162) 00:21:51.143963 run osmo-hlr_10.42.42.2(pid=1980): stderr: | 20221210002147867 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210002147867 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210002147867 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210002147867 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210002147867 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210002147868 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210002147880 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:nanobts+band-900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210002147888 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210002147888 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210002147888 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:21:51.196373 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1973): Terminating (SIGTERM) 00:21:51.238556 run iperf3-srv_10.42.42.10(pid=1974): Terminating (SIGTERM) 00:21:51.280558 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1975): Terminating (SIGTERM) 00:21:51.322721 run iperf3-srv_10.42.42.10(pid=1976): Terminating (SIGTERM) 00:21:51.364629 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1979): Terminating (SIGTERM) 00:21:51.406792 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1982): Terminating (SIGTERM) 00:21:51.448859 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1985): Terminating (SIGTERM) 00:21:51.491787 --- ParallelTerminationStrategy: PID 1973 died... 00:21:51.511940 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1973): Terminated: ok {rc=0} 00:21:51.558914 --- ParallelTerminationStrategy: PID 1974 died... 00:21:51.578709 run iperf3-srv_10.42.42.10(pid=1974): Terminated {rc=256} 00:21:51.625401 --- ParallelTerminationStrategy: PID 1975 died... 00:21:51.645248 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1975): Terminated: ok {rc=0} 00:21:51.691801 --- ParallelTerminationStrategy: PID 1976 died... 00:21:51.711575 run iperf3-srv_10.42.42.10(pid=1976): Terminated {rc=256} 00:21:51.758132 --- ParallelTerminationStrategy: PID 1979 died... 00:21:51.777913 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1979): Terminated: ok {rc=0} 00:21:51.824375 --- ParallelTerminationStrategy: PID 1982 died... 00:21:51.843910 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1982): Terminated: ok {rc=0} 00:21:51.890376 --- ParallelTerminationStrategy: PID 1985 died... 00:21:51.909919 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1985): Terminated: ok {rc=0} 00:21:51.998794 bus /gobi_0: Setting Powered False 00:21:53.098432 bus /gobi_0: Setting Powered False 00:21:54.221621 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:nanobts+band-900+mod-bts0-egprs iperf3.py ---------------------------------------------- 00:21:55.372178 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:21:55.384237 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:21:55.437045 tst iperf3.py: using LAC 24695 00:21:55.564188 tst iperf3.py: using RAC 215 00:21:55.692395 tst iperf3.py: using CellId 24695 00:21:55.810753 tst iperf3.py: using BVCI 24696 00:21:55.919291 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:21:55.930427 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:21:55.941370 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:21:55.952354 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:21:55.963038 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:21:55.973709 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:21:55.984499 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:21:55.995215 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:21:56.006032 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:21:56.123186 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 00:21:56.343201 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:21:56.668656 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1987): Launched 00:21:56.949848 run iperf3-srv_10.42.42.10(pid=1988): Launched 00:21:57.071025 tst iperf3.py:8: start network... 00:21:57.290888 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:21:57.793855 run create_hlr_db(pid=1989): Launched 00:21:57.916530 bus /gobi_6: Setting Powered False 00:21:58.981239 run create_hlr_db(pid=1989): Terminated: ok {rc=0} 00:21:59.431761 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1991): Launched 00:21:59.753713 run osmo-hlr_10.42.42.2(pid=1992): Launched 00:21:59.877663 run osmo-stp_10.42.42.5: Starting osmo-stp 00:22:00.436877 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1994): Launched 00:22:00.757527 run osmo-stp_10.42.42.5(pid=1995): Launched 00:22:00.920724 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:22:01.624511 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1997): Launched 00:22:01.756062 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:22:02.029695 run patchelf(pid=1998): Launched 00:22:02.222605 run osmo-stp_10.42.42.5(pid=1995): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1995)] 00:22:02.360304 run osmo-stp_10.42.42.5(pid=1995): stdout: | (launched: 2022-12-10_00:22:00.699068) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:22:02.499680 run osmo-stp_10.42.42.5(pid=1995): stderr: | 20221210002200963 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002200963 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002200963 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002200964 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002200967 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002200967 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002200967 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:22:02.639361 run osmo-stp_10.42.42.5(pid=1995): stdout: | (launched: 2022-12-10_00:22:00.699068) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:22:02.772169 run osmo-stp_10.42.42.5(pid=1995): stderr: | 20221210002200963 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002200963 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002200963 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002200964 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002200967 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002200967 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002200967 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:22:02.929809 run patchelf(pid=1998): Terminating (SIGINT) 00:22:03.111578 run patchelf(pid=1998): Terminated: ok {rc=0} 00:22:03.242245 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1995): Process ended prematurely: osmo-stp_10.42.42.5(pid=1995) [trial-2366↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1995)] [trial-2366↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8] 00:22:03.252450 tst iperf3.py:8: Test FAILED (7.9 sec) 00:22:03.282286 run osmo-hlr_10.42.42.2(pid=1992): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1992)] 00:22:03.333106 run osmo-hlr_10.42.42.2(pid=1992): stdout: | (launched: 2022-12-10_00:21:59.695317) 00:22:03.385319 run osmo-hlr_10.42.42.2(pid=1992): stderr: | 20221210002159893 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210002159893 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210002159893 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210002159893 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210002159893 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210002159893 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210002159905 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:nanobts+band-900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210002159914 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210002159914 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210002159914 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:22:03.438048 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1987): Terminating (SIGTERM) 00:22:03.480186 run iperf3-srv_10.42.42.10(pid=1988): Terminating (SIGTERM) 00:22:03.522226 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1991): Terminating (SIGTERM) 00:22:03.564256 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1994): Terminating (SIGTERM) 00:22:03.606404 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1997): Terminating (SIGTERM) 00:22:03.649377 --- ParallelTerminationStrategy: PID 1987 died... 00:22:03.669667 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1987): Terminated: ok {rc=0} 00:22:03.717324 --- ParallelTerminationStrategy: PID 1988 died... 00:22:03.736845 run iperf3-srv_10.42.42.10(pid=1988): Terminated {rc=256} 00:22:03.784033 --- ParallelTerminationStrategy: PID 1991 died... 00:22:03.803844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1991): Terminated: ok {rc=0} 00:22:03.850882 --- ParallelTerminationStrategy: PID 1994 died... 00:22:03.870620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1994): Terminated: ok {rc=0} 00:22:03.918287 --- ParallelTerminationStrategy: PID 1997 died... 00:22:03.938199 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1997): Terminated: ok {rc=0} 00:22:04.027682 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:nanobts+band-900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 00:22:05.179238 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:05.191306 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:22:05.244469 tst iperf3m4.py: using LAC 24696 00:22:05.370968 tst iperf3m4.py: using RAC 216 00:22:05.509478 tst iperf3m4.py: using CellId 24696 00:22:05.639589 tst iperf3m4.py: using BVCI 24697 00:22:05.757472 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:05.768773 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:05.780000 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:05.791388 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:05.802704 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:05.813974 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:05.825406 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:05.836819 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:05.848319 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:22:05.965751 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:22:06.086660 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:22:06.208004 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:22:06.329993 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 00:22:06.550369 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:22:06.875204 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1999): Launched 00:22:07.157683 run iperf3-srv_10.42.42.10(pid=2000): Launched 00:22:07.279283 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 00:22:07.498455 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:22:07.823730 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2001): Launched 00:22:08.105575 run iperf3-srv_10.42.42.10(pid=2002): Launched 00:22:08.226676 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 00:22:08.445646 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:22:08.770007 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2003): Launched 00:22:09.050655 run iperf3-srv_10.42.42.10(pid=2004): Launched 00:22:09.171474 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 00:22:09.389488 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:22:09.712763 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2005): Launched 00:22:09.977264 run iperf3-srv_10.42.42.10(pid=2006): Launched 00:22:10.089849 tst iperf3m4.py:8: start network... 00:22:10.291593 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:22:10.759425 run create_hlr_db(pid=2007): Launched 00:22:10.881305 bus /gobi_6: Setting Powered False 00:22:11.945045 run create_hlr_db(pid=2007): Terminated: ok {rc=0} 00:22:12.375765 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2009): Launched 00:22:12.676234 run osmo-hlr_10.42.42.2(pid=2010): Launched 00:22:12.790130 run osmo-stp_10.42.42.5: Starting osmo-stp 00:22:13.313209 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2012): Launched 00:22:13.615548 run osmo-stp_10.42.42.5(pid=2013): Launched 00:22:13.730481 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:22:14.249246 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2015): Launched 00:22:14.363858 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:22:14.618508 run patchelf(pid=2016): Launched 00:22:14.785930 run osmo-stp_10.42.42.5(pid=2013): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2013)] 00:22:14.912570 run osmo-stp_10.42.42.5(pid=2013): stdout: | (launched: 2022-12-10_00:22:13.560032) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:22:15.041625 run osmo-stp_10.42.42.5(pid=2013): stderr: | 20221210002213733 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002213733 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002213733 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002213733 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002213734 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002213734 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002213734 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:22:15.170905 run osmo-stp_10.42.42.5(pid=2013): stdout: | (launched: 2022-12-10_00:22:13.560032) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:22:15.293776 run osmo-stp_10.42.42.5(pid=2013): stderr: | 20221210002213733 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002213733 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002213733 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002213733 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002213734 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002213734 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002213734 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:22:15.440284 run patchelf(pid=2016): Terminating (SIGINT) 00:22:15.608630 run patchelf(pid=2016): Terminated: ok {rc=0} 00:22:15.730696 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2013): Process ended prematurely: osmo-stp_10.42.42.5(pid=2013) [trial-2366↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2013)] [trial-2366↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8] 00:22:15.740148 tst iperf3m4.py:8: Test FAILED (10.6 sec) 00:22:15.767651 run osmo-hlr_10.42.42.2(pid=2010): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2010)] 00:22:15.814847 run osmo-hlr_10.42.42.2(pid=2010): stdout: | (launched: 2022-12-10_00:22:12.620869) 00:22:15.868142 run osmo-hlr_10.42.42.2(pid=2010): stderr: | 20221210002212799 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210002212799 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210002212799 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210002212799 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210002212799 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210002212799 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210002212812 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:nanobts+band-900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210002212821 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210002212821 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210002212822 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:22:15.938226 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1999): Terminating (SIGTERM) 00:22:15.983287 run iperf3-srv_10.42.42.10(pid=2000): Terminating (SIGTERM) 00:22:16.027758 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2001): Terminating (SIGTERM) 00:22:16.073158 run iperf3-srv_10.42.42.10(pid=2002): Terminating (SIGTERM) 00:22:16.119507 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2003): Terminating (SIGTERM) 00:22:16.164185 run iperf3-srv_10.42.42.10(pid=2004): Terminating (SIGTERM) 00:22:16.210066 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2005): Terminating (SIGTERM) 00:22:16.255148 run iperf3-srv_10.42.42.10(pid=2006): Terminating (SIGTERM) 00:22:16.302499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2009): Terminating (SIGTERM) 00:22:16.348916 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2012): Terminating (SIGTERM) 00:22:16.395357 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2015): Terminating (SIGTERM) 00:22:16.442706 --- ParallelTerminationStrategy: PID 1999 died... 00:22:16.463890 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1999): Terminated: ok {rc=0} 00:22:16.518965 --- ParallelTerminationStrategy: PID 2000 died... 00:22:16.542783 run iperf3-srv_10.42.42.10(pid=2000): Terminated {rc=256} 00:22:16.595536 --- ParallelTerminationStrategy: PID 2001 died... 00:22:16.618394 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2001): Terminated: ok {rc=0} 00:22:16.672818 --- ParallelTerminationStrategy: PID 2002 died... 00:22:16.695932 run iperf3-srv_10.42.42.10(pid=2002): Terminated {rc=256} 00:22:16.748342 --- ParallelTerminationStrategy: PID 2003 died... 00:22:16.769076 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2003): Terminated: ok {rc=0} 00:22:16.819239 --- ParallelTerminationStrategy: PID 2004 died... 00:22:16.839797 run iperf3-srv_10.42.42.10(pid=2004): Terminated {rc=256} 00:22:16.889433 --- ParallelTerminationStrategy: PID 2005 died... 00:22:16.910803 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2005): Terminated: ok {rc=0} 00:22:16.961106 --- ParallelTerminationStrategy: PID 2006 died... 00:22:16.981790 run iperf3-srv_10.42.42.10(pid=2006): Terminated {rc=256} 00:22:17.032081 --- ParallelTerminationStrategy: PID 2009 died... 00:22:17.052669 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2009): Terminated: ok {rc=0} 00:22:17.102697 --- ParallelTerminationStrategy: PID 2012 died... 00:22:17.124357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2012): Terminated: ok {rc=0} 00:22:17.173978 --- ParallelTerminationStrategy: PID 2015 died... 00:22:17.194751 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2015): Terminated: ok {rc=0} 00:22:17.286538 bus /gobi_4: Setting Powered False 00:22:18.385742 bus /gobi_4: Setting Powered False 00:22:19.504915 bus /gobi_1: Setting Powered False 00:22:20.604547 bus /gobi_1: Setting Powered False 00:22:21.720160 bus /gobi_0: Setting Powered False 00:22:22.818915 bus /gobi_0: Setting Powered False 00:22:23.935511 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:nanobts+band-900+mod-bts0-egprs ping.py ---------------------------------------------- 00:22:25.039193 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:25.050850 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:22:25.100146 tst ping.py: using LAC 24697 00:22:25.219431 tst ping.py: using RAC 217 00:22:25.336526 tst ping.py: using CellId 24697 00:22:25.454648 tst ping.py: using BVCI 24698 00:22:25.562526 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:25.573614 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:25.584470 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:25.595231 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:25.605933 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:25.616661 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:25.627559 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:25.638427 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:22:25.752204 tst ping.py:19: start network... 00:22:25.951185 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:22:26.409826 run create_hlr_db(pid=2017): Launched 00:22:26.530968 bus /gobi_6: Setting Powered False 00:22:27.590992 run create_hlr_db(pid=2017): Terminated: ok {rc=0} 00:22:28.024387 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2019): Launched 00:22:28.340685 run osmo-hlr_10.42.42.2(pid=2020): Launched 00:22:28.462640 run osmo-stp_10.42.42.5: Starting osmo-stp 00:22:29.012471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2022): Launched 00:22:29.328891 run osmo-stp_10.42.42.5(pid=2023): Launched 00:22:29.450516 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:22:29.999666 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2025): Launched 00:22:30.122258 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:22:30.391513 run patchelf(pid=2026): Launched 00:22:30.568383 run osmo-stp_10.42.42.5(pid=2023): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2023)] 00:22:30.702819 run osmo-stp_10.42.42.5(pid=2023): stdout: | (launched: 2022-12-10_00:22:29.270963) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:22:30.839627 run osmo-stp_10.42.42.5(pid=2023): stderr: | 20221210002229461 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002229461 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002229462 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002229462 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002229465 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002229465 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002229465 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:22:30.985572 run osmo-stp_10.42.42.5(pid=2023): stdout: | (launched: 2022-12-10_00:22:29.270963) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:22:31.119595 run osmo-stp_10.42.42.5(pid=2023): stderr: | 20221210002229461 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002229461 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002229462 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002229462 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002229465 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002229465 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002229465 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:22:31.278292 run patchelf(pid=2026): Terminating (SIGINT) 00:22:31.460653 run patchelf(pid=2026): Terminated: ok {rc=0} 00:22:31.593136 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=2023): Process ended prematurely: osmo-stp_10.42.42.5(pid=2023) [trial-2366↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2023)] [trial-2366↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22] 00:22:31.603706 tst ping.py:22: Test FAILED (6.6 sec) 00:22:31.635650 run osmo-hlr_10.42.42.2(pid=2020): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2020)] 00:22:31.688197 run osmo-hlr_10.42.42.2(pid=2020): stdout: | (launched: 2022-12-10_00:22:28.282634) 00:22:31.742689 run osmo-hlr_10.42.42.2(pid=2020): stderr: | 20221210002228480 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210002228480 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210002228480 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210002228480 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210002228480 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210002228480 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210002228493 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:nanobts+band-900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210002228501 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210002228501 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210002228501 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:22:31.797674 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2019): Terminating (SIGTERM) 00:22:31.842440 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2022): Terminating (SIGTERM) 00:22:31.888119 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2025): Terminating (SIGTERM) 00:22:31.933299 --- ParallelTerminationStrategy: PID 2019 died... 00:22:31.954132 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2019): Terminated: ok {rc=0} 00:22:32.005438 --- ParallelTerminationStrategy: PID 2022 died... 00:22:32.026218 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2022): Terminated: ok {rc=0} 00:22:32.078330 --- ParallelTerminationStrategy: PID 2025 died... 00:22:32.099066 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2025): Terminated: ok {rc=0} 00:22:32.189352 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:nanobts+band-900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 00:22:33.278328 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:33.290897 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 00:22:33.342301 tst ping_idle_ping.py: using LAC 24698 00:22:33.468229 tst ping_idle_ping.py: using RAC 218 00:22:33.598040 tst ping_idle_ping.py: using CellId 24698 00:22:33.722932 tst ping_idle_ping.py: using BVCI 24699 00:22:33.833130 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:33.844103 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:33.855019 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:33.865868 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:33.877532 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:33.888832 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:33.900423 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 00:22:33.911818 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 00:22:34.039293 tst ping_idle_ping.py:24: start network... 00:22:34.239337 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:22:34.702118 run create_hlr_db(pid=2027): Launched 00:22:34.823446 bus /gobi_6: Setting Powered False 00:22:35.884010 run create_hlr_db(pid=2027): Terminated: ok {rc=0} 00:22:36.325399 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2032): Launched 00:22:36.644141 run osmo-hlr_10.42.42.2(pid=2033): Launched 00:22:36.764935 run osmo-stp_10.42.42.5: Starting osmo-stp 00:22:37.316292 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2035): Launched 00:22:37.634737 run osmo-stp_10.42.42.5(pid=2036): Launched 00:22:37.756037 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:22:38.304355 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2038): Launched 00:22:38.425507 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:22:38.694145 run patchelf(pid=2039): Launched 00:22:38.870685 run osmo-stp_10.42.42.5(pid=2036): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2036)] 00:22:39.005229 run osmo-stp_10.42.42.5(pid=2036): stdout: | (launched: 2022-12-10_00:22:37.576363) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:22:39.141863 run osmo-stp_10.42.42.5(pid=2036): stderr: | 20221210002237769 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002237769 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002237769 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002237769 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002237770 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002237770 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002237770 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:22:39.278100 run osmo-stp_10.42.42.5(pid=2036): stdout: | (launched: 2022-12-10_00:22:37.576363) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:22:39.408372 run osmo-stp_10.42.42.5(pid=2036): stderr: | 20221210002237769 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002237769 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002237769 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002237769 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002237770 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002237770 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002237770 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:22:39.562731 run patchelf(pid=2039): Terminating (SIGINT) 00:22:39.741641 run patchelf(pid=2039): Terminated: ok {rc=0} 00:22:39.870245 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=2036): Process ended prematurely: osmo-stp_10.42.42.5(pid=2036) [trial-2366↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2036)] [trial-2366↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27] 00:22:39.879799 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 00:22:39.908851 run osmo-hlr_10.42.42.2(pid=2033): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2033)] 00:22:39.959062 run osmo-hlr_10.42.42.2(pid=2033): stdout: | (launched: 2022-12-10_00:22:36.586178) 00:22:40.011414 run osmo-hlr_10.42.42.2(pid=2033): stderr: | 20221210002236783 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210002236783 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210002236783 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210002236783 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210002236783 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210002236783 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210002236795 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:nanobts+band-900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210002236804 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210002236804 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210002236804 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:22:40.063494 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2032): Terminating (SIGTERM) 00:22:40.105707 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2035): Terminating (SIGTERM) 00:22:40.147722 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2038): Terminating (SIGTERM) 00:22:40.190060 --- ParallelTerminationStrategy: PID 2032 died... 00:22:40.210143 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2032): Terminated: ok {rc=0} 00:22:40.256773 --- ParallelTerminationStrategy: PID 2035 died... 00:22:40.276406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2035): Terminated: ok {rc=0} 00:22:40.322668 --- ParallelTerminationStrategy: PID 2038 died... 00:22:40.342235 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2038): Terminated: ok {rc=0} 00:22:40.429490 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2366 gprs:nanobts+band-900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 gprs:nanobts+band-900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 00:22:41.731460 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:22:41.738303 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 00:22:41.770050 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 00:22:41.808276 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 00:22:41.894938 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 00:22:41.928655 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 00:22:41.969367 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 00:22:42.564311 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2366 gprs:nanobts+band-900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 00:22:42.617490 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:22:42.629139 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:22:42.697565 tst cs_paging_gprs_active.py: using LAC 24699 00:22:42.820094 tst cs_paging_gprs_active.py: using RAC 219 00:22:42.939413 tst cs_paging_gprs_active.py: using CellId 24699 00:22:43.060554 tst cs_paging_gprs_active.py: using BVCI 24700 00:22:43.172025 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:22:43.183007 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:22:43.193707 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:22:43.204890 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:22:43.216129 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:22:43.227391 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:22:43.238759 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:22:43.250403 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:22:43.261358 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:22:43.382832 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:22:43.503309 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 00:22:43.722870 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:22:44.048020 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2043): Launched 00:22:44.328344 run iperf3-srv_10.42.42.10(pid=2044): Launched 00:22:44.449554 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 00:22:44.667493 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:22:44.991651 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2045): Launched 00:22:45.272687 run iperf3-srv_10.42.42.10(pid=2046): Launched 00:22:45.393742 tst cs_paging_gprs_active.py:38: start network... 00:22:45.611452 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:22:46.128270 run create_hlr_db(pid=2047): Launched 00:22:46.261507 bus /gobi_6: Setting Powered False 00:22:47.325736 run create_hlr_db(pid=2047): Terminated: ok {rc=0} 00:22:47.777293 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2049): Launched 00:22:48.100826 run osmo-hlr_10.42.42.2(pid=2050): Launched 00:22:48.224560 run osmo-stp_10.42.42.5: Starting osmo-stp 00:22:48.782043 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2052): Launched 00:22:49.105703 run osmo-stp_10.42.42.5(pid=2053): Launched 00:22:49.228675 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:22:49.785041 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2055): Launched 00:22:49.908244 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:22:50.181224 run patchelf(pid=2056): Launched 00:22:50.360370 run osmo-stp_10.42.42.5(pid=2053): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2053)] 00:22:50.496860 run osmo-stp_10.42.42.5(pid=2053): stdout: | (launched: 2022-12-10_00:22:49.046777) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:22:50.635282 run osmo-stp_10.42.42.5(pid=2053): stderr: | 20221210002249239 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002249239 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002249239 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002249240 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002249242 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002249242 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002249242 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:22:50.774538 run osmo-stp_10.42.42.5(pid=2053): stdout: | (launched: 2022-12-10_00:22:49.046777) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:22:50.906928 run osmo-stp_10.42.42.5(pid=2053): stderr: | 20221210002249239 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002249239 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002249239 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002249240 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002249242 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002249242 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002249242 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:22:51.063978 run patchelf(pid=2056): Terminating (SIGINT) 00:22:51.245309 run patchelf(pid=2056): Terminated: ok {rc=0} 00:22:51.375868 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=2053): Process ended prematurely: osmo-stp_10.42.42.5(pid=2053) [trial-2366↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2053)] [trial-2366↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 00:22:51.386264 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 00:22:51.415562 run osmo-hlr_10.42.42.2(pid=2050): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2050)] 00:22:51.465539 run osmo-hlr_10.42.42.2(pid=2050): stdout: | (launched: 2022-12-10_00:22:48.041946) 00:22:51.517443 run osmo-hlr_10.42.42.2(pid=2050): stderr: | 20221210002248241 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210002248242 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210002248242 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210002248242 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210002248242 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210002248242 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210002248254 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:nanobts+band-900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210002248262 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210002248262 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210002248262 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:22:51.569786 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2043): Terminating (SIGTERM) 00:22:51.611395 run iperf3-srv_10.42.42.10(pid=2044): Terminating (SIGTERM) 00:22:51.653038 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2045): Terminating (SIGTERM) 00:22:51.695132 run iperf3-srv_10.42.42.10(pid=2046): Terminating (SIGTERM) 00:22:51.736795 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2049): Terminating (SIGTERM) 00:22:51.779051 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2052): Terminating (SIGTERM) 00:22:51.820667 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2055): Terminating (SIGTERM) 00:22:51.863649 --- ParallelTerminationStrategy: PID 2043 died... 00:22:51.883986 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2043): Terminated: ok {rc=0} 00:22:51.930952 --- ParallelTerminationStrategy: PID 2044 died... 00:22:51.950529 run iperf3-srv_10.42.42.10(pid=2044): Terminated {rc=256} 00:22:51.997354 --- ParallelTerminationStrategy: PID 2045 died... 00:22:52.017067 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2045): Terminated: ok {rc=0} 00:22:52.063457 --- ParallelTerminationStrategy: PID 2046 died... 00:22:52.083131 run iperf3-srv_10.42.42.10(pid=2046): Terminated {rc=256} 00:22:52.129558 --- ParallelTerminationStrategy: PID 2049 died... 00:22:52.149176 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2049): Terminated: ok {rc=0} 00:22:52.195677 --- ParallelTerminationStrategy: PID 2052 died... 00:22:52.215258 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2052): Terminated: ok {rc=0} 00:22:52.261649 --- ParallelTerminationStrategy: PID 2055 died... 00:22:52.281299 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2055): Terminated: ok {rc=0} 00:22:52.369035 bus /gobi_0: Setting Powered False 00:22:53.466637 bus /gobi_0: Setting Powered False 00:22:54.580135 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 00:22:55.726551 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:22:55.738117 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:22:55.807646 tst iperf3.py: using LAC 24700 00:22:55.930622 tst iperf3.py: using RAC 220 00:22:56.048860 tst iperf3.py: using CellId 24700 00:22:56.174903 tst iperf3.py: using BVCI 24701 00:22:56.293899 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:22:56.305761 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:22:56.317226 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:22:56.329126 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:22:56.340784 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:22:56.352885 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:22:56.364774 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:22:56.376451 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:22:56.388361 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:22:56.505226 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 00:22:56.708183 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:22:57.011291 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2057): Launched 00:22:57.274540 run iperf3-srv_10.42.42.10(pid=2058): Launched 00:22:57.387108 tst iperf3.py:8: start network... 00:22:57.589690 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:22:58.057715 run create_hlr_db(pid=2059): Launched 00:22:58.181929 bus /gobi_6: Setting Powered False 00:22:59.242397 run create_hlr_db(pid=2059): Terminated: ok {rc=0} 00:22:59.683426 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2061): Launched 00:23:00.008261 run osmo-hlr_10.42.42.2(pid=2062): Launched 00:23:00.132398 run osmo-stp_10.42.42.5: Starting osmo-stp 00:23:00.693979 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2064): Launched 00:23:01.047891 run osmo-stp_10.42.42.5(pid=2065): Launched 00:23:01.396510 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:23:02.037717 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2067): Launched 00:23:02.188020 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:23:02.466452 run patchelf(pid=2078): Launched 00:23:02.646548 run osmo-stp_10.42.42.5(pid=2065): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2065)] 00:23:02.782460 run osmo-stp_10.42.42.5(pid=2065): stdout: | (launched: 2022-12-10_00:23:00.974344) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:23:02.917329 run osmo-stp_10.42.42.5(pid=2065): stderr: | 20221210002301289 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002301289 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002301290 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002301290 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002301290 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002301290 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002301291 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:23:03.050746 run osmo-stp_10.42.42.5(pid=2065): stdout: | (launched: 2022-12-10_00:23:00.974344) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:23:03.179330 run osmo-stp_10.42.42.5(pid=2065): stderr: | 20221210002301289 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002301289 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002301290 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002301290 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002301290 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002301290 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002301291 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:23:03.332076 run patchelf(pid=2078): Terminating (SIGINT) 00:23:03.507252 run patchelf(pid=2078): Terminated: ok {rc=0} 00:23:03.637330 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2065): Process ended prematurely: osmo-stp_10.42.42.5(pid=2065) [trial-2366↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2065)] [trial-2366↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8] 00:23:03.648120 tst iperf3.py:8: Test FAILED (8.0 sec) 00:23:03.679057 run osmo-hlr_10.42.42.2(pid=2062): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2062)] 00:23:03.731698 run osmo-hlr_10.42.42.2(pid=2062): stdout: | (launched: 2022-12-10_00:22:59.949093) 00:23:03.784001 run osmo-hlr_10.42.42.2(pid=2062): stderr: | 20221210002300148 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210002300148 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210002300149 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210002300149 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210002300149 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210002300149 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210002300160 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210002300169 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210002300169 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210002300169 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:23:03.836466 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2057): Terminating (SIGTERM) 00:23:03.878475 run iperf3-srv_10.42.42.10(pid=2058): Terminating (SIGTERM) 00:23:03.922427 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2061): Terminating (SIGTERM) 00:23:03.965168 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2064): Terminating (SIGTERM) 00:23:04.009101 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2067): Terminating (SIGTERM) 00:23:04.053692 --- ParallelTerminationStrategy: PID 2057 died... 00:23:04.073372 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2057): Terminated: ok {rc=0} 00:23:04.123305 --- ParallelTerminationStrategy: PID 2058 died... 00:23:04.143129 run iperf3-srv_10.42.42.10(pid=2058): Terminated {rc=256} 00:23:04.190317 --- ParallelTerminationStrategy: PID 2061 died... 00:23:04.210696 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2061): Terminated: ok {rc=0} 00:23:04.256735 --- ParallelTerminationStrategy: PID 2064 died... 00:23:04.276717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2064): Terminated: ok {rc=0} 00:23:04.323513 --- ParallelTerminationStrategy: PID 2067 died... 00:23:04.343840 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2067): Terminated: ok {rc=0} 00:23:04.431318 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 00:23:05.585121 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:05.598203 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:23:05.669245 tst iperf3m4.py: using LAC 24701 00:23:05.799711 tst iperf3m4.py: using RAC 221 00:23:05.925320 tst iperf3m4.py: using CellId 24701 00:23:06.052270 tst iperf3m4.py: using BVCI 24702 00:23:06.171260 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:06.184048 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:06.196504 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:06.211345 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:06.223766 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:06.236877 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:06.251806 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:06.265682 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:06.278118 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:23:06.403514 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:23:06.530782 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:23:06.654427 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:23:06.777594 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 00:23:06.986058 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:23:07.322417 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2082): Launched 00:23:07.620209 run iperf3-srv_10.42.42.10(pid=2083): Launched 00:23:07.750169 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 00:23:07.957528 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:23:08.277701 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2084): Launched 00:23:08.585735 run iperf3-srv_10.42.42.10(pid=2085): Launched 00:23:08.713182 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 00:23:08.920311 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:23:09.242150 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2086): Launched 00:23:09.527082 run iperf3-srv_10.42.42.10(pid=2087): Launched 00:23:09.657372 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 00:23:09.865803 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:23:10.189779 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2088): Launched 00:23:10.488307 run iperf3-srv_10.42.42.10(pid=2089): Launched 00:23:10.625741 tst iperf3m4.py:8: start network... 00:23:10.849218 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:23:11.370726 run create_hlr_db(pid=2090): Launched 00:23:11.535122 bus /gobi_6: Setting Powered False 00:23:12.623361 run create_hlr_db(pid=2090): Terminated: ok {rc=0} 00:23:13.181730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2226): Launched 00:23:13.589992 run osmo-hlr_10.42.42.2(pid=2272): Launched 00:23:13.871186 run osmo-stp_10.42.42.5: Starting osmo-stp 00:23:14.569725 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2354): Launched 00:23:14.913797 run osmo-stp_10.42.42.5(pid=2355): Launched 00:23:15.167631 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:23:15.823598 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2357): Launched 00:23:16.001110 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:23:16.323436 run patchelf(pid=2358): Launched 00:23:16.602577 run osmo-stp_10.42.42.5(pid=2355): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2355)] 00:23:16.738453 run osmo-stp_10.42.42.5(pid=2355): stdout: | (launched: 2022-12-10_00:23:14.849715) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:23:16.871792 run osmo-stp_10.42.42.5(pid=2355): stderr: | 20221210002315156 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002315156 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002315156 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002315156 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002315157 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002315157 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002315157 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:23:17.002395 run osmo-stp_10.42.42.5(pid=2355): stdout: | (launched: 2022-12-10_00:23:14.849715) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:23:17.126697 run osmo-stp_10.42.42.5(pid=2355): stderr: | 20221210002315156 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002315156 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002315156 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002315156 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002315157 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002315157 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002315157 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:23:17.274637 run patchelf(pid=2358): Terminating (SIGINT) 00:23:17.447137 run patchelf(pid=2358): Terminated: ok {rc=0} 00:23:17.572151 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2355): Process ended prematurely: osmo-stp_10.42.42.5(pid=2355) [trial-2366↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2355)] [trial-2366↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 00:23:17.582719 tst iperf3m4.py:8: Test FAILED (12.0 sec) 00:23:17.610848 run osmo-hlr_10.42.42.2(pid=2272): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2272)] 00:23:17.659227 run osmo-hlr_10.42.42.2(pid=2272): stdout: | (launched: 2022-12-10_00:23:13.505857) 00:23:17.709773 run osmo-hlr_10.42.42.2(pid=2272): stderr: | 20221210002313898 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210002313898 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210002313898 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210002313898 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210002313898 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210002313898 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210002313919 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210002313927 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210002313927 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210002313927 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:23:17.760539 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2082): Terminating (SIGTERM) 00:23:17.800761 run iperf3-srv_10.42.42.10(pid=2083): Terminating (SIGTERM) 00:23:17.842596 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2084): Terminating (SIGTERM) 00:23:17.884375 run iperf3-srv_10.42.42.10(pid=2085): Terminating (SIGTERM) 00:23:17.925990 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2086): Terminating (SIGTERM) 00:23:17.967027 run iperf3-srv_10.42.42.10(pid=2087): Terminating (SIGTERM) 00:23:18.010354 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2088): Terminating (SIGTERM) 00:23:18.051069 run iperf3-srv_10.42.42.10(pid=2089): Terminating (SIGTERM) 00:23:18.091378 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2226): Terminating (SIGTERM) 00:23:18.131864 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2354): Terminating (SIGTERM) 00:23:18.173726 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2357): Terminating (SIGTERM) 00:23:18.214508 --- ParallelTerminationStrategy: PID 2082 died... 00:23:18.233715 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2082): Terminated: ok {rc=0} 00:23:18.278270 --- ParallelTerminationStrategy: PID 2083 died... 00:23:18.297404 run iperf3-srv_10.42.42.10(pid=2083): Terminated {rc=256} 00:23:18.342036 --- ParallelTerminationStrategy: PID 2084 died... 00:23:18.361507 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2084): Terminated: ok {rc=0} 00:23:18.406170 --- ParallelTerminationStrategy: PID 2085 died... 00:23:18.425389 run iperf3-srv_10.42.42.10(pid=2085): Terminated {rc=256} 00:23:18.469942 --- ParallelTerminationStrategy: PID 2086 died... 00:23:18.489159 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2086): Terminated: ok {rc=0} 00:23:18.533916 --- ParallelTerminationStrategy: PID 2087 died... 00:23:18.553970 run iperf3-srv_10.42.42.10(pid=2087): Terminated {rc=256} 00:23:18.599345 --- ParallelTerminationStrategy: PID 2088 died... 00:23:18.618819 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2088): Terminated: ok {rc=0} 00:23:18.663857 --- ParallelTerminationStrategy: PID 2089 died... 00:23:18.683146 run iperf3-srv_10.42.42.10(pid=2089): Terminated {rc=256} 00:23:18.728397 --- ParallelTerminationStrategy: PID 2226 died... 00:23:18.747776 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2226): Terminated: ok {rc=0} 00:23:18.792581 --- ParallelTerminationStrategy: PID 2354 died... 00:23:18.812050 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2354): Terminated: ok {rc=0} 00:23:18.857205 --- ParallelTerminationStrategy: PID 2357 died... 00:23:18.876433 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2357): Terminated: ok {rc=0} 00:23:18.962257 bus /gobi_4: Setting Powered False 00:23:20.059546 bus /gobi_4: Setting Powered False 00:23:21.176535 bus /gobi_1: Setting Powered False 00:23:22.275632 bus /gobi_1: Setting Powered False 00:23:23.392315 bus /gobi_0: Setting Powered False 00:23:24.494285 bus /gobi_0: Setting Powered False 00:23:25.612249 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 00:23:26.716230 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:26.728372 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:23:26.801063 tst ping.py: using LAC 24702 00:23:26.917280 tst ping.py: using RAC 222 00:23:27.042452 tst ping.py: using CellId 24702 00:23:27.166165 tst ping.py: using BVCI 24703 00:23:27.282375 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:27.294142 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:27.305618 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:27.317216 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:27.329346 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:27.340924 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:27.352646 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:27.364231 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:23:27.481186 tst ping.py:19: start network... 00:23:27.695067 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:23:28.185479 run create_hlr_db(pid=2360): Launched 00:23:28.306286 bus /gobi_6: Setting Powered False 00:23:29.369473 run create_hlr_db(pid=2360): Terminated: ok {rc=0} 00:23:29.808694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2362): Launched 00:23:30.125337 run osmo-hlr_10.42.42.2(pid=2363): Launched 00:23:30.247111 run osmo-stp_10.42.42.5: Starting osmo-stp 00:23:30.799220 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2365): Launched 00:23:31.141685 run osmo-stp_10.42.42.5(pid=2366): Launched 00:23:31.378918 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:23:32.052124 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2368): Launched 00:23:32.191473 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:23:32.443559 run patchelf(pid=2369): Launched 00:23:32.609087 run osmo-stp_10.42.42.5(pid=2366): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2366)] 00:23:32.733919 run osmo-stp_10.42.42.5(pid=2366): stdout: | (launched: 2022-12-10_00:23:31.073876) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:23:32.860803 run osmo-stp_10.42.42.5(pid=2366): stderr: | 20221210002331407 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002331407 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002331408 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002331408 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002331409 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002331409 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002331409 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:23:32.988077 run osmo-stp_10.42.42.5(pid=2366): stdout: | (launched: 2022-12-10_00:23:31.073876) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:23:33.109312 run osmo-stp_10.42.42.5(pid=2366): stderr: | 20221210002331407 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002331407 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002331408 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002331408 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002331409 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002331409 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002331409 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:23:33.252408 run patchelf(pid=2369): Terminating (SIGINT) 00:23:33.418352 run patchelf(pid=2369): Terminated: ok {rc=0} 00:23:33.537600 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=2366): Process ended prematurely: osmo-stp_10.42.42.5(pid=2366) [trial-2366↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2366)] [trial-2366↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22] 00:23:33.546444 tst ping.py:22: Test FAILED (6.8 sec) 00:23:33.572924 run osmo-hlr_10.42.42.2(pid=2363): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2363)] 00:23:33.620212 run osmo-hlr_10.42.42.2(pid=2363): stdout: | (launched: 2022-12-10_00:23:30.067133) 00:23:33.668892 run osmo-hlr_10.42.42.2(pid=2363): stderr: | 20221210002330264 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210002330264 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210002330264 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210002330264 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210002330264 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210002330264 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210002330276 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210002330286 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210002330287 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210002330287 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:23:33.718717 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2362): Terminating (SIGTERM) 00:23:33.758214 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2365): Terminating (SIGTERM) 00:23:33.797626 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2368): Terminating (SIGTERM) 00:23:33.838032 --- ParallelTerminationStrategy: PID 2362 died... 00:23:33.856868 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2362): Terminated: ok {rc=0} 00:23:33.901578 --- ParallelTerminationStrategy: PID 2365 died... 00:23:33.920666 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2365): Terminated: ok {rc=0} 00:23:33.965367 --- ParallelTerminationStrategy: PID 2368 died... 00:23:33.984139 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2368): Terminated: ok {rc=0} 00:23:34.068341 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 00:23:35.155325 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:35.167829 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 00:23:35.238919 tst ping_idle_ping.py: using LAC 24703 00:23:35.364202 tst ping_idle_ping.py: using RAC 223 00:23:35.488513 tst ping_idle_ping.py: using CellId 24703 00:23:35.615413 tst ping_idle_ping.py: using BVCI 24704 00:23:35.733817 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:35.745288 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:35.756415 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:35.768463 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:35.780442 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:35.792595 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:35.805423 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 00:23:35.817693 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 00:23:35.938745 tst ping_idle_ping.py:24: start network... 00:23:36.155007 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:23:36.652889 run create_hlr_db(pid=2370): Launched 00:23:36.773929 bus /gobi_6: Setting Powered False 00:23:37.837959 run create_hlr_db(pid=2370): Terminated: ok {rc=0} 00:23:38.265477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2372): Launched 00:23:38.565539 run osmo-hlr_10.42.42.2(pid=2373): Launched 00:23:38.681115 run osmo-stp_10.42.42.5: Starting osmo-stp 00:23:39.195536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2375): Launched 00:23:39.491444 run osmo-stp_10.42.42.5(pid=2376): Launched 00:23:39.605662 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:23:40.119142 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2378): Launched 00:23:40.232197 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:23:40.483221 run patchelf(pid=2379): Launched 00:23:40.648478 run osmo-stp_10.42.42.5(pid=2376): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2376)] 00:23:40.773512 run osmo-stp_10.42.42.5(pid=2376): stdout: | (launched: 2022-12-10_00:23:39.436668) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:23:40.900362 run osmo-stp_10.42.42.5(pid=2376): stderr: | 20221210002339609 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002339609 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002339609 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002339610 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002339610 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002339610 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002339610 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:23:41.027233 run osmo-stp_10.42.42.5(pid=2376): stdout: | (launched: 2022-12-10_00:23:39.436668) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:23:41.148530 run osmo-stp_10.42.42.5(pid=2376): stderr: | 20221210002339609 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002339609 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002339609 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002339610 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002339610 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002339610 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002339610 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:23:41.292328 run patchelf(pid=2379): Terminating (SIGINT) 00:23:41.458783 run patchelf(pid=2379): Terminated: ok {rc=0} 00:23:41.578944 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=2376): Process ended prematurely: osmo-stp_10.42.42.5(pid=2376) [trial-2366↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2376)] [trial-2366↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 00:23:41.587801 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 00:23:41.614349 run osmo-hlr_10.42.42.2(pid=2373): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2373)] 00:23:41.661367 run osmo-hlr_10.42.42.2(pid=2373): stdout: | (launched: 2022-12-10_00:23:38.510302) 00:23:41.710236 run osmo-hlr_10.42.42.2(pid=2373): stderr: | 20221210002338684 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210002338684 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210002338684 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210002338684 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210002338684 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210002338685 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210002338697 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210002338707 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210002338707 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210002338707 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:23:41.759413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2372): Terminating (SIGTERM) 00:23:41.798981 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2375): Terminating (SIGTERM) 00:23:41.838544 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2378): Terminating (SIGTERM) 00:23:41.878197 --- ParallelTerminationStrategy: PID 2372 died... 00:23:41.897437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2372): Terminated: ok {rc=0} 00:23:41.941177 --- ParallelTerminationStrategy: PID 2375 died... 00:23:41.959703 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2375): Terminated: ok {rc=0} 00:23:42.003244 --- ParallelTerminationStrategy: PID 2378 died... 00:23:42.021793 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2378): Terminated: ok {rc=0} 00:23:42.104613 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2366 gprs:nanobts+band-900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 00:23:43.407545 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:23:43.414728 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 00:23:43.446256 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 00:23:43.484166 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 00:23:43.569176 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 00:23:43.600712 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 00:23:43.638642 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 00:23:44.241971 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2366 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 00:23:44.289939 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:23:44.301232 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 00:23:44.349850 tst cs_paging_gprs_active.py: using LAC 24704 00:23:44.466233 tst cs_paging_gprs_active.py: using RAC 224 00:23:44.585279 tst cs_paging_gprs_active.py: using CellId 24704 00:23:44.701053 tst cs_paging_gprs_active.py: using BVCI 24705 00:23:44.808426 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:23:44.819865 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:23:44.831143 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:23:44.842371 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:23:44.853530 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:23:44.864553 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:23:44.875745 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:23:44.886844 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:23:44.898158 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 00:23:45.016332 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 00:23:45.135158 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 00:23:45.352027 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:23:45.672055 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2386): Launched 00:23:45.986452 run iperf3-srv_10.42.42.10(pid=2387): Launched 00:23:46.113178 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 00:23:46.332283 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:23:46.683927 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2388): Launched 00:23:46.979614 run iperf3-srv_10.42.42.10(pid=2389): Launched 00:23:47.114297 tst cs_paging_gprs_active.py:38: start network... 00:23:47.331922 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:23:47.825941 run create_hlr_db(pid=2390): Launched 00:23:47.947080 bus /gobi_6: Setting Powered False 00:23:49.010584 run create_hlr_db(pid=2390): Terminated: ok {rc=0} 00:23:49.437690 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2392): Launched 00:23:49.737223 run osmo-hlr_10.42.42.2(pid=2393): Launched 00:23:49.850941 run osmo-stp_10.42.42.5: Starting osmo-stp 00:23:50.379614 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2395): Launched 00:23:50.678027 run osmo-stp_10.42.42.5(pid=2396): Launched 00:23:50.791818 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:23:51.325132 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2398): Launched 00:23:51.438870 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:23:51.690890 run patchelf(pid=2399): Launched 00:23:51.855699 run osmo-stp_10.42.42.5(pid=2396): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2396)] 00:23:52.006503 run osmo-stp_10.42.42.5(pid=2396): stdout: | (launched: 2022-12-10_00:23:50.623458) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:23:52.134073 run osmo-stp_10.42.42.5(pid=2396): stderr: | 20221210002350794 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002350794 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002350795 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002350795 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002350795 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002350795 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002350796 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:23:52.262235 run osmo-stp_10.42.42.5(pid=2396): stdout: | (launched: 2022-12-10_00:23:50.623458) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:23:52.384032 run osmo-stp_10.42.42.5(pid=2396): stderr: | 20221210002350794 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002350794 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002350795 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002350795 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002350795 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002350795 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002350796 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:23:52.528303 run patchelf(pid=2399): Terminating (SIGINT) 00:23:52.695115 run patchelf(pid=2399): Terminated: ok {rc=0} 00:23:52.816142 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=2396): Process ended prematurely: osmo-stp_10.42.42.5(pid=2396) [trial-2366↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2396)] [trial-2366↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 00:23:52.825727 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 00:23:52.852227 run osmo-hlr_10.42.42.2(pid=2393): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2393)] 00:23:52.899254 run osmo-hlr_10.42.42.2(pid=2393): stdout: | (launched: 2022-12-10_00:23:49.682398) 00:23:52.948104 run osmo-hlr_10.42.42.2(pid=2393): stderr: | 20221210002349858 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210002349858 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210002349858 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210002349859 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210002349859 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210002349859 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210002349871 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210002349881 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210002349881 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210002349881 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:23:52.997131 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2386): Terminating (SIGTERM) 00:23:53.036273 run iperf3-srv_10.42.42.10(pid=2387): Terminating (SIGTERM) 00:23:53.075212 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2388): Terminating (SIGTERM) 00:23:53.114296 run iperf3-srv_10.42.42.10(pid=2389): Terminating (SIGTERM) 00:23:53.153111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2392): Terminating (SIGTERM) 00:23:53.192127 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2395): Terminating (SIGTERM) 00:23:53.231223 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2398): Terminating (SIGTERM) 00:23:53.270526 --- ParallelTerminationStrategy: PID 2386 died... 00:23:53.289346 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2386): Terminated: ok {rc=0} 00:23:53.333145 --- ParallelTerminationStrategy: PID 2387 died... 00:23:53.351286 run iperf3-srv_10.42.42.10(pid=2387): Terminated {rc=256} 00:23:53.394866 --- ParallelTerminationStrategy: PID 2388 died... 00:23:53.413261 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2388): Terminated: ok {rc=0} 00:23:53.456278 --- ParallelTerminationStrategy: PID 2389 died... 00:23:53.474545 run iperf3-srv_10.42.42.10(pid=2389): Terminated {rc=256} 00:23:53.517677 --- ParallelTerminationStrategy: PID 2392 died... 00:23:53.536281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2392): Terminated: ok {rc=0} 00:23:53.579349 --- ParallelTerminationStrategy: PID 2395 died... 00:23:53.597620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2395): Terminated: ok {rc=0} 00:23:53.641200 --- ParallelTerminationStrategy: PID 2398 died... 00:23:53.659500 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2398): Terminated: ok {rc=0} 00:23:53.744420 bus /gobi_0: Setting Powered False 00:23:54.843600 bus /gobi_0: Setting Powered False 00:23:55.957688 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 00:23:57.106570 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:23:57.119137 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 00:23:57.170295 tst iperf3.py: using LAC 24705 00:23:57.296082 tst iperf3.py: using RAC 225 00:23:57.420017 tst iperf3.py: using CellId 24705 00:23:57.544710 tst iperf3.py: using BVCI 24706 00:23:57.662282 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:23:57.674192 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:23:57.685884 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:23:57.698091 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:23:57.710043 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:23:57.721810 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:23:57.733886 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:23:57.745688 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:23:57.757653 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 00:23:57.879064 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 00:23:58.093650 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:23:58.412139 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2400): Launched 00:23:58.687412 run iperf3-srv_10.42.42.10(pid=2401): Launched 00:23:58.805947 tst iperf3.py:8: start network... 00:23:59.020038 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:23:59.512621 run create_hlr_db(pid=2402): Launched 00:23:59.634074 bus /gobi_6: Setting Powered False 00:24:00.694644 run create_hlr_db(pid=2402): Terminated: ok {rc=0} 00:24:01.162438 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2404): Launched 00:24:01.506220 run osmo-hlr_10.42.42.2(pid=2405): Launched 00:24:01.722848 run osmo-stp_10.42.42.5: Starting osmo-stp 00:24:02.397946 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2407): Launched 00:24:02.714266 run osmo-stp_10.42.42.5(pid=2408): Launched 00:24:02.835191 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:24:03.382624 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2410): Launched 00:24:03.504116 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:24:03.773541 run patchelf(pid=2411): Launched 00:24:03.950382 run osmo-stp_10.42.42.5(pid=2408): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2408)] 00:24:04.086227 run osmo-stp_10.42.42.5(pid=2408): stdout: | (launched: 2022-12-10_00:24:02.656699) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:24:04.223718 run osmo-stp_10.42.42.5(pid=2408): stderr: | 20221210002402848 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002402848 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002402848 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002402848 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002402849 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002402849 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002402849 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:24:04.361734 run osmo-stp_10.42.42.5(pid=2408): stdout: | (launched: 2022-12-10_00:24:02.656699) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:24:04.493104 run osmo-stp_10.42.42.5(pid=2408): stderr: | 20221210002402848 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002402848 [1;32mDLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002402848 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002402848 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002402849 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002402849 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002402849 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:24:04.648607 run patchelf(pid=2411): Terminating (SIGINT) 00:24:04.827945 run patchelf(pid=2411): Terminated: ok {rc=0} 00:24:04.957490 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2408): Process ended prematurely: osmo-stp_10.42.42.5(pid=2408) [trial-2366↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2408)] [trial-2366↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 00:24:04.967738 tst iperf3.py:8: Test FAILED (7.9 sec) 00:24:04.996707 run osmo-hlr_10.42.42.2(pid=2405): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2405)] 00:24:05.047506 run osmo-hlr_10.42.42.2(pid=2405): stdout: | (launched: 2022-12-10_00:24:01.439887) 00:24:05.099522 run osmo-hlr_10.42.42.2(pid=2405): stderr: | 20221210002401752 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210002401752 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210002401752 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210002401752 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210002401752 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210002401752 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210002401773 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210002401781 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210002401782 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210002401782 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:24:05.151886 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2400): Terminating (SIGTERM) 00:24:05.193923 run iperf3-srv_10.42.42.10(pid=2401): Terminating (SIGTERM) 00:24:05.235887 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2404): Terminating (SIGTERM) 00:24:05.278018 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2407): Terminating (SIGTERM) 00:24:05.319960 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2410): Terminating (SIGTERM) 00:24:05.362403 --- ParallelTerminationStrategy: PID 2400 died... 00:24:05.382642 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2400): Terminated: ok {rc=0} 00:24:05.429718 --- ParallelTerminationStrategy: PID 2401 died... 00:24:05.449102 run iperf3-srv_10.42.42.10(pid=2401): Terminated {rc=256} 00:24:05.495373 --- ParallelTerminationStrategy: PID 2404 died... 00:24:05.514842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2404): Terminated: ok {rc=0} 00:24:05.561418 --- ParallelTerminationStrategy: PID 2407 died... 00:24:05.580765 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2407): Terminated: ok {rc=0} 00:24:05.627063 --- ParallelTerminationStrategy: PID 2410 died... 00:24:05.646596 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2410): Terminated: ok {rc=0} 00:24:05.734388 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 00:24:06.883166 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:06.895613 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 00:24:06.953307 tst iperf3m4.py: using LAC 24706 00:24:07.078333 tst iperf3m4.py: using RAC 226 00:24:07.201487 tst iperf3m4.py: using CellId 24706 00:24:07.324019 tst iperf3m4.py: using BVCI 24707 00:24:07.441000 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:07.453018 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:07.464720 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:07.476773 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:07.488671 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:07.500480 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:07.512503 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:07.524738 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:07.536639 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 00:24:07.654901 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 00:24:07.774805 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 00:24:07.894342 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 00:24:08.014669 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 00:24:08.231300 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:24:08.550720 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2412): Launched 00:24:08.826821 run iperf3-srv_10.42.42.10(pid=2413): Launched 00:24:08.945727 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 00:24:09.160843 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:24:09.479973 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2414): Launched 00:24:09.755921 run iperf3-srv_10.42.42.10(pid=2415): Launched 00:24:09.874607 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 00:24:10.089671 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:24:10.408922 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2416): Launched 00:24:10.684417 run iperf3-srv_10.42.42.10(pid=2417): Launched 00:24:10.803222 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 00:24:11.017874 run iperf3-srv_10.42.42.10: Starting iperf3-srv 00:24:11.336925 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2418): Launched 00:24:11.612402 run iperf3-srv_10.42.42.10(pid=2419): Launched 00:24:11.731214 tst iperf3m4.py:8: start network... 00:24:11.945536 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:24:12.441212 run create_hlr_db(pid=2420): Launched 00:24:12.562605 bus /gobi_6: Setting Powered False 00:24:13.625468 run create_hlr_db(pid=2420): Terminated: ok {rc=0} 00:24:14.067995 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2422): Launched 00:24:14.386342 run osmo-hlr_10.42.42.2(pid=2423): Launched 00:24:14.507999 run osmo-stp_10.42.42.5: Starting osmo-stp 00:24:15.056120 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2425): Launched 00:24:15.374627 run osmo-stp_10.42.42.5(pid=2426): Launched 00:24:15.496185 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:24:16.061721 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2428): Launched 00:24:16.183561 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:24:16.463280 run patchelf(pid=2429): Launched 00:24:16.641263 run osmo-stp_10.42.42.5(pid=2426): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2426)] 00:24:16.772768 run osmo-stp_10.42.42.5(pid=2426): stdout: | (launched: 2022-12-10_00:24:15.316711) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:24:16.904459 run osmo-stp_10.42.42.5(pid=2426): stderr: | 20221210002415506 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002415506 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002415507 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002415507 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002415507 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002415507 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002415507 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:24:17.037654 run osmo-stp_10.42.42.5(pid=2426): stdout: | (launched: 2022-12-10_00:24:15.316711) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:24:17.163957 run osmo-stp_10.42.42.5(pid=2426): stderr: | 20221210002415506 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002415506 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002415507 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002415507 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002415507 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002415507 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002415507 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:24:17.310186 run patchelf(pid=2429): Terminating (SIGINT) 00:24:17.477992 run patchelf(pid=2429): Terminated: ok {rc=0} 00:24:17.599356 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2426): Process ended prematurely: osmo-stp_10.42.42.5(pid=2426) [trial-2366↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2426)] [trial-2366↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 00:24:17.612750 tst iperf3m4.py:8: Test FAILED (10.8 sec) 00:24:17.642307 run osmo-hlr_10.42.42.2(pid=2423): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2423)] 00:24:17.692833 run osmo-hlr_10.42.42.2(pid=2423): stdout: | (launched: 2022-12-10_00:24:14.328074) 00:24:17.745294 run osmo-hlr_10.42.42.2(pid=2423): stderr: | 20221210002414524 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210002414524 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210002414524 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210002414524 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210002414525 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210002414525 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210002414549 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210002414560 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210002414560 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210002414560 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:24:17.798053 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2412): Terminating (SIGTERM) 00:24:17.840652 run iperf3-srv_10.42.42.10(pid=2413): Terminating (SIGTERM) 00:24:17.882841 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2414): Terminating (SIGTERM) 00:24:17.925025 run iperf3-srv_10.42.42.10(pid=2415): Terminating (SIGTERM) 00:24:17.966986 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2416): Terminating (SIGTERM) 00:24:18.009316 run iperf3-srv_10.42.42.10(pid=2417): Terminating (SIGTERM) 00:24:18.051598 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2418): Terminating (SIGTERM) 00:24:18.094415 run iperf3-srv_10.42.42.10(pid=2419): Terminating (SIGTERM) 00:24:18.136355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2422): Terminating (SIGTERM) 00:24:18.178733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2425): Terminating (SIGTERM) 00:24:18.220778 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2428): Terminating (SIGTERM) 00:24:18.263153 --- ParallelTerminationStrategy: PID 2412 died... 00:24:18.282966 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2412): Terminated: ok {rc=0} 00:24:18.330101 --- ParallelTerminationStrategy: PID 2413 died... 00:24:18.349726 run iperf3-srv_10.42.42.10(pid=2413): Terminated {rc=256} 00:24:18.396611 --- ParallelTerminationStrategy: PID 2414 died... 00:24:18.416285 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2414): Terminated: ok {rc=0} 00:24:18.462926 --- ParallelTerminationStrategy: PID 2415 died... 00:24:18.482498 run iperf3-srv_10.42.42.10(pid=2415): Terminated {rc=256} 00:24:18.529216 --- ParallelTerminationStrategy: PID 2416 died... 00:24:18.548754 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2416): Terminated: ok {rc=0} 00:24:18.595766 --- ParallelTerminationStrategy: PID 2417 died... 00:24:18.615506 run iperf3-srv_10.42.42.10(pid=2417): Terminated {rc=256} 00:24:18.662104 --- ParallelTerminationStrategy: PID 2418 died... 00:24:18.681642 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2418): Terminated: ok {rc=0} 00:24:18.728309 --- ParallelTerminationStrategy: PID 2419 died... 00:24:18.747795 run iperf3-srv_10.42.42.10(pid=2419): Terminated {rc=256} 00:24:18.794450 --- ParallelTerminationStrategy: PID 2422 died... 00:24:18.814130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2422): Terminated: ok {rc=0} 00:24:18.861176 --- ParallelTerminationStrategy: PID 2425 died... 00:24:18.880755 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2425): Terminated: ok {rc=0} 00:24:18.927499 --- ParallelTerminationStrategy: PID 2428 died... 00:24:18.947046 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2428): Terminated: ok {rc=0} 00:24:19.035463 bus /gobi_4: Setting Powered False 00:24:20.134588 bus /gobi_4: Setting Powered False 00:24:21.251036 bus /gobi_1: Setting Powered False 00:24:22.349088 bus /gobi_1: Setting Powered False 00:24:23.464622 bus /gobi_0: Setting Powered False 00:24:24.563171 bus /gobi_0: Setting Powered False 00:24:25.681495 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 00:24:26.783719 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:26.795833 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 00:24:26.847184 tst ping.py: using LAC 24707 00:24:26.964509 tst ping.py: using RAC 227 00:24:27.081892 tst ping.py: using CellId 24707 00:24:27.199420 tst ping.py: using BVCI 24708 00:24:27.306436 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:27.317954 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:27.329235 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:27.340405 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:27.351564 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:27.362765 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:27.374163 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:27.385359 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 00:24:27.505201 tst ping.py:19: start network... 00:24:27.716931 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:24:28.203447 run create_hlr_db(pid=2430): Launched 00:24:28.322748 bus /gobi_6: Setting Powered False 00:24:29.385253 run create_hlr_db(pid=2430): Terminated: ok {rc=0} 00:24:29.806213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2432): Launched 00:24:30.098634 run osmo-hlr_10.42.42.2(pid=2433): Launched 00:24:30.210586 run osmo-stp_10.42.42.5: Starting osmo-stp 00:24:30.717644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2435): Launched 00:24:31.035283 run osmo-stp_10.42.42.5(pid=2436): Launched 00:24:31.260345 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:24:31.947993 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2438): Launched 00:24:32.064326 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:24:32.313718 run patchelf(pid=2439): Launched 00:24:32.476141 run osmo-stp_10.42.42.5(pid=2436): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2436)] 00:24:32.599839 run osmo-stp_10.42.42.5(pid=2436): stdout: | (launched: 2022-12-10_00:24:30.967561) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:24:32.725828 run osmo-stp_10.42.42.5(pid=2436): stderr: | 20221210002431298 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002431299 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002431299 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002431299 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002431300 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002431300 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002431300 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:24:32.851561 run osmo-stp_10.42.42.5(pid=2436): stdout: | (launched: 2022-12-10_00:24:30.967561) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:24:32.971420 run osmo-stp_10.42.42.5(pid=2436): stderr: | 20221210002431298 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002431299 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002431299 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002431299 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002431300 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002431300 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002431300 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:24:33.113807 run patchelf(pid=2439): Terminating (SIGINT) 00:24:33.278530 run patchelf(pid=2439): Terminated: ok {rc=0} 00:24:33.396871 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=2436): Process ended prematurely: osmo-stp_10.42.42.5(pid=2436) [trial-2366↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2436)] [trial-2366↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 00:24:33.405809 tst ping.py:22: Test FAILED (6.6 sec) 00:24:33.432287 run osmo-hlr_10.42.42.2(pid=2433): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2433)] 00:24:33.479574 run osmo-hlr_10.42.42.2(pid=2433): stdout: | (launched: 2022-12-10_00:24:30.044769) 00:24:33.528821 run osmo-hlr_10.42.42.2(pid=2433): stderr: | 20221210002430219 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210002430219 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210002430220 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210002430220 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210002430220 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210002430220 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210002430232 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210002430242 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210002430243 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210002430243 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:24:33.578475 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2432): Terminating (SIGTERM) 00:24:33.617928 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2435): Terminating (SIGTERM) 00:24:33.657633 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2438): Terminating (SIGTERM) 00:24:33.697531 --- ParallelTerminationStrategy: PID 2432 died... 00:24:33.716521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2432): Terminated: ok {rc=0} 00:24:33.760825 --- ParallelTerminationStrategy: PID 2435 died... 00:24:33.779587 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2435): Terminated: ok {rc=0} 00:24:33.823568 --- ParallelTerminationStrategy: PID 2438 died... 00:24:33.842361 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2438): Terminated: ok {rc=0} 00:24:33.927538 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2366 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 00:24:35.016364 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:35.029082 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 00:24:35.082001 tst ping_idle_ping.py: using LAC 24708 00:24:35.206574 tst ping_idle_ping.py: using RAC 228 00:24:35.327690 tst ping_idle_ping.py: using CellId 24708 00:24:35.451817 tst ping_idle_ping.py: using BVCI 24709 00:24:35.566789 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:35.578979 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:35.590744 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:35.602820 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:35.614802 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:35.626646 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:35.638588 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 00:24:35.650477 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 00:24:35.769872 tst ping_idle_ping.py:24: start network... 00:24:35.981554 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:24:36.470439 run create_hlr_db(pid=2440): Launched 00:24:36.589668 bus /gobi_6: Setting Powered False 00:24:37.652131 run create_hlr_db(pid=2440): Terminated: ok {rc=0} 00:24:38.073144 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2442): Launched 00:24:38.367046 run osmo-hlr_10.42.42.2(pid=2443): Launched 00:24:38.479261 run osmo-stp_10.42.42.5: Starting osmo-stp 00:24:39.002102 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2445): Launched 00:24:39.294472 run osmo-stp_10.42.42.5(pid=2446): Launched 00:24:39.406432 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:24:39.912833 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2448): Launched 00:24:40.025661 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:24:40.273438 run patchelf(pid=2449): Launched 00:24:40.436859 run osmo-stp_10.42.42.5(pid=2446): ERR: Terminated: ERROR {rc=1} [trial-2366↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2446)] 00:24:40.569214 run osmo-stp_10.42.42.5(pid=2446): stdout: | (launched: 2022-12-10_00:24:39.240449) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:24:40.705232 run osmo-stp_10.42.42.5(pid=2446): stderr: | 20221210002439410 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002439410 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002439410 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002439411 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002439411 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002439411 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002439411 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:24:40.840404 run osmo-stp_10.42.42.5(pid=2446): stdout: | (launched: 2022-12-10_00:24:39.240449) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:24:40.969704 run osmo-stp_10.42.42.5(pid=2446): stderr: | 20221210002439410 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002439410 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002439410 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002439411 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002439411 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002439411 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002439411 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:24:41.122933 run patchelf(pid=2449): Terminating (SIGINT) 00:24:41.299099 run patchelf(pid=2449): Terminated: ok {rc=0} 00:24:41.426532 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=2446): Process ended prematurely: osmo-stp_10.42.42.5(pid=2446) [trial-2366↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2446)] [trial-2366↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 00:24:41.436399 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 00:24:41.465188 run osmo-hlr_10.42.42.2(pid=2443): ERR: Terminated: ERROR {rc=237} [trial-2366↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2443)] 00:24:41.515622 run osmo-hlr_10.42.42.2(pid=2443): stdout: | (launched: 2022-12-10_00:24:38.312699) 00:24:41.567772 run osmo-hlr_10.42.42.2(pid=2443): stderr: | 20221210002438486 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210002438486 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210002438486 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210002438486 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210002438486 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210002438486 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210002438498 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210002438509 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210002438509 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210002438509 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:24:41.620705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2442): Terminating (SIGTERM) 00:24:41.663190 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2445): Terminating (SIGTERM) 00:24:41.705712 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2448): Terminating (SIGTERM) 00:24:41.748224 --- ParallelTerminationStrategy: PID 2442 died... 00:24:41.768425 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2442): Terminated: ok {rc=0} 00:24:41.815500 --- ParallelTerminationStrategy: PID 2445 died... 00:24:41.834940 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2445): Terminated: ok {rc=0} 00:24:41.881449 --- ParallelTerminationStrategy: PID 2448 died... 00:24:41.901191 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2448): Terminated: ok {rc=0} 00:24:41.989353 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2366 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 00:24:43.304836 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:24:43.312640 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 00:24:43.346115 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 00:24:43.380633 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 00:24:43.434110 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 00:24:43.466591 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 00:24:43.500880 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 00:24:44.061857 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2366 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 00:24:44.067005 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:24:44.078993 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 00:24:44.146995 tst switch_tch_pdch.py: using LAC 24709 00:24:44.265277 tst switch_tch_pdch.py: using RAC 229 00:24:44.380639 tst switch_tch_pdch.py: using CellId 24709 00:24:44.496237 tst switch_tch_pdch.py: using BVCI 24710 00:24:44.603232 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:24:44.614755 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:24:44.626079 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:24:44.637391 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:24:44.648755 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:24:44.660065 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:24:44.671429 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 00:24:44.682842 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:24:44.800258 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 00:24:44.917552 tst switch_tch_pdch.py:51: start network... 00:24:45.114510 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:24:45.567689 run create_hlr_db(pid=2453): Launched 00:24:45.687708 bus /gobi_6: Setting Powered False 00:24:46.754377 run create_hlr_db(pid=2453): Terminated: ok {rc=0} 00:24:47.199765 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2455): Launched 00:24:47.518780 run osmo-hlr_10.42.42.2(pid=2456): Launched 00:24:47.639092 run osmo-stp_10.42.42.5: Starting osmo-stp 00:24:48.181121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2458): Launched 00:24:48.494022 run osmo-stp_10.42.42.5(pid=2459): Launched 00:24:48.613937 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 00:24:49.156706 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2461): Launched 00:24:49.276826 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 00:24:49.541479 run patchelf(pid=2462): Launched 00:24:49.716221 run osmo-stp_10.42.42.5(pid=2459): ERR: Terminated: ERROR {rc=1} [trial-2366↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2459)] 00:24:49.849922 run osmo-stp_10.42.42.5(pid=2459): stdout: | (launched: 2022-12-10_00:24:48.436938) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:24:49.985504 run osmo-stp_10.42.42.5(pid=2459): stderr: | 20221210002448627 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002448627 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002448628 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002448628 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002448628 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002448629 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002448629 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:24:50.121775 run osmo-stp_10.42.42.5(pid=2459): stdout: | (launched: 2022-12-10_00:24:48.436938) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:24:50.251300 run osmo-stp_10.42.42.5(pid=2459): stderr: | 20221210002448627 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002448627 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002448628 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002448628 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002448628 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002448629 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002448629 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:24:50.404744 run patchelf(pid=2462): Terminating (SIGINT) 00:24:50.581468 run patchelf(pid=2462): Terminated: ok {rc=0} 00:24:50.709415 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=2459): Process ended prematurely: osmo-stp_10.42.42.5(pid=2459) [trial-2366↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2459)] [trial-2366↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 00:24:50.719040 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 00:24:50.748169 run osmo-hlr_10.42.42.2(pid=2456): ERR: Terminated: ERROR {rc=237} [trial-2366↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2456)] 00:24:50.798364 run osmo-hlr_10.42.42.2(pid=2456): stdout: | (launched: 2022-12-10_00:24:47.461857) 00:24:50.850781 run osmo-hlr_10.42.42.2(pid=2456): stderr: | 20221210002447660 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210002447660 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210002447660 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210002447660 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210002447660 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210002447660 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210002447672 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210002447681 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210002447681 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210002447681 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:24:50.903859 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2455): Terminating (SIGTERM) 00:24:50.946328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2458): Terminating (SIGTERM) 00:24:50.988752 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2461): Terminating (SIGTERM) 00:24:51.031697 --- ParallelTerminationStrategy: PID 2455 died... 00:24:51.051666 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2455): Terminated: ok {rc=0} 00:24:51.098716 --- ParallelTerminationStrategy: PID 2458 died... 00:24:51.118270 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2458): Terminated: ok {rc=0} 00:24:51.164880 --- ParallelTerminationStrategy: PID 2461 died... 00:24:51.184741 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2461): Terminated: ok {rc=0} 00:24:51.272326 bus /gobi_0: Setting Powered False 00:24:52.369653 bus /gobi_0: Setting Powered False 00:24:53.484872 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2366 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 nitb_smpp --------------------------------------------------------------------- 00:24:54.738155 tst nitb_smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:24:54.740537 tst nitb_smpp: Verifying 1 x bts (candidates: 11) 00:24:54.760784 tst nitb_smpp: Verifying 1 x ip_address (candidates: 9) 00:24:54.767459 tst nitb_smpp: Verifying 1 x modem (candidates: 12) 00:24:54.800392 tst nitb_smpp: Reserving 1 x bts (candidates: 11) 00:24:54.820921 tst nitb_smpp: Reserving 1 x ip_address (candidates: 9) 00:24:54.827582 tst nitb_smpp: Reserving 1 x modem (candidates: 12) 00:24:55.348452 tst nitb_smpp: RESERVED RESOURCES for nitb_smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2366 nitb_smpp esme_connect_policy_acceptall.py ---------------------------------------------- 00:24:55.353410 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 00:24:55.372154 tst esme_connect_policy_acceptall.py: using MSISDN 7450 00:24:55.512933 run osmo-nitb_10.42.42.2: Starting osmo-nitb 00:24:56.112272 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2469): Launched 00:24:56.431153 run osmo-nitb_10.42.42.2(pid=2470): Launched 00:24:56.607840 run osmo-nitb_10.42.42.2(pid=2470): ERR: Terminated: ERROR {rc=2} [trial-2366↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2470)] 00:24:56.750789 run osmo-nitb_10.42.42.2(pid=2470): stdout: | (launched: 2022-12-10_00:24:56.373682) 00:24:56.895088 run osmo-nitb_10.42.42.2(pid=2470): stderr: | (launched: 2022-12-10_00:24:56.421052) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:24:57.039967 run osmo-nitb_10.42.42.2(pid=2470): stdout: | (launched: 2022-12-10_00:24:56.373682) 00:24:57.179161 run osmo-nitb_10.42.42.2(pid=2470): stderr: | (launched: 2022-12-10_00:24:56.421052) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=2470): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2470) [trial-2366↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2470)] 00:24:57.551325 tst osmo-nitb_10.42.42.2(pid=2470): stdout: | (launched: 2022-12-10_00:24:56.373682) 00:24:57.680879 tst osmo-nitb_10.42.42.2(pid=2470): stderr: | (launched: 2022-12-10_00:24:56.421052) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:24:57.833798 tst esme_connect_policy_acceptall.py:18: ERR: Error: osmo-nitb_10.42.42.2(pid=2470): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2470) [trial-2366↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2470)] [trial-2366↪nitb_smpp↪esme_connect_policy_acceptall.py:18] 00:24:57.843098 tst esme_connect_policy_acceptall.py:18: Test FAILED (2.5 sec) 00:24:57.850400 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2469): Terminating (SIGTERM) 00:24:58.061429 --- ParallelTerminationStrategy: PID 2469 died... 00:24:58.083454 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2469): Terminated: ok {rc=0} ---------------------------------------------- trial-2366 nitb_smpp esme_connect_policy_closed.py ---------------------------------------------- 00:24:58.134652 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 00:24:58.156086 tst esme_connect_policy_closed.py: using MSISDN 7451 00:24:58.283666 tst esme_connect_policy_closed.py: using MSISDN 7452 00:24:58.401752 run osmo-nitb_10.42.42.2: Starting osmo-nitb 00:24:58.997465 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2471): Launched 00:24:59.319191 run osmo-nitb_10.42.42.2(pid=2472): Launched 00:24:59.491758 run osmo-nitb_10.42.42.2(pid=2472): ERR: Terminated: ERROR {rc=2} [trial-2366↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2472)] 00:24:59.623747 run osmo-nitb_10.42.42.2(pid=2472): stdout: | (launched: 2022-12-10_00:24:59.261126) 00:24:59.757149 run osmo-nitb_10.42.42.2(pid=2472): stderr: | (launched: 2022-12-10_00:24:59.308909) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:24:59.890629 run osmo-nitb_10.42.42.2(pid=2472): stdout: | (launched: 2022-12-10_00:24:59.261126) 00:25:00.018413 run osmo-nitb_10.42.42.2(pid=2472): stderr: | (launched: 2022-12-10_00:24:59.308909) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:25:00.171630 tst esme_connect_policy_closed.py:24: ERR: Error: osmo-nitb_10.42.42.2(pid=2472): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2472) [trial-2366↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2472)] [trial-2366↪nitb_smpp↪esme_connect_policy_closed.py:24] 00:25:00.180732 tst esme_connect_policy_closed.py:24: Test FAILED (2.0 sec) 00:25:00.187831 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2471): Terminating (SIGTERM) 00:25:00.398483 --- ParallelTerminationStrategy: PID 2471 died... 00:25:00.419979 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2471): Terminated: ok {rc=0} ---------------------------------------------- trial-2366 nitb_smpp esme_ms_sms_storeforward.py ---------------------------------------------- 00:25:00.471112 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 00:25:00.482908 tst nitb_smpp: Using 1 x bts (candidates: 1) 00:25:00.523142 tst esme_ms_sms_storeforward.py: using LAC 24710 00:25:00.650558 tst esme_ms_sms_storeforward.py: using RAC 230 00:25:00.775713 tst esme_ms_sms_storeforward.py: using CellId 24710 00:25:00.930215 tst esme_ms_sms_storeforward.py: using BVCI 24711 00:25:01.050734 tst nitb_smpp: Using 1 x modem (candidates: 1) 00:25:01.182127 tst esme_ms_sms_storeforward.py: using MSISDN 7453 00:25:01.302730 tst esme_ms_sms_storeforward.py:20: start nitb and bts... 00:25:01.525614 run osmo-nitb_10.42.42.2: Starting osmo-nitb 00:25:02.207882 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2476): Launched 00:25:02.539039 run osmo-nitb_10.42.42.2(pid=2477): Launched 00:25:02.713222 run osmo-nitb_10.42.42.2(pid=2477): ERR: Terminated: ERROR {rc=2} [trial-2366↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2477)] 00:25:02.846153 run osmo-nitb_10.42.42.2(pid=2477): stdout: | (launched: 2022-12-10_00:25:02.480578) 00:25:02.979905 run osmo-nitb_10.42.42.2(pid=2477): stderr: | (launched: 2022-12-10_00:25:02.528793) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:25:03.114582 run osmo-nitb_10.42.42.2(pid=2477): stdout: | (launched: 2022-12-10_00:25:02.480578) 00:25:03.243024 run osmo-nitb_10.42.42.2(pid=2477): stderr: | (launched: 2022-12-10_00:25:02.528793) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:25:03.396799 tst esme_ms_sms_storeforward.py:23: ERR: Error: osmo-nitb_10.42.42.2(pid=2477): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2477) [trial-2366↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2477)] [trial-2366↪nitb_smpp↪esme_ms_sms_storeforward.py:23] 00:25:03.405685 tst esme_ms_sms_storeforward.py:23: Test FAILED (2.9 sec) 00:25:03.412611 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2476): Terminating (SIGTERM) 00:25:03.623149 --- ParallelTerminationStrategy: PID 2476 died... 00:25:03.644391 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2476): Terminated: ok {rc=0} 00:25:03.733044 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 nitb_smpp esme_ms_sms_transaction.py ---------------------------------------------- 00:25:04.818710 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 00:25:04.830572 tst nitb_smpp: Using 1 x bts (candidates: 1) 00:25:04.867793 tst esme_ms_sms_transaction.py: using LAC 24711 00:25:04.996316 tst esme_ms_sms_transaction.py: using RAC 231 00:25:05.124872 tst esme_ms_sms_transaction.py: using CellId 24711 00:25:05.252910 tst esme_ms_sms_transaction.py: using BVCI 24712 00:25:05.370288 tst nitb_smpp: Using 1 x modem (candidates: 1) 00:25:05.500801 tst esme_ms_sms_transaction.py: using MSISDN 7454 00:25:05.618806 tst esme_ms_sms_transaction.py:18: start nitb and bts... 00:25:05.836920 run osmo-nitb_10.42.42.2: Starting osmo-nitb 00:25:06.490514 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2478): Launched 00:25:06.811165 run osmo-nitb_10.42.42.2(pid=2479): Launched 00:25:06.989046 run osmo-nitb_10.42.42.2(pid=2479): ERR: Terminated: ERROR {rc=2} [trial-2366↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2479)] 00:25:07.133318 run osmo-nitb_10.42.42.2(pid=2479): stdout: | (launched: 2022-12-10_00:25:06.752931) 00:25:07.278117 run osmo-nitb_10.42.42.2(pid=2479): stderr: | (launched: 2022-12-10_00:25:06.801015) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:25:07.423279 run osmo-nitb_10.42.42.2(pid=2479): stdout: | (launched: 2022-12-10_00:25:06.752931) 00:25:07.562988 run osmo-nitb_10.42.42.2(pid=2479): stderr: | (launched: 2022-12-10_00:25:06.801015) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=2479): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2479) [trial-2366↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2479)] 00:25:07.932934 tst osmo-nitb_10.42.42.2(pid=2479): stdout: | (launched: 2022-12-10_00:25:06.752931) 00:25:08.063274 tst osmo-nitb_10.42.42.2(pid=2479): stderr: | (launched: 2022-12-10_00:25:06.801015) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 00:25:08.216243 tst esme_ms_sms_transaction.py:21: ERR: Error: osmo-nitb_10.42.42.2(pid=2479): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2479) [trial-2366↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2479)] [trial-2366↪nitb_smpp↪esme_ms_sms_transaction.py:21] 00:25:08.225390 tst esme_ms_sms_transaction.py:21: Test FAILED (3.4 sec) 00:25:08.232490 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2478): Terminating (SIGTERM) 00:25:08.443373 --- ParallelTerminationStrategy: PID 2478 died... 00:25:08.464849 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2478): Terminated: ok {rc=0} 00:25:08.552328 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 nitb_smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 smpp --------------------------------------------------------------------- 00:25:09.718166 tst smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:25:09.721677 tst smpp: Verifying 1 x bts (candidates: 11) 00:25:09.742602 tst smpp: Verifying 6 x ip_address (candidates: 9) 00:25:09.769117 tst smpp: Verifying 1 x modem (candidates: 12) 00:25:09.803624 tst smpp: Reserving 1 x bts (candidates: 11) 00:25:09.824031 tst smpp: Reserving 6 x ip_address (candidates: 9) 00:25:09.850391 tst smpp: Reserving 1 x modem (candidates: 12) 00:25:10.378916 tst smpp: RESERVED RESOURCES for smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2366 smpp esme_connect_policy_acceptall.py ---------------------------------------------- 00:25:10.384023 tst smpp: Using 1 x ip_address (candidates: 6) 00:25:10.394399 tst smpp: Using 1 x ip_address (candidates: 6) 00:25:10.405201 tst smpp: Using 1 x ip_address (candidates: 6) 00:25:10.416328 tst smpp: Using 1 x ip_address (candidates: 6) 00:25:10.435703 tst esme_connect_policy_acceptall.py: using MSISDN 7455 00:25:10.547475 run osmo-stp_10.42.42.4: Starting osmo-stp 00:25:11.058723 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=2483): Launched 00:25:11.358456 run osmo-stp_10.42.42.4(pid=2484): Launched 00:25:11.473125 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:25:11.937257 run create_hlr_db(pid=2485): Launched 00:25:12.060121 bus /sierra_2: Setting Powered False 00:25:13.120852 run create_hlr_db(pid=2485): Terminated: ok {rc=0} 00:25:13.539217 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2487): Launched 00:25:13.838290 run osmo-hlr_10.42.42.2(pid=2488): Launched 00:25:13.952883 run osmo-msc_10.42.42.5: Starting osmo-msc 00:25:14.517643 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2490): Launched 00:25:14.818580 run osmo-msc_10.42.42.5(pid=2491): Launched 00:25:14.985693 run osmo-hlr_10.42.42.2(pid=2488): ERR: Terminated: ERROR {rc=237} [trial-2366↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2488)] 00:25:15.113546 run osmo-hlr_10.42.42.2(pid=2488): stdout: | (launched: 2022-12-10_00:25:13.783578) 00:25:15.241558 run osmo-hlr_10.42.42.2(pid=2488): stderr: | 20221210002513961 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210002513961 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210002513961 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210002513961 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210002513961 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210002513961 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210002513973 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210002513982 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210002513982 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210002513982 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:25:15.367162 run osmo-hlr_10.42.42.2(pid=2488): stdout: | (launched: 2022-12-10_00:25:13.783578) 00:25:15.487019 run osmo-hlr_10.42.42.2(pid=2488): stderr: | 20221210002513961 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210002513961 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210002513961 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210002513961 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210002513961 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210002513961 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210002513973 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210002513982 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210002513982 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210002513982 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:25:15.630781 tst esme_connect_policy_acceptall.py:23: ERR: Error: osmo-hlr_10.42.42.2(pid=2488): Process ended prematurely: osmo-hlr_10.42.42.2(pid=2488) [trial-2366↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2488)] [trial-2366↪smpp↪esme_connect_policy_acceptall.py:23] 00:25:15.638870 tst esme_connect_policy_acceptall.py:23: Test FAILED (5.2 sec) 00:25:15.664474 run osmo-msc_10.42.42.5(pid=2491): ERR: Terminated: ERROR {rc=9} [trial-2366↪smpp↪esme_connect_policy_acceptall.py↪esme_connect_policy_acceptall.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=2491)] 00:25:15.711573 run osmo-msc_10.42.42.5(pid=2491): stdout: | (launched: 2022-12-10_00:25:14.763033) 00:25:15.760832 run osmo-msc_10.42.42.5(pid=2491): stderr: | 20221210002515081 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | 20221210002515081 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | 20221210002515081 DLSS7 DEBUG XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210002515081 DLSCCP NOTICE OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | 20221210002515082 DLSS7 NOTICE 0: Creating SCCP instance (osmo_ss7.c:458) | 20221210002515082 DLSCCP INFO Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | 20221210002515082 DLSS7 DEBUG registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | 20221210002515082 DLGLOBAL NOTICE unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221210002515082 DSGS ERROR SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 00:25:15.810446 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=2483): Terminating (SIGTERM) 00:25:15.863086 run osmo-stp_10.42.42.4(pid=2484): Terminating (SIGTERM) 00:25:15.921058 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2487): Terminating (SIGTERM) 00:25:16.011627 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2490): Terminating (SIGTERM) 00:25:16.094513 --- ParallelTerminationStrategy: PID 2483 died... 00:25:16.115088 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=2483): Terminated: ok {rc=0} 00:25:16.167351 --- ParallelTerminationStrategy: PID 2484 died... 00:25:16.187818 run osmo-stp_10.42.42.4(pid=2484): Terminated: ok {rc=0} 00:25:16.236920 --- ParallelTerminationStrategy: PID 2487 died... 00:25:16.257480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2487): Terminated: ok {rc=0} 00:25:16.307146 --- ParallelTerminationStrategy: PID 2490 died... 00:25:16.328621 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2490): Terminated: ok {rc=0} ---------------------------------------------- trial-2366 smpp esme_connect_policy_closed.py ---------------------------------------------- 00:25:16.383244 tst smpp: Using 1 x ip_address (candidates: 6) 00:25:16.394828 tst smpp: Using 1 x bts (candidates: 1) 00:25:16.430251 tst esme_connect_policy_closed.py: using LAC 24712 00:25:16.600215 tst esme_connect_policy_closed.py: using RAC 232 00:25:16.719977 tst esme_connect_policy_closed.py: using CellId 24712 00:25:16.876271 tst esme_connect_policy_closed.py: using BVCI 24713 00:25:17.014094 tst smpp: Using 1 x ip_address (candidates: 6) 00:25:17.026484 tst smpp: Using 1 x ip_address (candidates: 6) 00:25:17.039819 tst smpp: Using 1 x ip_address (candidates: 6) 00:25:17.060940 tst esme_connect_policy_closed.py: using MSISDN 7456 00:25:17.211017 tst esme_connect_policy_closed.py: using MSISDN 7457 00:25:17.323515 run osmo-stp_10.42.42.4: Starting osmo-stp 00:25:17.841776 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=2494): Launched 00:25:18.143367 run osmo-stp_10.42.42.4(pid=2495): Launched 00:25:18.258094 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:25:18.725589 run create_hlr_db(pid=2496): Launched 00:25:19.903688 run create_hlr_db(pid=2496): Terminated: ok {rc=0} 00:25:20.220918 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2498): Launched 00:25:20.523327 run osmo-hlr_10.42.42.2(pid=2499): Launched 00:25:20.638693 run osmo-msc_10.42.42.5: Starting osmo-msc 00:25:21.185258 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2501): Launched 00:25:21.486611 run osmo-msc_10.42.42.5(pid=2502): Launched 00:25:21.655436 run osmo-hlr_10.42.42.2(pid=2499): ERR: Terminated: ERROR {rc=237} [trial-2366↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2499)] 00:25:21.784207 run osmo-hlr_10.42.42.2(pid=2499): stdout: | (launched: 2022-12-10_00:25:20.467135) 00:25:21.912433 run osmo-hlr_10.42.42.2(pid=2499): stderr: | 20221210002520645 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210002520645 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210002520645 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210002520645 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210002520645 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210002520645 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210002520660 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210002520671 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210002520671 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210002520671 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:25:22.037944 run osmo-hlr_10.42.42.2(pid=2499): stdout: | (launched: 2022-12-10_00:25:20.467135) 00:25:22.158438 run osmo-hlr_10.42.42.2(pid=2499): stderr: | 20221210002520645 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210002520645 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210002520645 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210002520645 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210002520645 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210002520645 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210002520660 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210002520671 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210002520671 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210002520671 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:25:22.302451 tst esme_connect_policy_closed.py:31: ERR: Error: osmo-hlr_10.42.42.2(pid=2499): Process ended prematurely: osmo-hlr_10.42.42.2(pid=2499) [trial-2366↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2499)] [trial-2366↪smpp↪esme_connect_policy_closed.py:31] 00:25:22.310534 tst esme_connect_policy_closed.py:31: Test FAILED (5.9 sec) 00:25:22.336085 run osmo-msc_10.42.42.5(pid=2502): ERR: Terminated: ERROR {rc=9} [trial-2366↪smpp↪esme_connect_policy_closed.py↪esme_connect_policy_closed.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=2502)] 00:25:22.383225 run osmo-msc_10.42.42.5(pid=2502): stdout: | (launched: 2022-12-10_00:25:21.431043) 00:25:22.432125 run osmo-msc_10.42.42.5(pid=2502): stderr: | 20221210002521748 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | 20221210002521748 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | 20221210002521749 DLSS7 DEBUG XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210002521749 DLSCCP NOTICE OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | 20221210002521749 DLSS7 NOTICE 0: Creating SCCP instance (osmo_ss7.c:458) | 20221210002521749 DLSCCP INFO Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | 20221210002521749 DLSS7 DEBUG registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | 20221210002521749 DLGLOBAL NOTICE unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221210002521749 DSGS ERROR SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 00:25:22.481482 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=2494): Terminating (SIGTERM) 00:25:22.520624 run osmo-stp_10.42.42.4(pid=2495): Terminating (SIGTERM) 00:25:22.559743 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2498): Terminating (SIGTERM) 00:25:22.600285 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2501): Terminating (SIGTERM) 00:25:22.641716 --- ParallelTerminationStrategy: PID 2494 died... 00:25:22.661132 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=2494): Terminated: ok {rc=0} 00:25:22.704813 --- ParallelTerminationStrategy: PID 2495 died... 00:25:22.723207 run osmo-stp_10.42.42.4(pid=2495): Terminated: ok {rc=0} 00:25:22.766626 --- ParallelTerminationStrategy: PID 2498 died... 00:25:22.784886 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2498): Terminated: ok {rc=0} 00:25:22.828267 --- ParallelTerminationStrategy: PID 2501 died... 00:25:22.846650 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2501): Terminated: ok {rc=0} ---------------------------------------------- trial-2366 smpp esme_ms_sms_storeforward.py ---------------------------------------------- 00:25:22.895194 tst smpp: Using 1 x ip_address (candidates: 6) 00:25:22.906233 tst smpp: Using 1 x bts (candidates: 1) 00:25:22.940853 tst esme_ms_sms_storeforward.py: using LAC 24713 00:25:23.060795 tst esme_ms_sms_storeforward.py: using RAC 233 00:25:23.180740 tst esme_ms_sms_storeforward.py: using CellId 24713 00:25:23.308316 tst esme_ms_sms_storeforward.py: using BVCI 24714 00:25:23.428611 tst smpp: Using 1 x ip_address (candidates: 6) 00:25:23.439639 tst smpp: Using 1 x ip_address (candidates: 6) 00:25:23.450699 tst smpp: Using 1 x ip_address (candidates: 6) 00:25:23.462163 tst smpp: Using 1 x ip_address (candidates: 6) 00:25:23.473524 tst smpp: Using 1 x ip_address (candidates: 6) 00:25:23.484662 tst smpp: Using 1 x modem (candidates: 1) 00:25:23.613786 tst esme_ms_sms_storeforward.py: using MSISDN 7458 00:25:23.733139 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:25:24.235647 run create_hlr_db(pid=2505): Launched 00:25:25.415625 run create_hlr_db(pid=2505): Terminated: ok {rc=0} 00:25:25.755246 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2507): Launched 00:25:26.077210 run osmo-hlr_10.42.42.2(pid=2508): Launched 00:25:26.201459 run osmo-stp_10.42.42.5: Starting osmo-stp 00:25:26.757568 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2510): Launched 00:25:27.082382 run osmo-stp_10.42.42.5(pid=2511): Launched 00:25:27.206901 run osmo-msc_10.42.42.6: Starting osmo-msc 00:25:27.789224 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2513): Launched 00:25:28.111573 run osmo-msc_10.42.42.6(pid=2514): Launched 00:25:28.291101 run osmo-stp_10.42.42.5(pid=2511): ERR: Terminated: ERROR {rc=1} [trial-2366↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2511)] 00:25:28.427022 run osmo-stp_10.42.42.5(pid=2511): stdout: | (launched: 2022-12-10_00:25:27.023115) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:25:28.563603 run osmo-stp_10.42.42.5(pid=2511): stderr: | 20221210002527215 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002527215 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002527216 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002527216 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002527216 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002527216 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002527217 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:25:28.699697 run osmo-stp_10.42.42.5(pid=2511): stdout: | (launched: 2022-12-10_00:25:27.023115) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:25:28.829253 run osmo-stp_10.42.42.5(pid=2511): stderr: | 20221210002527215 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002527215 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002527216 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002527216 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002527216 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002527216 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002527217 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:25:28.983479 tst esme_ms_sms_storeforward.py:30: ERR: Error: osmo-stp_10.42.42.5(pid=2511): Process ended prematurely: osmo-stp_10.42.42.5(pid=2511) [trial-2366↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2511)] [trial-2366↪smpp↪esme_ms_sms_storeforward.py:30] 00:25:28.992530 tst esme_ms_sms_storeforward.py:30: Test FAILED (6.1 sec) 00:25:29.020569 run osmo-hlr_10.42.42.2(pid=2508): ERR: Terminated: ERROR {rc=237} [trial-2366↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2508)] 00:25:29.071446 run osmo-hlr_10.42.42.2(pid=2508): stdout: | (launched: 2022-12-10_00:25:26.018555) 00:25:29.123541 run osmo-hlr_10.42.42.2(pid=2508): stderr: | 20221210002526218 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210002526218 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210002526218 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210002526218 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210002526218 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210002526218 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210002526230 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/smpp/esme_ms_sms_storeforward.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210002526238 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210002526238 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210002526238 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:25:29.196006 run osmo-msc_10.42.42.6(pid=2514): ERR: Terminated: ERROR {rc=2} [trial-2366↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2514)] 00:25:29.246412 run osmo-msc_10.42.42.6(pid=2514): stdout: | (launched: 2022-12-10_00:25:28.052650) 00:25:29.298614 run osmo-msc_10.42.42.6(pid=2514): stderr: | 20221210002528376 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210002528376 DLGLOBAL DEBUG validating counter group 0x7f0ba46e2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210002528377 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210002528377 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210002528377 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210002528377 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210002528379 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210002528379 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210002528379 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210002528379 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:25:29.351015 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2507): Terminating (SIGTERM) 00:25:29.393027 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2510): Terminating (SIGTERM) 00:25:29.434919 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2513): Terminating (SIGTERM) 00:25:29.476903 --- ParallelTerminationStrategy: PID 2507 died... 00:25:29.496896 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2507): Terminated: ok {rc=0} 00:25:29.543439 --- ParallelTerminationStrategy: PID 2510 died... 00:25:29.563106 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2510): Terminated: ok {rc=0} 00:25:29.609255 --- ParallelTerminationStrategy: PID 2513 died... 00:25:29.628491 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2513): Terminated: ok {rc=0} 00:25:29.715308 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 smpp esme_ms_sms_transaction.py ---------------------------------------------- 00:25:30.802930 tst smpp: Using 1 x ip_address (candidates: 6) 00:25:30.814408 tst smpp: Using 1 x bts (candidates: 1) 00:25:30.860002 tst esme_ms_sms_transaction.py: using LAC 24714 00:25:30.986817 tst esme_ms_sms_transaction.py: using RAC 234 00:25:31.147748 tst esme_ms_sms_transaction.py: using CellId 24714 00:25:31.267907 tst esme_ms_sms_transaction.py: using BVCI 24715 00:25:31.426383 tst smpp: Using 1 x ip_address (candidates: 6) 00:25:31.442135 tst smpp: Using 1 x ip_address (candidates: 6) 00:25:31.459341 tst smpp: Using 1 x ip_address (candidates: 6) 00:25:31.476557 tst smpp: Using 1 x ip_address (candidates: 6) 00:25:31.493144 tst smpp: Using 1 x ip_address (candidates: 6) 00:25:31.508233 tst smpp: Using 1 x modem (candidates: 1) 00:25:31.651123 tst esme_ms_sms_transaction.py: using MSISDN 7459 00:25:31.773330 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:25:32.332257 run create_hlr_db(pid=2516): Launched 00:25:32.468556 bus /sierra_2: Setting Powered False 00:25:33.533246 run create_hlr_db(pid=2516): Terminated: ok {rc=0} 00:25:33.982489 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2518): Launched 00:25:34.306386 run osmo-hlr_10.42.42.2(pid=2519): Launched 00:25:34.430272 run osmo-stp_10.42.42.5: Starting osmo-stp 00:25:34.988379 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2521): Launched 00:25:35.309943 run osmo-stp_10.42.42.5(pid=2522): Launched 00:25:35.433918 run osmo-msc_10.42.42.6: Starting osmo-msc 00:25:36.016376 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2524): Launched 00:25:36.339119 run osmo-msc_10.42.42.6(pid=2525): Launched 00:25:36.519009 run osmo-stp_10.42.42.5(pid=2522): ERR: Terminated: ERROR {rc=1} [trial-2366↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2522)] 00:25:36.654664 run osmo-stp_10.42.42.5(pid=2522): stdout: | (launched: 2022-12-10_00:25:35.251532) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:25:36.790703 run osmo-stp_10.42.42.5(pid=2522): stderr: | 20221210002535443 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002535444 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002535444 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002535444 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002535445 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002535445 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002535445 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:25:36.925955 run osmo-stp_10.42.42.5(pid=2522): stdout: | (launched: 2022-12-10_00:25:35.251532) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:25:37.055605 run osmo-stp_10.42.42.5(pid=2522): stderr: | 20221210002535443 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002535444 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002535444 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002535444 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002535445 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002535445 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002535445 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:25:37.209922 tst esme_ms_sms_transaction.py:28: ERR: Error: osmo-stp_10.42.42.5(pid=2522): Process ended prematurely: osmo-stp_10.42.42.5(pid=2522) [trial-2366↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2522)] [trial-2366↪smpp↪esme_ms_sms_transaction.py:28] 00:25:37.218924 tst esme_ms_sms_transaction.py:28: Test FAILED (6.4 sec) 00:25:37.246698 run osmo-hlr_10.42.42.2(pid=2519): ERR: Terminated: ERROR {rc=237} [trial-2366↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2519)] 00:25:37.296740 run osmo-hlr_10.42.42.2(pid=2519): stdout: | (launched: 2022-12-10_00:25:34.247817) 00:25:37.348675 run osmo-hlr_10.42.42.2(pid=2519): stderr: | 20221210002534445 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210002534445 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210002534445 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210002534445 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210002534445 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210002534445 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210002534457 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/smpp/esme_ms_sms_transaction.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210002534465 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210002534466 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210002534466 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:25:37.420495 run osmo-msc_10.42.42.6(pid=2525): ERR: Terminated: ERROR {rc=2} [trial-2366↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2525)] 00:25:37.470453 run osmo-msc_10.42.42.6(pid=2525): stdout: | (launched: 2022-12-10_00:25:36.280568) 00:25:37.522391 run osmo-msc_10.42.42.6(pid=2525): stderr: | 20221210002536602 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210002536602 DLGLOBAL DEBUG validating counter group 0x7f2e96c9fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210002536602 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210002536602 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210002536602 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210002536603 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210002536606 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210002536607 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210002536607 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210002536607 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:25:37.574304 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2518): Terminating (SIGTERM) 00:25:37.616229 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2521): Terminating (SIGTERM) 00:25:37.658270 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2524): Terminating (SIGTERM) 00:25:37.700231 --- ParallelTerminationStrategy: PID 2518 died... 00:25:37.720104 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2518): Terminated: ok {rc=0} 00:25:37.767211 --- ParallelTerminationStrategy: PID 2521 died... 00:25:37.786813 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2521): Terminated: ok {rc=0} 00:25:37.833132 --- ParallelTerminationStrategy: PID 2524 died... 00:25:37.852630 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2524): Terminated: ok {rc=0} 00:25:37.941458 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 encryption --------------------------------------------------------------------- 00:25:39.137770 tst encryption: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:25:39.141400 tst encryption: Verifying 1 x bts (candidates: 11) 00:25:39.163731 tst encryption: Verifying 6 x ip_address (candidates: 9) 00:25:39.191665 tst encryption: Verifying 1 x modem (candidates: 12) 00:25:39.226283 tst encryption: Reserving 1 x bts (candidates: 11) 00:25:39.247777 tst encryption: Reserving 6 x ip_address (candidates: 9) 00:25:39.276519 tst encryption: Reserving 1 x modem (candidates: 12) 00:25:39.806579 tst encryption: RESERVED RESOURCES for encryption: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2366 encryption register_a5_0_authopt.py ---------------------------------------------- 00:25:39.862565 tst encryption: Using 1 x ip_address (candidates: 6) 00:25:39.873731 tst encryption: Using 1 x bts (candidates: 1) 00:25:39.908426 tst register_a5_0_authopt.py: using LAC 24715 00:25:40.035832 tst register_a5_0_authopt.py: using RAC 235 00:25:40.162579 tst register_a5_0_authopt.py: using CellId 24715 00:25:40.288538 tst register_a5_0_authopt.py: using BVCI 24716 00:25:40.407173 tst encryption: Using 1 x ip_address (candidates: 6) 00:25:40.418322 tst encryption: Using 1 x ip_address (candidates: 6) 00:25:40.429063 tst encryption: Using 1 x ip_address (candidates: 6) 00:25:40.439996 tst encryption: Using 1 x ip_address (candidates: 6) 00:25:40.451154 tst encryption: Using 1 x ip_address (candidates: 6) 00:25:40.462403 tst encryption: Using 1 x modem (candidates: 1) 00:25:40.580341 tst register_a5_0_authopt.py:8: start network... 00:25:40.801067 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:25:41.306050 run create_hlr_db(pid=2530): Launched 00:25:41.429957 bus /sierra_2: Setting Powered False 00:25:42.494385 run create_hlr_db(pid=2530): Terminated: ok {rc=0} 00:25:42.930797 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2532): Launched 00:25:43.237309 run osmo-hlr_10.42.42.2(pid=2533): Launched 00:25:43.354391 run osmo-stp_10.42.42.5: Starting osmo-stp 00:25:43.891957 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2535): Launched 00:25:44.195515 run osmo-stp_10.42.42.5(pid=2536): Launched 00:25:44.310910 run osmo-msc_10.42.42.6: Starting osmo-msc 00:25:44.859363 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2538): Launched 00:25:45.163852 run osmo-msc_10.42.42.6(pid=2539): Launched 00:25:45.333993 run osmo-stp_10.42.42.5(pid=2536): ERR: Terminated: ERROR {rc=1} [trial-2366↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2536)] 00:25:45.469558 run osmo-stp_10.42.42.5(pid=2536): stdout: | (launched: 2022-12-10_00:25:44.140351) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:25:45.610521 run osmo-stp_10.42.42.5(pid=2536): stderr: | 20221210002544309 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002544309 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002544309 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002544309 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002544310 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002544310 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002544310 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:25:45.746943 run osmo-stp_10.42.42.5(pid=2536): stdout: | (launched: 2022-12-10_00:25:44.140351) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:25:45.878508 run osmo-stp_10.42.42.5(pid=2536): stderr: | 20221210002544309 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002544309 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002544309 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002544309 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002544310 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002544310 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002544310 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:25:46.036853 tst register_a5_0_authopt.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2536): Process ended prematurely: osmo-stp_10.42.42.5(pid=2536) [trial-2366↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2536)] [trial-2366↪encryption↪register_a5_0_authopt.py:8] 00:25:46.047893 tst register_a5_0_authopt.py:8: Test FAILED (6.2 sec) 00:25:46.078503 run osmo-hlr_10.42.42.2(pid=2533): ERR: Terminated: ERROR {rc=237} [trial-2366↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2533)] 00:25:46.131132 run osmo-hlr_10.42.42.2(pid=2533): stdout: | (launched: 2022-12-10_00:25:43.181732) 00:25:46.185811 run osmo-hlr_10.42.42.2(pid=2533): stderr: | 20221210002543357 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210002543358 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210002543358 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210002543358 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210002543358 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210002543358 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210002543370 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/encryption/register_a5_0_authopt.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210002543380 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210002543380 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210002543380 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:25:46.260284 run osmo-msc_10.42.42.6(pid=2539): ERR: Terminated: ERROR {rc=2} [trial-2366↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2539)] 00:25:46.312570 run osmo-msc_10.42.42.6(pid=2539): stdout: | (launched: 2022-12-10_00:25:45.107965) 00:25:46.366755 run osmo-msc_10.42.42.6(pid=2539): stderr: | 20221210002545380 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210002545380 DLGLOBAL DEBUG validating counter group 0x7fe6de234c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210002545380 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210002545380 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210002545380 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210002545381 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210002545382 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210002545383 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210002545383 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210002545383 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:25:46.421697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2532): Terminating (SIGTERM) 00:25:46.466958 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2535): Terminating (SIGTERM) 00:25:46.513158 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2538): Terminating (SIGTERM) 00:25:46.559528 --- ParallelTerminationStrategy: PID 2532 died... 00:25:46.580474 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2532): Terminated: ok {rc=0} 00:25:46.631594 --- ParallelTerminationStrategy: PID 2535 died... 00:25:46.652306 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2535): Terminated: ok {rc=0} 00:25:46.702059 --- ParallelTerminationStrategy: PID 2538 died... 00:25:46.722675 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2538): Terminated: ok {rc=0} 00:25:46.819941 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 encryption register_a5_0_authreq.py ---------------------------------------------- 00:25:47.983623 tst encryption: Using 1 x ip_address (candidates: 6) 00:25:47.995421 tst encryption: Using 1 x bts (candidates: 1) 00:25:48.032898 tst register_a5_0_authreq.py: using LAC 24716 00:25:48.165646 tst register_a5_0_authreq.py: using RAC 236 00:25:48.293235 tst register_a5_0_authreq.py: using CellId 24716 00:25:48.418592 tst register_a5_0_authreq.py: using BVCI 24717 00:25:48.537600 tst encryption: Using 1 x ip_address (candidates: 6) 00:25:48.548678 tst encryption: Using 1 x ip_address (candidates: 6) 00:25:48.559787 tst encryption: Using 1 x ip_address (candidates: 6) 00:25:48.571056 tst encryption: Using 1 x ip_address (candidates: 6) 00:25:48.582412 tst encryption: Using 1 x ip_address (candidates: 6) 00:25:48.593557 tst encryption: Using 1 x modem (candidates: 1) 00:25:48.714044 tst register_a5_0_authreq.py:8: start network... 00:25:48.935467 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:25:49.441180 run create_hlr_db(pid=2541): Launched 00:25:49.565554 bus /sierra_2: Setting Powered False 00:25:50.630115 run create_hlr_db(pid=2541): Terminated: ok {rc=0} 00:25:51.066017 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2543): Launched 00:25:51.371383 run osmo-hlr_10.42.42.2(pid=2544): Launched 00:25:51.488220 run osmo-stp_10.42.42.5: Starting osmo-stp 00:25:52.030864 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2546): Launched 00:25:52.335097 run osmo-stp_10.42.42.5(pid=2547): Launched 00:25:52.451929 run osmo-msc_10.42.42.6: Starting osmo-msc 00:25:53.002419 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2549): Launched 00:25:53.308331 run osmo-msc_10.42.42.6(pid=2550): Launched 00:25:53.479273 run osmo-stp_10.42.42.5(pid=2547): ERR: Terminated: ERROR {rc=1} [trial-2366↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2547)] 00:25:53.608093 run osmo-stp_10.42.42.5(pid=2547): stdout: | (launched: 2022-12-10_00:25:52.279569) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:25:53.736910 run osmo-stp_10.42.42.5(pid=2547): stderr: | 20221210002552449 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002552449 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002552449 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002552450 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002552450 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002552450 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002552450 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:25:53.863531 run osmo-stp_10.42.42.5(pid=2547): stdout: | (launched: 2022-12-10_00:25:52.279569) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:25:53.984408 run osmo-stp_10.42.42.5(pid=2547): stderr: | 20221210002552449 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002552449 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002552449 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002552450 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002552450 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002552450 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002552450 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:25:54.129624 tst register_a5_0_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2547): Process ended prematurely: osmo-stp_10.42.42.5(pid=2547) [trial-2366↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2547)] [trial-2366↪encryption↪register_a5_0_authreq.py:8] 00:25:54.138303 tst register_a5_0_authreq.py:8: Test FAILED (6.2 sec) 00:25:54.164406 run osmo-hlr_10.42.42.2(pid=2544): ERR: Terminated: ERROR {rc=237} [trial-2366↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2544)] 00:25:54.211733 run osmo-hlr_10.42.42.2(pid=2544): stdout: | (launched: 2022-12-10_00:25:51.315821) 00:25:54.260514 run osmo-hlr_10.42.42.2(pid=2544): stderr: | 20221210002551493 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210002551493 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210002551493 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210002551493 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210002551493 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210002551493 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210002551505 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/encryption/register_a5_0_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210002551514 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210002551514 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210002551514 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:25:54.328603 run osmo-msc_10.42.42.6(pid=2550): ERR: Terminated: ERROR {rc=2} [trial-2366↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2550)] 00:25:54.375885 run osmo-msc_10.42.42.6(pid=2550): stdout: | (launched: 2022-12-10_00:25:53.252382) 00:25:54.424790 run osmo-msc_10.42.42.6(pid=2550): stderr: | 20221210002553524 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210002553524 DLGLOBAL DEBUG validating counter group 0x7fd49814bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210002553524 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210002553525 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210002553525 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210002553525 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210002553527 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210002553527 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210002553527 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210002553527 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:25:54.473827 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2543): Terminating (SIGTERM) 00:25:54.513084 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2546): Terminating (SIGTERM) 00:25:54.553241 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2549): Terminating (SIGTERM) 00:25:54.592913 --- ParallelTerminationStrategy: PID 2543 died... 00:25:54.611837 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2543): Terminated: ok {rc=0} 00:25:54.655961 --- ParallelTerminationStrategy: PID 2546 died... 00:25:54.674700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2546): Terminated: ok {rc=0} 00:25:54.718969 --- ParallelTerminationStrategy: PID 2549 died... 00:25:54.737591 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2549): Terminated: ok {rc=0} 00:25:54.823244 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 encryption register_a5_1_authreq.py ---------------------------------------------- 00:25:55.972232 tst encryption: Using 1 x ip_address (candidates: 6) 00:25:55.983403 tst encryption: Using 1 x bts (candidates: 1) 00:25:56.018946 tst register_a5_1_authreq.py: using LAC 24717 00:25:56.149774 tst register_a5_1_authreq.py: using RAC 237 00:25:56.279395 tst register_a5_1_authreq.py: using CellId 24717 00:25:56.406655 tst register_a5_1_authreq.py: using BVCI 24718 00:25:56.525587 tst encryption: Using 1 x ip_address (candidates: 6) 00:25:56.536505 tst encryption: Using 1 x ip_address (candidates: 6) 00:25:56.547304 tst encryption: Using 1 x ip_address (candidates: 6) 00:25:56.558562 tst encryption: Using 1 x ip_address (candidates: 6) 00:25:56.569654 tst encryption: Using 1 x ip_address (candidates: 6) 00:25:56.580696 tst encryption: Using 1 x modem (candidates: 1) 00:25:56.696837 tst register_a5_1_authreq.py:8: start network... 00:25:56.902969 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:25:57.377099 run create_hlr_db(pid=2552): Launched 00:25:57.502531 bus /sierra_2: Setting Powered False 00:25:58.566667 run create_hlr_db(pid=2552): Terminated: ok {rc=0} 00:25:59.020850 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2554): Launched 00:25:59.347557 run osmo-hlr_10.42.42.2(pid=2555): Launched 00:25:59.471588 run osmo-stp_10.42.42.5: Starting osmo-stp 00:26:00.034431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2557): Launched 00:26:00.361310 run osmo-stp_10.42.42.5(pid=2558): Launched 00:26:00.486282 run osmo-msc_10.42.42.6: Starting osmo-msc 00:26:01.107796 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2560): Launched 00:26:01.458575 run osmo-msc_10.42.42.6(pid=2561): Launched 00:26:01.905650 run osmo-stp_10.42.42.5(pid=2558): ERR: Terminated: ERROR {rc=1} [trial-2366↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2558)] 00:26:02.184623 run osmo-stp_10.42.42.5(pid=2558): stdout: | (launched: 2022-12-10_00:26:00.301896) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:26:02.323944 run osmo-stp_10.42.42.5(pid=2558): stderr: | 20221210002600493 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002600493 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002600494 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002600494 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002600494 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002600495 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002600495 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:26:02.465088 run osmo-stp_10.42.42.5(pid=2558): stdout: | (launched: 2022-12-10_00:26:00.301896) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:26:02.596358 run osmo-stp_10.42.42.5(pid=2558): stderr: | 20221210002600493 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002600493 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002600494 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002600494 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002600494 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002600495 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002600495 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:26:02.752509 tst register_a5_1_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2558): Process ended prematurely: osmo-stp_10.42.42.5(pid=2558) [trial-2366↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2558)] [trial-2366↪encryption↪register_a5_1_authreq.py:8] 00:26:02.762469 tst register_a5_1_authreq.py:8: Test FAILED (6.8 sec) 00:26:02.791264 run osmo-hlr_10.42.42.2(pid=2555): ERR: Terminated: ERROR {rc=237} [trial-2366↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2555)] 00:26:02.842058 run osmo-hlr_10.42.42.2(pid=2555): stdout: | (launched: 2022-12-10_00:25:59.288401) 00:26:02.894398 run osmo-hlr_10.42.42.2(pid=2555): stderr: | 20221210002559486 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210002559486 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210002559486 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210002559486 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210002559486 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210002559486 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210002559499 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/encryption/register_a5_1_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210002559507 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210002559508 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210002559508 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:26:02.967541 run osmo-msc_10.42.42.6(pid=2561): ERR: Terminated: ERROR {rc=2} [trial-2366↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2561)] 00:26:03.018488 run osmo-msc_10.42.42.6(pid=2561): stdout: | (launched: 2022-12-10_00:26:01.391800) 00:26:03.071587 run osmo-msc_10.42.42.6(pid=2561): stderr: | 20221210002601926 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210002601927 DLGLOBAL DEBUG validating counter group 0x7fc5b4eedc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210002601927 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210002601927 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210002601927 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210002601927 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210002601931 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210002601931 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210002601931 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210002601931 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:26:03.124685 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2554): Terminating (SIGTERM) 00:26:03.167380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2557): Terminating (SIGTERM) 00:26:03.210446 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2560): Terminating (SIGTERM) 00:26:03.253397 --- ParallelTerminationStrategy: PID 2554 died... 00:26:03.273362 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2554): Terminated: ok {rc=0} 00:26:03.321212 --- ParallelTerminationStrategy: PID 2557 died... 00:26:03.341400 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2557): Terminated: ok {rc=0} 00:26:03.388812 --- ParallelTerminationStrategy: PID 2560 died... 00:26:03.408878 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2560): Terminated: ok {rc=0} 00:26:03.497856 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2366 encryption register_a5_3_authreq.py ---------------------------------------------- 00:26:04.648727 tst encryption: Using 1 x ip_address (candidates: 6) 00:26:04.660601 tst encryption: Using 1 x bts (candidates: 1) 00:26:04.697377 tst register_a5_3_authreq.py: using LAC 24718 00:26:04.825631 tst register_a5_3_authreq.py: using RAC 238 00:26:04.955391 tst register_a5_3_authreq.py: using CellId 24718 00:26:05.077136 tst register_a5_3_authreq.py: using BVCI 24719 00:26:05.189936 tst encryption: Using 1 x ip_address (candidates: 6) 00:26:05.200930 tst encryption: Using 1 x ip_address (candidates: 6) 00:26:05.211742 tst encryption: Using 1 x ip_address (candidates: 6) 00:26:05.222256 tst encryption: Using 1 x ip_address (candidates: 6) 00:26:05.232630 tst encryption: Using 1 x ip_address (candidates: 6) 00:26:05.242900 tst encryption: Using 1 x modem (candidates: 1) 00:26:05.372918 tst register_a5_3_authreq.py:8: start network... 00:26:05.594951 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:26:06.099653 run create_hlr_db(pid=2563): Launched 00:26:06.224705 bus /sierra_2: Setting Powered False 00:26:07.289182 run create_hlr_db(pid=2563): Terminated: ok {rc=0} 00:26:07.742519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2565): Launched 00:26:08.068731 run osmo-hlr_10.42.42.2(pid=2566): Launched 00:26:08.194173 run osmo-stp_10.42.42.5: Starting osmo-stp 00:26:08.752583 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2568): Launched 00:26:09.078346 run osmo-stp_10.42.42.5(pid=2569): Launched 00:26:09.203017 run osmo-msc_10.42.42.6: Starting osmo-msc 00:26:09.790543 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2571): Launched 00:26:10.115708 run osmo-msc_10.42.42.6(pid=2572): Launched 00:26:10.297180 run osmo-stp_10.42.42.5(pid=2569): ERR: Terminated: ERROR {rc=1} [trial-2366↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2569)] 00:26:10.434479 run osmo-stp_10.42.42.5(pid=2569): stdout: | (launched: 2022-12-10_00:26:09.019077) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:26:10.572216 run osmo-stp_10.42.42.5(pid=2569): stderr: | 20221210002609212 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002609212 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002609213 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002609213 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002609215 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002609216 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002609216 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:26:10.709178 run osmo-stp_10.42.42.5(pid=2569): stdout: | (launched: 2022-12-10_00:26:09.019077) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:26:10.839307 run osmo-stp_10.42.42.5(pid=2569): stderr: | 20221210002609212 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002609212 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002609213 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002609213 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002609215 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002609216 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002609216 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:26:10.994655 tst register_a5_3_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2569): Process ended prematurely: osmo-stp_10.42.42.5(pid=2569) [trial-2366↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2569)] [trial-2366↪encryption↪register_a5_3_authreq.py:8] 00:26:11.004189 tst register_a5_3_authreq.py:8: Test FAILED (6.4 sec) 00:26:11.032104 run osmo-hlr_10.42.42.2(pid=2566): ERR: Terminated: ERROR {rc=237} [trial-2366↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2566)] 00:26:11.082746 run osmo-hlr_10.42.42.2(pid=2566): stdout: | (launched: 2022-12-10_00:26:08.009702) 00:26:11.134581 run osmo-hlr_10.42.42.2(pid=2566): stderr: | 20221210002608208 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210002608208 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210002608208 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210002608208 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210002608209 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210002608209 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210002608222 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/encryption/register_a5_3_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210002608233 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210002608233 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210002608233 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:26:11.206314 run osmo-msc_10.42.42.6(pid=2572): ERR: Terminated: ERROR {rc=2} [trial-2366↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2572)] 00:26:11.256438 run osmo-msc_10.42.42.6(pid=2572): stdout: | (launched: 2022-12-10_00:26:10.056569) 00:26:11.308320 run osmo-msc_10.42.42.6(pid=2572): stderr: | 20221210002610378 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210002610378 DLGLOBAL DEBUG validating counter group 0x7f0f5b358c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210002610379 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210002610379 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210002610379 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210002610379 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210002610381 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210002610381 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210002610381 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210002610381 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:26:11.360410 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2565): Terminating (SIGTERM) 00:26:11.402262 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2568): Terminating (SIGTERM) 00:26:11.444064 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2571): Terminating (SIGTERM) 00:26:11.485967 --- ParallelTerminationStrategy: PID 2565 died... 00:26:11.505737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2565): Terminated: ok {rc=0} 00:26:11.552004 --- ParallelTerminationStrategy: PID 2568 died... 00:26:11.571361 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2568): Terminated: ok {rc=0} 00:26:11.617498 --- ParallelTerminationStrategy: PID 2571 died... 00:26:11.636751 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2571): Terminated: ok {rc=0} 00:26:11.723911 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 encryption FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 4g:srsenb-rftype@zmq+srsue-rftype@zmq --------------------------------------------------------------------- 00:26:12.933648 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:26:12.939427 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x enb (candidates: 2) 00:26:12.958364 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x modem (candidates: 12) 00:26:12.986782 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x run_node (candidates: 1) 00:26:13.014271 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x enb (candidates: 2) 00:26:13.033939 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x modem (candidates: 12) 00:26:13.061537 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x run_node (candidates: 1) 00:26:13.572349 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: RESERVED RESOURCES for 4g: enb srsENB-zmq modem srsUE-zmq_1 run_node e55cbce541824969b492cc4fa86bdef69cf65e7d ---------------------------------------------- trial-2366 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover.py ---------------------------------------------- 00:26:13.577116 tst handover.py:11: TEST_CONFIG: {} 00:26:13.796305 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 00:26:13.812546 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 00:26:13.836123 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 00:26:13.885332 tst handover.py: using MSISDN 7460 00:26:14.004137 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7460', subscriber_id=0} 00:26:14.118384 run srsepc_10.42.42.118: Starting srsepc 00:26:16.027845 run rm-remote-dir(pid=2577): Launched 00:26:16.217287 bus /sierra_2: Setting Powered False 00:26:17.274238 run rm-remote-dir(pid=2577): Terminated: ok {rc=0} 00:26:17.805889 run mk-remote-dir(pid=2578): Launched 00:26:18.994049 run mk-remote-dir(pid=2578): Terminated: ok {rc=0} 00:26:19.297165 run scp-inst-to-remote(pid=2579): Launched 00:26:21.481524 run scp-inst-to-remote(pid=2579): Terminated: ok {rc=0} 00:26:21.812185 run rm-remote-dir(pid=2581): Launched 00:26:22.990601 run rm-remote-dir(pid=2581): Terminated: ok {rc=0} 00:26:23.324244 run mk-remote-dir(pid=2582): Launched 00:26:24.503840 run mk-remote-dir(pid=2582): Terminated: ok {rc=0} 00:26:24.786773 run scp-cfg-to-remote(pid=2583): Launched 00:26:25.962518 run scp-cfg-to-remote(pid=2583): Terminated: ok {rc=0} 00:26:26.243571 run scp-db-to-remote(pid=2585): Launched 00:26:27.420764 run scp-db-to-remote(pid=2585): Terminated: ok {rc=0} 00:26:27.551349 run srsepc_10.42.42.118: Setting RPATH for srsepc 00:26:27.856035 run patchelf(pid=2587): Launched 00:26:29.032345 run patchelf(pid=2587): Terminated: ok {rc=0} 00:26:29.162282 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 00:26:29.468008 run setcap-netadm(pid=2588): Launched 00:26:30.643290 run setcap-netadm(pid=2588): Terminated: ok {rc=0} 00:26:30.990301 run srsepc(pid=2589): Launched 00:26:31.158279 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 00:26:32.396838 run rm-remote-dir(pid=2590): Launched 00:26:32.584225 run srsepc(pid=2589): ERR: Terminated: ERROR {rc=127} [trial-2366↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2589)] 00:26:32.727015 run srsepc(pid=2589): stdout: | (launched: 2022-12-10_00:26:30.927539) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 00:26:32.870872 run srsepc(pid=2589): stderr: | (launched: 2022-12-10_00:26:30.973359) | Connection to 10.42.42.116 closed. 00:26:33.014476 run srsepc(pid=2589): stdout: | (launched: 2022-12-10_00:26:30.927539) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 00:26:33.152078 run srsepc(pid=2589): stderr: | (launched: 2022-12-10_00:26:30.973359) | Connection to 10.42.42.116 closed. 00:26:33.314637 run rm-remote-dir(pid=2590): Terminating (SIGINT) 00:26:33.503664 run rm-remote-dir(pid=2590): Terminated: ok {rc=0} 00:26:33.640325 tst handover.py:37: ERR: Error: srsepc(pid=2589): Process ended prematurely: srsepc(pid=2589) [trial-2366↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2589)] [trial-2366↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37] 00:26:33.650903 tst handover.py:37: Test FAILED (20.1 sec) 00:26:33.730296 run scp-back-log(pid=2591): Launched 00:26:34.810888 run scp-back-log(pid=2591): ERR: Terminated: ERROR {rc=1} [trial-2366↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=2591)] 00:26:34.874402 run scp-back-log(pid=2591): stdout: | (launched: 2022-12-10_00:26:33.699309) 00:26:34.939311 run scp-back-log(pid=2591): stderr: | (launched: 2022-12-10_00:26:33.719734) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 00:26:35.012031 tst srsepc_10.42.42.118: Error('scp-back-log(pid=2591): launch_sync(): local process exited with status 1 [trial-2366↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=2591)]') ---------------------------------------------- trial-2366 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_bidir.py ---------------------------------------------- 00:26:35.058774 tst iperf3_bidir.py:13: Number of physical ue: 1 00:26:35.278285 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 00:26:35.321348 tst iperf3_bidir.py:20: ue index0: srsue_10.42.42.116 00:26:35.539797 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 00:26:35.555981 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 00:26:35.589791 tst iperf3_bidir.py: using MSISDN 7461 00:26:35.707567 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7461', subscriber_id=0} 00:26:35.821876 run srsepc_10.42.42.118: Starting srsepc 00:26:36.488919 run rm-remote-dir(pid=2593): Launched 00:26:37.678148 run rm-remote-dir(pid=2593): Terminated: ok {rc=0} 00:26:38.034303 run mk-remote-dir(pid=2594): Launched 00:26:39.223429 run mk-remote-dir(pid=2594): Terminated: ok {rc=0} 00:26:39.528041 run scp-inst-to-remote(pid=2595): Launched 00:26:41.716422 run scp-inst-to-remote(pid=2595): Terminated: ok {rc=0} 00:26:42.070186 run rm-remote-dir(pid=2597): Launched 00:26:43.259216 run rm-remote-dir(pid=2597): Terminated: ok {rc=0} 00:26:43.616336 run mk-remote-dir(pid=2598): Launched 00:26:44.805681 run mk-remote-dir(pid=2598): Terminated: ok {rc=0} 00:26:45.109961 run scp-cfg-to-remote(pid=2599): Launched 00:26:46.305852 run scp-cfg-to-remote(pid=2599): Terminated: ok {rc=0} 00:26:46.650310 run scp-db-to-remote(pid=2601): Launched 00:26:47.895236 run scp-db-to-remote(pid=2601): Terminated: ok {rc=0} 00:26:48.035390 run srsepc_10.42.42.118: Setting RPATH for srsepc 00:26:48.363887 run patchelf(pid=2603): Launched 00:26:49.550412 run patchelf(pid=2603): Terminated: ok {rc=0} 00:26:49.690585 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 00:26:50.017761 run setcap-netadm(pid=2604): Launched 00:26:51.204506 run setcap-netadm(pid=2604): Terminated: ok {rc=0} 00:26:51.547732 run srsepc(pid=2605): Launched 00:26:51.669199 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 00:26:52.843794 run rm-remote-dir(pid=2606): Launched 00:26:53.030069 run srsepc(pid=2605): ERR: Terminated: ERROR {rc=127} [trial-2366↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2605)] 00:26:53.173529 run srsepc(pid=2605): stdout: | (launched: 2022-12-10_00:26:51.488216) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 00:26:53.317210 run srsepc(pid=2605): stderr: | (launched: 2022-12-10_00:26:51.536918) | Connection to 10.42.42.116 closed. 00:26:53.460757 run srsepc(pid=2605): stdout: | (launched: 2022-12-10_00:26:51.488216) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 00:26:53.598114 run srsepc(pid=2605): stderr: | (launched: 2022-12-10_00:26:51.536918) | Connection to 10.42.42.116 closed. 00:26:53.760523 run rm-remote-dir(pid=2606): Terminating (SIGINT) 00:26:53.948645 run rm-remote-dir(pid=2606): Terminated: ok {rc=0} 00:26:54.085754 tst iperf3_bidir.py:42: ERR: Error: srsepc(pid=2605): Process ended prematurely: srsepc(pid=2605) [trial-2366↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2605)] [trial-2366↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42] 00:26:54.096606 tst iperf3_bidir.py:42: Test FAILED (19.0 sec) 00:26:54.176710 run scp-back-log(pid=2607): Launched 00:26:55.257455 run scp-back-log(pid=2607): ERR: Terminated: ERROR {rc=1} [trial-2366↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=2607)] 00:26:55.321766 run scp-back-log(pid=2607): stdout: | (launched: 2022-12-10_00:26:54.145518) 00:26:55.387568 run scp-back-log(pid=2607): stderr: | (launched: 2022-12-10_00:26:54.166108) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 00:26:55.460920 tst srsepc_10.42.42.118: Error('scp-back-log(pid=2607): launch_sync(): local process exited with status 1 [trial-2366↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=2607)]') ---------------------------------------------- trial-2366 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_dl.py ---------------------------------------------- 00:26:55.508496 tst iperf3_dl.py:13: Number of physical ue: 1 00:26:55.729018 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 00:26:55.775872 tst iperf3_dl.py:20: ue index0: srsue_10.42.42.116 00:26:55.994671 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 00:26:56.011149 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 00:26:56.044870 tst iperf3_dl.py: using MSISDN 7462 00:26:56.163195 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7462', subscriber_id=0} 00:26:56.277266 run srsepc_10.42.42.118: Starting srsepc 00:26:56.941635 run rm-remote-dir(pid=2609): Launched 00:26:58.131756 run rm-remote-dir(pid=2609): Terminated: ok {rc=0} 00:26:58.487011 run mk-remote-dir(pid=2610): Launched 00:26:59.675821 run mk-remote-dir(pid=2610): Terminated: ok {rc=0} 00:26:59.978376 run scp-inst-to-remote(pid=2611): Launched 00:27:02.165465 run scp-inst-to-remote(pid=2611): Terminated: ok {rc=0} 00:27:02.536894 run rm-remote-dir(pid=2613): Launched 00:27:03.718924 run rm-remote-dir(pid=2613): Terminated: ok {rc=0} 00:27:04.051787 run mk-remote-dir(pid=2614): Launched 00:27:05.231032 run mk-remote-dir(pid=2614): Terminated: ok {rc=0} 00:27:05.513734 run scp-cfg-to-remote(pid=2615): Launched 00:27:06.693568 run scp-cfg-to-remote(pid=2615): Terminated: ok {rc=0} 00:27:06.979792 run scp-db-to-remote(pid=2617): Launched 00:27:08.156367 run scp-db-to-remote(pid=2617): Terminated: ok {rc=0} 00:27:08.286776 run srsepc_10.42.42.118: Setting RPATH for srsepc 00:27:08.592880 run patchelf(pid=2619): Launched 00:27:09.769666 run patchelf(pid=2619): Terminated: ok {rc=0} 00:27:09.900153 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 00:27:10.205826 run setcap-netadm(pid=2620): Launched 00:27:11.381896 run setcap-netadm(pid=2620): Terminated: ok {rc=0} 00:27:11.702375 run srsepc(pid=2621): Launched 00:27:11.831186 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 00:27:13.001668 run rm-remote-dir(pid=2622): Launched 00:27:13.188231 run srsepc(pid=2621): ERR: Terminated: ERROR {rc=127} [trial-2366↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2621)] 00:27:13.330225 run srsepc(pid=2621): stdout: | (launched: 2022-12-10_00:27:11.646479) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 00:27:13.473259 run srsepc(pid=2621): stderr: | (launched: 2022-12-10_00:27:11.691675) | Connection to 10.42.42.116 closed. 00:27:13.616760 run srsepc(pid=2621): stdout: | (launched: 2022-12-10_00:27:11.646479) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 00:27:13.753922 run srsepc(pid=2621): stderr: | (launched: 2022-12-10_00:27:11.691675) | Connection to 10.42.42.116 closed. 00:27:13.916487 run rm-remote-dir(pid=2622): Terminating (SIGINT) 00:27:14.106292 run rm-remote-dir(pid=2622): Terminated: ok {rc=0} 00:27:14.243361 tst iperf3_dl.py:42: ERR: Error: srsepc(pid=2621): Process ended prematurely: srsepc(pid=2621) [trial-2366↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2621)] [trial-2366↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42] 00:27:14.254273 tst iperf3_dl.py:42: Test FAILED (18.7 sec) 00:27:14.335098 run scp-back-log(pid=2623): Launched 00:27:15.416018 run scp-back-log(pid=2623): ERR: Terminated: ERROR {rc=1} [trial-2366↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=2623)] 00:27:15.480148 run scp-back-log(pid=2623): stdout: | (launched: 2022-12-10_00:27:14.303703) 00:27:15.546032 run scp-back-log(pid=2623): stderr: | (launched: 2022-12-10_00:27:14.324475) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 00:27:15.619816 tst srsepc_10.42.42.118: Error('scp-back-log(pid=2623): launch_sync(): local process exited with status 1 [trial-2366↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=2623)]') ---------------------------------------------- trial-2366 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_ul.py ---------------------------------------------- 00:27:15.667441 tst iperf3_ul.py:13: Number of physical ue: 1 00:27:15.903923 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 00:27:15.949821 tst iperf3_ul.py:20: ue index0: srsue_10.42.42.116 00:27:16.220940 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 00:27:16.241781 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 00:27:16.282423 tst iperf3_ul.py: using MSISDN 7463 00:27:16.402705 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7463', subscriber_id=0} 00:27:16.519044 run srsepc_10.42.42.118: Starting srsepc 00:27:17.200748 run rm-remote-dir(pid=2625): Launched 00:27:18.390135 run rm-remote-dir(pid=2625): Terminated: ok {rc=0} 00:27:18.746341 run mk-remote-dir(pid=2626): Launched 00:27:19.934878 run mk-remote-dir(pid=2626): Terminated: ok {rc=0} 00:27:20.238332 run scp-inst-to-remote(pid=2627): Launched 00:27:22.426647 run scp-inst-to-remote(pid=2627): Terminated: ok {rc=0} 00:27:22.780329 run rm-remote-dir(pid=2629): Launched 00:27:23.969442 run rm-remote-dir(pid=2629): Terminated: ok {rc=0} 00:27:24.324879 run mk-remote-dir(pid=2630): Launched 00:27:25.511301 run mk-remote-dir(pid=2630): Terminated: ok {rc=0} 00:27:25.794945 run scp-cfg-to-remote(pid=2631): Launched 00:27:26.971539 run scp-cfg-to-remote(pid=2631): Terminated: ok {rc=0} 00:27:27.252619 run scp-db-to-remote(pid=2633): Launched 00:27:28.429932 run scp-db-to-remote(pid=2633): Terminated: ok {rc=0} 00:27:28.560480 run srsepc_10.42.42.118: Setting RPATH for srsepc 00:27:28.865958 run patchelf(pid=2635): Launched 00:27:30.042150 run patchelf(pid=2635): Terminated: ok {rc=0} 00:27:30.172418 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 00:27:30.478315 run setcap-netadm(pid=2636): Launched 00:27:31.674808 run setcap-netadm(pid=2636): Terminated: ok {rc=0} 00:27:32.017912 run srsepc(pid=2637): Launched 00:27:32.243578 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 00:27:33.371720 run rm-remote-dir(pid=2638): Launched 00:27:33.549997 run srsepc(pid=2637): ERR: Terminated: ERROR {rc=127} [trial-2366↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2637)] 00:27:33.685817 run srsepc(pid=2637): stdout: | (launched: 2022-12-10_00:27:31.951932) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 00:27:33.820779 run srsepc(pid=2637): stderr: | (launched: 2022-12-10_00:27:31.998053) | Connection to 10.42.42.116 closed. 00:27:33.955991 run srsepc(pid=2637): stdout: | (launched: 2022-12-10_00:27:31.951932) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 00:27:34.084690 run srsepc(pid=2637): stderr: | (launched: 2022-12-10_00:27:31.998053) | Connection to 10.42.42.116 closed. 00:27:34.237424 run rm-remote-dir(pid=2638): Terminating (SIGINT) 00:27:34.414720 run rm-remote-dir(pid=2638): Terminated: ok {rc=0} 00:27:34.543173 tst iperf3_ul.py:42: ERR: Error: srsepc(pid=2637): Process ended prematurely: srsepc(pid=2637) [trial-2366↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2637)] [trial-2366↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42] 00:27:34.553176 tst iperf3_ul.py:42: Test FAILED (18.9 sec) 00:27:34.629448 run scp-back-log(pid=2639): Launched 00:27:35.705774 run scp-back-log(pid=2639): ERR: Terminated: ERROR {rc=1} [trial-2366↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=2639)] 00:27:35.766828 run scp-back-log(pid=2639): stdout: | (launched: 2022-12-10_00:27:34.599073) 00:27:35.828725 run scp-back-log(pid=2639): stderr: | (launched: 2022-12-10_00:27:34.618701) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 00:27:35.898639 tst srsepc_10.42.42.118: Error('scp-back-log(pid=2639): launch_sync(): local process exited with status 1 [trial-2366↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=2639)]') ---------------------------------------------- trial-2366 4g:srsenb-rftype@zmq+srsue-rftype@zmq ping.py ---------------------------------------------- 00:27:35.946323 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 00:27:35.962906 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 00:27:35.985559 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 00:27:36.033674 tst ping.py: using MSISDN 7464 00:27:36.157651 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7464', subscriber_id=0} 00:27:36.273341 run srsepc_10.42.42.118: Starting srsepc 00:27:36.946844 run rm-remote-dir(pid=2642): Launched 00:27:38.137875 run rm-remote-dir(pid=2642): Terminated: ok {rc=0} 00:27:38.495345 run mk-remote-dir(pid=2643): Launched 00:27:39.683542 run mk-remote-dir(pid=2643): Terminated: ok {rc=0} 00:27:39.987488 run scp-inst-to-remote(pid=2644): Launched 00:27:42.177384 run scp-inst-to-remote(pid=2644): Terminated: ok {rc=0} 00:27:42.532524 run rm-remote-dir(pid=2646): Launched 00:27:43.720837 run rm-remote-dir(pid=2646): Terminated: ok {rc=0} 00:27:44.077709 run mk-remote-dir(pid=2647): Launched 00:27:45.267729 run mk-remote-dir(pid=2647): Terminated: ok {rc=0} 00:27:45.571728 run scp-cfg-to-remote(pid=2648): Launched 00:27:46.774904 run scp-cfg-to-remote(pid=2648): Terminated: ok {rc=0} 00:27:47.142499 run scp-db-to-remote(pid=2650): Launched 00:27:48.363989 run scp-db-to-remote(pid=2650): Terminated: ok {rc=0} 00:27:48.503637 run srsepc_10.42.42.118: Setting RPATH for srsepc 00:27:48.831737 run patchelf(pid=2652): Launched 00:27:50.017760 run patchelf(pid=2652): Terminated: ok {rc=0} 00:27:50.158578 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 00:27:50.486135 run setcap-netadm(pid=2653): Launched 00:27:51.673279 run setcap-netadm(pid=2653): Terminated: ok {rc=0} 00:27:52.015887 run srsepc(pid=2654): Launched 00:27:52.138205 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 00:27:53.313010 run rm-remote-dir(pid=2655): Launched 00:27:53.499867 run srsepc(pid=2654): ERR: Terminated: ERROR {rc=127} [trial-2366↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2654)] 00:27:53.643284 run srsepc(pid=2654): stdout: | (launched: 2022-12-10_00:27:51.956598) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 00:27:53.787394 run srsepc(pid=2654): stderr: | (launched: 2022-12-10_00:27:52.005260) | Connection to 10.42.42.116 closed. 00:27:53.931398 run srsepc(pid=2654): stdout: | (launched: 2022-12-10_00:27:51.956598) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 00:27:54.069399 run srsepc(pid=2654): stderr: | (launched: 2022-12-10_00:27:52.005260) | Connection to 10.42.42.116 closed. 00:27:54.233117 run rm-remote-dir(pid=2655): Terminating (SIGINT) 00:27:54.422535 run rm-remote-dir(pid=2655): Terminated: ok {rc=0} 00:27:54.559837 tst ping.py:16: ERR: Error: srsepc(pid=2654): Process ended prematurely: srsepc(pid=2654) [trial-2366↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2654)] [trial-2366↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16] 00:27:54.570779 tst ping.py:16: Test FAILED (18.6 sec) 00:27:54.650691 run scp-back-log(pid=2656): Launched 00:27:55.730247 run scp-back-log(pid=2656): ERR: Terminated: ERROR {rc=1} [trial-2366↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=2656)] 00:27:55.793996 run scp-back-log(pid=2656): stdout: | (launched: 2022-12-10_00:27:54.619474) 00:27:55.859166 run scp-back-log(pid=2656): stderr: | (launched: 2022-12-10_00:27:54.639928) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 00:27:55.932029 tst srsepc_10.42.42.118: Error('scp-back-log(pid=2656): launch_sync(): local process exited with status 1 [trial-2366↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=2656)]') ---------------------------------------------- trial-2366 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mo_ping.py ---------------------------------------------- 00:27:55.979391 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 00:27:55.996556 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 00:27:56.020314 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 00:27:56.073090 tst rrc_idle_mo_ping.py: using MSISDN 7465 00:27:56.195543 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7465', subscriber_id=0} 00:27:56.310172 run srsepc_10.42.42.118: Starting srsepc 00:27:56.978192 run rm-remote-dir(pid=2658): Launched 00:27:58.168050 run rm-remote-dir(pid=2658): Terminated: ok {rc=0} 00:27:58.525918 run mk-remote-dir(pid=2659): Launched 00:27:59.714509 run mk-remote-dir(pid=2659): Terminated: ok {rc=0} 00:28:00.018045 run scp-inst-to-remote(pid=2660): Launched 00:28:02.222571 run scp-inst-to-remote(pid=2660): Terminated: ok {rc=0} 00:28:02.642302 run rm-remote-dir(pid=2662): Launched 00:28:03.822507 run rm-remote-dir(pid=2662): Terminated: ok {rc=0} 00:28:04.156863 run mk-remote-dir(pid=2663): Launched 00:28:05.336259 run mk-remote-dir(pid=2663): Terminated: ok {rc=0} 00:28:05.620350 run scp-cfg-to-remote(pid=2664): Launched 00:28:06.796798 run scp-cfg-to-remote(pid=2664): Terminated: ok {rc=0} 00:28:07.078762 run scp-db-to-remote(pid=2666): Launched 00:28:08.256411 run scp-db-to-remote(pid=2666): Terminated: ok {rc=0} 00:28:08.387027 run srsepc_10.42.42.118: Setting RPATH for srsepc 00:28:08.693073 run patchelf(pid=2668): Launched 00:28:09.869275 run patchelf(pid=2668): Terminated: ok {rc=0} 00:28:09.999821 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 00:28:10.306178 run setcap-netadm(pid=2669): Launched 00:28:11.481298 run setcap-netadm(pid=2669): Terminated: ok {rc=0} 00:28:11.803017 run srsepc(pid=2670): Launched 00:28:11.944536 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 00:28:13.049200 run rm-remote-dir(pid=2671): Launched 00:28:13.226641 run srsepc(pid=2670): ERR: Terminated: ERROR {rc=127} [trial-2366↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2670)] 00:28:13.362905 run srsepc(pid=2670): stdout: | (launched: 2022-12-10_00:28:11.747500) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 00:28:13.498450 run srsepc(pid=2670): stderr: | (launched: 2022-12-10_00:28:11.792647) | Connection to 10.42.42.116 closed. 00:28:13.633923 run srsepc(pid=2670): stdout: | (launched: 2022-12-10_00:28:11.747500) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 00:28:13.762685 run srsepc(pid=2670): stderr: | (launched: 2022-12-10_00:28:11.792647) | Connection to 10.42.42.116 closed. 00:28:13.915133 run rm-remote-dir(pid=2671): Terminating (SIGINT) 00:28:14.092815 run rm-remote-dir(pid=2671): Terminated: ok {rc=0} 00:28:14.221842 tst rrc_idle_mo_ping.py:16: ERR: Error: srsepc(pid=2670): Process ended prematurely: srsepc(pid=2670) [trial-2366↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2670)] [trial-2366↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16] 00:28:14.231903 tst rrc_idle_mo_ping.py:16: Test FAILED (18.2 sec) 00:28:14.308488 run scp-back-log(pid=2672): Launched 00:28:15.385440 run scp-back-log(pid=2672): ERR: Terminated: ERROR {rc=1} [trial-2366↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=2672)] 00:28:15.445510 run scp-back-log(pid=2672): stdout: | (launched: 2022-12-10_00:28:14.278211) 00:28:15.507202 run scp-back-log(pid=2672): stderr: | (launched: 2022-12-10_00:28:14.297970) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 00:28:15.576380 tst srsepc_10.42.42.118: Error('scp-back-log(pid=2672): launch_sync(): local process exited with status 1 [trial-2366↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=2672)]') ---------------------------------------------- trial-2366 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mt_ping.py ---------------------------------------------- 00:28:15.621536 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 00:28:15.638018 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 00:28:15.660502 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 00:28:15.710353 tst rrc_idle_mt_ping.py: using MSISDN 7466 00:28:15.835763 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7466', subscriber_id=0} 00:28:15.970673 run srsepc_10.42.42.118: Starting srsepc 00:28:16.662403 run rm-remote-dir(pid=2675): Launched 00:28:17.902997 run rm-remote-dir(pid=2675): Terminated: ok {rc=0} 00:28:18.236885 run mk-remote-dir(pid=2676): Launched 00:28:19.423683 run mk-remote-dir(pid=2676): Terminated: ok {rc=0} 00:28:19.726549 run scp-inst-to-remote(pid=2677): Launched 00:28:21.915193 run scp-inst-to-remote(pid=2677): Terminated: ok {rc=0} 00:28:22.270080 run rm-remote-dir(pid=2679): Launched 00:28:23.459618 run rm-remote-dir(pid=2679): Terminated: ok {rc=0} 00:28:23.815346 run mk-remote-dir(pid=2680): Launched 00:28:25.005180 run mk-remote-dir(pid=2680): Terminated: ok {rc=0} 00:28:25.308886 run scp-cfg-to-remote(pid=2681): Launched 00:28:26.495721 run scp-cfg-to-remote(pid=2681): Terminated: ok {rc=0} 00:28:26.799600 run scp-db-to-remote(pid=2683): Launched 00:28:27.987065 run scp-db-to-remote(pid=2683): Terminated: ok {rc=0} 00:28:28.127098 run srsepc_10.42.42.118: Setting RPATH for srsepc 00:28:28.455708 run patchelf(pid=2685): Launched 00:28:29.641906 run patchelf(pid=2685): Terminated: ok {rc=0} 00:28:29.781726 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 00:28:30.109228 run setcap-netadm(pid=2686): Launched 00:28:31.295036 run setcap-netadm(pid=2686): Terminated: ok {rc=0} 00:28:31.651875 run srsepc(pid=2687): Launched 00:28:31.823631 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 00:28:33.038045 run rm-remote-dir(pid=2688): Launched 00:28:33.218283 run srsepc(pid=2687): ERR: Terminated: ERROR {rc=127} [trial-2366↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2687)] 00:28:33.353208 run srsepc(pid=2687): stdout: | (launched: 2022-12-10_00:28:31.585635) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 00:28:33.487589 run srsepc(pid=2687): stderr: | (launched: 2022-12-10_00:28:31.634635) | Connection to 10.42.42.116 closed. 00:28:33.621932 run srsepc(pid=2687): stdout: | (launched: 2022-12-10_00:28:31.585635) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 00:28:33.749614 run srsepc(pid=2687): stderr: | (launched: 2022-12-10_00:28:31.634635) | Connection to 10.42.42.116 closed. 00:28:33.900942 run rm-remote-dir(pid=2688): Terminating (SIGINT) 00:28:34.077283 run rm-remote-dir(pid=2688): Terminated: ok {rc=0} 00:28:34.205195 tst rrc_idle_mt_ping.py:16: ERR: Error: srsepc(pid=2687): Process ended prematurely: srsepc(pid=2687) [trial-2366↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2687)] [trial-2366↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16] 00:28:34.215164 tst rrc_idle_mt_ping.py:16: Test FAILED (18.6 sec) 00:28:34.291134 run scp-back-log(pid=2689): Launched 00:28:35.367274 run scp-back-log(pid=2689): ERR: Terminated: ERROR {rc=1} [trial-2366↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=2689)] 00:28:35.427274 run scp-back-log(pid=2689): stdout: | (launched: 2022-12-10_00:28:34.261269) 00:28:35.489202 run scp-back-log(pid=2689): stderr: | (launched: 2022-12-10_00:28:34.281038) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 00:28:35.559382 tst srsepc_10.42.42.118: Error('scp-back-log(pid=2689): launch_sync(): local process exited with status 1 [trial-2366↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=2689)]') --------------------------------------------------------------------- trial-2366 4g:srsenb-rftype@zmq+srsue-rftype@zmq FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 handover_2G:nanobts+bts1-oc2g --------------------------------------------------------------------- 00:28:35.686442 tst handover_2G:nanobts+bts1-oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:28:35.693242 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x bts (candidates: 11) 00:28:35.736354 tst handover_2G:nanobts+bts1-oc2g: Verifying 6 x ip_address (candidates: 9) 00:28:35.763749 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x modem (candidates: 12) 00:28:35.817512 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x bts (candidates: 11) 00:28:35.860920 tst handover_2G:nanobts+bts1-oc2g: Reserving 6 x ip_address (candidates: 9) 00:28:35.888318 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x modem (candidates: 12) 00:28:36.439427 tst handover_2G:nanobts+bts1-oc2g: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 handover_2G:nanobts+bts1-oc2g handover.py ---------------------------------------------- 00:28:36.445433 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 00:28:36.456755 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 00:28:36.495684 tst handover.py: using LAC 24719 00:28:36.625475 tst handover.py: using RAC 239 00:28:36.744330 tst handover.py: using CellId 24719 00:28:36.865811 tst handover.py: using BVCI 24720 00:28:36.976574 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 00:28:37.011309 tst handover.py: using LAC 24720 00:28:37.130385 tst handover.py: using RAC 240 00:28:37.257378 tst handover.py: using CellId 24720 00:28:37.384687 tst handover.py: using BVCI 24721 00:28:37.502495 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 00:28:37.513993 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 00:28:37.525292 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 00:28:37.536887 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 00:28:37.548448 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 00:28:37.559875 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 00:28:37.676063 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 00:28:37.794952 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:28:38.292931 run create_hlr_db(pid=2695): Launched 00:28:39.479813 run create_hlr_db(pid=2695): Terminated: ok {rc=0} 00:28:39.818306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2697): Launched 00:28:40.137743 run osmo-hlr_10.42.42.2(pid=2698): Launched 00:28:40.261319 run osmo-stp_10.42.42.5: Starting osmo-stp 00:28:40.814815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2700): Launched 00:28:41.135495 run osmo-stp_10.42.42.5(pid=2701): Launched 00:28:41.258514 run osmo-msc_10.42.42.6: Starting osmo-msc 00:28:41.841258 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2703): Launched 00:28:42.161199 run osmo-msc_10.42.42.6(pid=2704): Launched 00:28:42.339558 run osmo-stp_10.42.42.5(pid=2701): ERR: Terminated: ERROR {rc=1} [trial-2366↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2701)] 00:28:42.475423 run osmo-stp_10.42.42.5(pid=2701): stdout: | (launched: 2022-12-10_00:28:41.076653) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:28:42.610919 run osmo-stp_10.42.42.5(pid=2701): stderr: | 20221210002841265 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002841266 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002841266 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002841266 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002841267 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002841267 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002841267 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:28:42.745747 run osmo-stp_10.42.42.5(pid=2701): stdout: | (launched: 2022-12-10_00:28:41.076653) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:28:42.873716 run osmo-stp_10.42.42.5(pid=2701): stderr: | 20221210002841265 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002841266 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002841266 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002841266 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002841267 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002841267 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002841267 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:28:43.026835 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2701): Process ended prematurely: osmo-stp_10.42.42.5(pid=2701) [trial-2366↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2701)] [trial-2366↪handover_2G:nanobts+bts1-oc2g↪handover.py:18] 00:28:43.035781 tst handover.py:18: Test FAILED (6.6 sec) 00:28:43.063634 run osmo-hlr_10.42.42.2(pid=2698): ERR: Terminated: ERROR {rc=237} [trial-2366↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2698)] 00:28:43.114318 run osmo-hlr_10.42.42.2(pid=2698): stdout: | (launched: 2022-12-10_00:28:40.079942) 00:28:43.166999 run osmo-hlr_10.42.42.2(pid=2698): stderr: | 20221210002840278 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210002840278 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210002840278 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210002840278 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210002840278 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210002840278 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210002840290 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/handover_2G:nanobts+bts1-oc2g/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210002840299 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210002840299 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210002840299 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:28:43.239351 run osmo-msc_10.42.42.6(pid=2704): ERR: Terminated: ERROR {rc=2} [trial-2366↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2704)] 00:28:43.289762 run osmo-msc_10.42.42.6(pid=2704): stdout: | (launched: 2022-12-10_00:28:42.102678) 00:28:43.341643 run osmo-msc_10.42.42.6(pid=2704): stderr: | 20221210002842423 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210002842423 DLGLOBAL DEBUG validating counter group 0x7fb5a5029c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210002842423 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210002842423 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210002842423 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210002842423 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210002842425 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210002842426 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210002842426 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210002842426 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:28:43.393808 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2697): Terminating (SIGTERM) 00:28:43.435329 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2700): Terminating (SIGTERM) 00:28:43.477217 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2703): Terminating (SIGTERM) 00:28:43.519161 --- ParallelTerminationStrategy: PID 2697 died... 00:28:43.539126 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2697): Terminated: ok {rc=0} 00:28:43.585955 --- ParallelTerminationStrategy: PID 2700 died... 00:28:43.605542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2700): Terminated: ok {rc=0} 00:28:43.652003 --- ParallelTerminationStrategy: PID 2703 died... 00:28:43.671649 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2703): Terminated: ok {rc=0} 00:28:43.759249 bus /sierra_3: Setting Powered False 00:28:44.858095 bus /sierra_3: Setting Powered False 00:28:45.980554 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 handover_2G:nanobts+bts1-oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 handover_2G:nanobts+bts1-octphy --------------------------------------------------------------------- 00:28:47.274290 tst handover_2G:nanobts+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:28:47.279976 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x bts (candidates: 11) 00:28:47.320461 tst handover_2G:nanobts+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 00:28:47.347028 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x modem (candidates: 12) 00:28:47.398355 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x bts (candidates: 11) 00:28:47.437949 tst handover_2G:nanobts+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 00:28:47.464328 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x modem (candidates: 12) 00:28:48.021562 tst handover_2G:nanobts+bts1-octphy: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 handover_2G:nanobts+bts1-octphy handover.py ---------------------------------------------- 00:28:48.027235 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 00:28:48.038758 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 00:28:48.077911 tst handover.py: using LAC 24721 00:28:48.207076 tst handover.py: using RAC 241 00:28:48.336084 tst handover.py: using CellId 24721 00:28:48.464527 tst handover.py: using BVCI 24722 00:28:48.584544 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 00:28:48.619507 tst handover.py: using LAC 24722 00:28:48.753420 tst handover.py: using RAC 242 00:28:48.879905 tst handover.py: using CellId 24722 00:28:49.005397 tst handover.py: using BVCI 24723 00:28:49.123042 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 00:28:49.134624 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 00:28:49.146589 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 00:28:49.158625 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 00:28:49.171030 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 00:28:49.183051 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 00:28:49.302550 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 00:28:49.417872 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:28:49.857854 run create_hlr_db(pid=2709): Launched 00:28:49.980460 bus /sierra_2: Setting Powered False 00:28:51.040503 run create_hlr_db(pid=2709): Terminated: ok {rc=0} 00:28:51.453365 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2711): Launched 00:28:51.776439 run osmo-hlr_10.42.42.2(pid=2712): Launched 00:28:51.899114 run osmo-stp_10.42.42.5: Starting osmo-stp 00:28:52.423142 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2714): Launched 00:28:52.743312 run osmo-stp_10.42.42.5(pid=2715): Launched 00:28:52.866504 run osmo-msc_10.42.42.6: Starting osmo-msc 00:28:53.419103 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2717): Launched 00:28:53.739799 run osmo-msc_10.42.42.6(pid=2718): Launched 00:28:53.918973 run osmo-stp_10.42.42.5(pid=2715): ERR: Terminated: ERROR {rc=1} [trial-2366↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2715)] 00:28:54.054548 run osmo-stp_10.42.42.5(pid=2715): stdout: | (launched: 2022-12-10_00:28:52.685336) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:28:54.190967 run osmo-stp_10.42.42.5(pid=2715): stderr: | 20221210002852876 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002852876 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002852876 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002852877 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002852879 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002852879 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002852879 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:28:54.325899 run osmo-stp_10.42.42.5(pid=2715): stdout: | (launched: 2022-12-10_00:28:52.685336) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:28:54.454156 run osmo-stp_10.42.42.5(pid=2715): stderr: | 20221210002852876 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002852876 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002852876 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002852877 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002852879 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002852879 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002852879 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:28:54.607731 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2715): Process ended prematurely: osmo-stp_10.42.42.5(pid=2715) [trial-2366↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2715)] [trial-2366↪handover_2G:nanobts+bts1-octphy↪handover.py:18] 00:28:54.616560 tst handover.py:18: Test FAILED (6.6 sec) 00:28:54.644173 run osmo-hlr_10.42.42.2(pid=2712): ERR: Terminated: ERROR {rc=237} [trial-2366↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2712)] 00:28:54.693723 run osmo-hlr_10.42.42.2(pid=2712): stdout: | (launched: 2022-12-10_00:28:51.718205) 00:28:54.745228 run osmo-hlr_10.42.42.2(pid=2712): stderr: | 20221210002851919 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210002851919 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210002851919 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210002851919 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210002851919 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210002851919 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210002851931 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/handover_2G:nanobts+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210002851939 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210002851940 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210002851940 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:28:54.816598 run osmo-msc_10.42.42.6(pid=2718): ERR: Terminated: ERROR {rc=2} [trial-2366↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2718)] 00:28:54.866178 run osmo-msc_10.42.42.6(pid=2718): stdout: | (launched: 2022-12-10_00:28:53.681386) 00:28:54.917351 run osmo-msc_10.42.42.6(pid=2718): stderr: | 20221210002854004 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210002854004 DLGLOBAL DEBUG validating counter group 0x7efc618ccc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210002854004 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210002854004 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210002854004 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210002854005 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210002854006 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210002854007 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210002854007 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210002854007 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:28:54.969093 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2711): Terminating (SIGTERM) 00:28:55.010330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2714): Terminating (SIGTERM) 00:28:55.051645 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2717): Terminating (SIGTERM) 00:28:55.093233 --- ParallelTerminationStrategy: PID 2711 died... 00:28:55.112713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2711): Terminated: ok {rc=0} 00:28:55.159090 --- ParallelTerminationStrategy: PID 2714 died... 00:28:55.178219 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2714): Terminated: ok {rc=0} 00:28:55.223977 --- ParallelTerminationStrategy: PID 2717 died... 00:28:55.243108 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2717): Terminated: ok {rc=0} 00:28:55.329395 bus /sierra_3: Setting Powered False 00:28:56.426728 bus /sierra_3: Setting Powered False 00:28:57.543024 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 handover_2G:nanobts+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 handover_2G:nanobts+bts1-trx-lms --------------------------------------------------------------------- 00:28:58.785077 tst handover_2G:nanobts+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:28:58.790362 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 00:28:58.843718 tst handover_2G:nanobts+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 00:28:58.870370 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 00:28:58.921386 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 00:28:58.973947 tst handover_2G:nanobts+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 00:28:59.000123 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 00:28:59.552634 tst handover_2G:nanobts+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 handover_2G:nanobts+bts1-trx-lms handover.py ---------------------------------------------- 00:28:59.558285 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 00:28:59.569372 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 00:28:59.607087 tst handover.py: using LAC 24723 00:28:59.726683 tst handover.py: using RAC 243 00:28:59.847095 tst handover.py: using CellId 24723 00:28:59.967936 tst handover.py: using BVCI 24724 00:29:00.078250 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 00:29:00.126770 tst handover.py: using LAC 24724 00:29:00.248182 tst handover.py: using RAC 244 00:29:00.368636 tst handover.py: using CellId 24724 00:29:00.488287 tst handover.py: using BVCI 24725 00:29:00.600327 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 00:29:00.611652 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 00:29:00.622592 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 00:29:00.633592 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 00:29:00.644495 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 00:29:00.655465 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 00:29:00.773573 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 00:29:00.899471 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:29:01.389856 run create_hlr_db(pid=2723): Launched 00:29:01.548586 bus /sierra_2: Setting Powered False 00:29:02.609364 run create_hlr_db(pid=2723): Terminated: ok {rc=0} 00:29:03.022149 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2725): Launched 00:29:03.343015 run osmo-hlr_10.42.42.2(pid=2726): Launched 00:29:03.466229 run osmo-stp_10.42.42.5: Starting osmo-stp 00:29:03.989847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2728): Launched 00:29:04.309307 run osmo-stp_10.42.42.5(pid=2729): Launched 00:29:04.433051 run osmo-msc_10.42.42.6: Starting osmo-msc 00:29:04.987406 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2731): Launched 00:29:05.309311 run osmo-msc_10.42.42.6(pid=2732): Launched 00:29:05.490165 run osmo-stp_10.42.42.5(pid=2729): ERR: Terminated: ERROR {rc=1} [trial-2366↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2729)] 00:29:05.626800 run osmo-stp_10.42.42.5(pid=2729): stdout: | (launched: 2022-12-10_00:29:04.251056) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:29:05.762832 run osmo-stp_10.42.42.5(pid=2729): stderr: | 20221210002904443 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002904443 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002904443 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002904443 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002904444 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002904444 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002904444 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:29:05.897776 run osmo-stp_10.42.42.5(pid=2729): stdout: | (launched: 2022-12-10_00:29:04.251056) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:29:06.025730 run osmo-stp_10.42.42.5(pid=2729): stderr: | 20221210002904443 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002904443 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002904443 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002904443 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002904444 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002904444 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002904444 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:29:06.179280 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2729): Process ended prematurely: osmo-stp_10.42.42.5(pid=2729) [trial-2366↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2729)] [trial-2366↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18] 00:29:06.188305 tst handover.py:18: Test FAILED (6.6 sec) 00:29:06.216343 run osmo-hlr_10.42.42.2(pid=2726): ERR: Terminated: ERROR {rc=237} [trial-2366↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2726)] 00:29:06.266202 run osmo-hlr_10.42.42.2(pid=2726): stdout: | (launched: 2022-12-10_00:29:03.284905) 00:29:06.317660 run osmo-hlr_10.42.42.2(pid=2726): stderr: | 20221210002903482 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210002903483 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210002903483 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210002903483 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210002903483 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210002903483 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210002903495 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/handover_2G:nanobts+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210002903503 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210002903504 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210002903504 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:29:06.389486 run osmo-msc_10.42.42.6(pid=2732): ERR: Terminated: ERROR {rc=2} [trial-2366↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2732)] 00:29:06.439426 run osmo-msc_10.42.42.6(pid=2732): stdout: | (launched: 2022-12-10_00:29:05.251096) 00:29:06.490799 run osmo-msc_10.42.42.6(pid=2732): stderr: | 20221210002905570 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210002905570 DLGLOBAL DEBUG validating counter group 0x7fb6b5fcec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210002905570 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210002905570 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210002905570 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210002905570 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210002905572 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210002905572 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210002905573 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210002905573 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:29:06.542558 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2725): Terminating (SIGTERM) 00:29:06.583880 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2728): Terminating (SIGTERM) 00:29:06.625310 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2731): Terminating (SIGTERM) 00:29:06.667880 --- ParallelTerminationStrategy: PID 2725 died... 00:29:06.687784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2725): Terminated: ok {rc=0} 00:29:06.734053 --- ParallelTerminationStrategy: PID 2728 died... 00:29:06.753565 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2728): Terminated: ok {rc=0} 00:29:06.799482 --- ParallelTerminationStrategy: PID 2731 died... 00:29:06.818895 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2731): Terminated: ok {rc=0} 00:29:06.905603 bus /sierra_3: Setting Powered False 00:29:08.004828 bus /sierra_3: Setting Powered False 00:29:09.123337 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 handover_2G:nanobts+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 handover_2G:nanobts+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 00:29:10.379989 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:29:10.385290 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 00:29:10.434662 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 00:29:10.461217 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 00:29:10.511342 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 00:29:10.560432 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 00:29:10.586887 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 00:29:11.141939 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 handover_2G:nanobts+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 00:29:11.147408 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:29:11.158682 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 00:29:11.196579 tst handover.py: using LAC 24725 00:29:11.313561 tst handover.py: using RAC 245 00:29:11.430535 tst handover.py: using CellId 24725 00:29:11.547235 tst handover.py: using BVCI 24726 00:29:11.657187 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 00:29:11.700225 tst handover.py: using LAC 24726 00:29:11.817470 tst handover.py: using RAC 246 00:29:11.942751 tst handover.py: using CellId 24726 00:29:12.062305 tst handover.py: using BVCI 24727 00:29:12.171485 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:29:12.182701 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:29:12.193784 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:29:12.205041 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:29:12.216161 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:29:12.227345 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 00:29:12.345457 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 00:29:12.465405 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:29:12.936665 run create_hlr_db(pid=2737): Launched 00:29:13.059241 bus /sierra_2: Setting Powered False 00:29:14.122672 run create_hlr_db(pid=2737): Terminated: ok {rc=0} 00:29:14.541680 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2739): Launched 00:29:14.862478 run osmo-hlr_10.42.42.2(pid=2740): Launched 00:29:14.985531 run osmo-stp_10.42.42.5: Starting osmo-stp 00:29:15.513507 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2742): Launched 00:29:15.845685 run osmo-stp_10.42.42.5(pid=2743): Launched 00:29:16.040888 run osmo-msc_10.42.42.6: Starting osmo-msc 00:29:16.850284 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2745): Launched 00:29:17.202663 run osmo-msc_10.42.42.6(pid=2746): Launched 00:29:17.433844 run osmo-stp_10.42.42.5(pid=2743): ERR: Terminated: ERROR {rc=1} [trial-2366↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2743)] 00:29:17.612292 run osmo-stp_10.42.42.5(pid=2743): stdout: | (launched: 2022-12-10_00:29:15.776131) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:29:17.740309 run osmo-stp_10.42.42.5(pid=2743): stderr: | 20221210002916160 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002916160 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002916160 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002916161 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002916161 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002916161 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002916161 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:29:17.866117 run osmo-stp_10.42.42.5(pid=2743): stdout: | (launched: 2022-12-10_00:29:15.776131) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:29:17.985925 run osmo-stp_10.42.42.5(pid=2743): stderr: | 20221210002916160 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002916160 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002916160 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002916161 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002916161 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002916161 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002916161 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:29:18.129362 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2743): Process ended prematurely: osmo-stp_10.42.42.5(pid=2743) [trial-2366↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2743)] [trial-2366↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18] 00:29:18.137775 tst handover.py:18: Test FAILED (7.0 sec) 00:29:18.163895 run osmo-hlr_10.42.42.2(pid=2740): ERR: Terminated: ERROR {rc=237} [trial-2366↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2740)] 00:29:18.211394 run osmo-hlr_10.42.42.2(pid=2740): stdout: | (launched: 2022-12-10_00:29:14.804306) 00:29:18.260594 run osmo-hlr_10.42.42.2(pid=2740): stderr: | 20221210002915007 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210002915007 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210002915007 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210002915007 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210002915007 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210002915007 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210002915021 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/handover_2G:nanobts+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210002915029 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210002915029 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210002915029 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:29:18.328791 run osmo-msc_10.42.42.6(pid=2746): ERR: Terminated: ERROR {rc=2} [trial-2366↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2746)] 00:29:18.376276 run osmo-msc_10.42.42.6(pid=2746): stdout: | (launched: 2022-12-10_00:29:17.139129) 00:29:18.425290 run osmo-msc_10.42.42.6(pid=2746): stderr: | 20221210002917555 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210002917556 DLGLOBAL DEBUG validating counter group 0x7f81bf5a7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210002917556 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210002917556 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210002917556 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210002917556 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210002917558 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210002917558 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210002917558 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210002917559 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:29:18.474759 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2739): Terminating (SIGTERM) 00:29:18.514216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2742): Terminating (SIGTERM) 00:29:18.554004 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2745): Terminating (SIGTERM) 00:29:18.593852 --- ParallelTerminationStrategy: PID 2739 died... 00:29:18.612937 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2739): Terminated: ok {rc=0} 00:29:18.657407 --- ParallelTerminationStrategy: PID 2742 died... 00:29:18.676054 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2742): Terminated: ok {rc=0} 00:29:18.720004 --- ParallelTerminationStrategy: PID 2745 died... 00:29:18.739011 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2745): Terminated: ok {rc=0} 00:29:18.824161 bus /sierra_3: Setting Powered False 00:29:19.923639 bus /sierra_3: Setting Powered False 00:29:21.035111 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 handover_2G:nanobts+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 handover_2G:nanobts+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 00:29:22.290671 tst handover_2G:nanobts+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:29:22.296270 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 00:29:22.352321 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 00:29:22.380268 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 00:29:22.433535 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 00:29:22.489388 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 00:29:22.516839 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 00:29:23.069873 tst handover_2G:nanobts+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 handover_2G:nanobts+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 00:29:23.075305 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:29:23.086770 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 00:29:23.125812 tst handover.py: using LAC 24727 00:29:23.256499 tst handover.py: using RAC 247 00:29:23.382464 tst handover.py: using CellId 24727 00:29:23.507595 tst handover.py: using BVCI 24728 00:29:23.625103 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 00:29:23.676633 tst handover.py: using LAC 24728 00:29:23.802869 tst handover.py: using RAC 248 00:29:23.928706 tst handover.py: using CellId 24728 00:29:24.053417 tst handover.py: using BVCI 24729 00:29:24.163894 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:29:24.175074 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:29:24.186078 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:29:24.197277 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:29:24.208347 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:29:24.219343 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 00:29:24.337505 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 00:29:24.456806 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:29:24.926120 run create_hlr_db(pid=2752): Launched 00:29:25.048482 bus /sierra_2: Setting Powered False 00:29:26.112297 run create_hlr_db(pid=2752): Terminated: ok {rc=0} 00:29:26.516244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2754): Launched 00:29:26.838133 run osmo-hlr_10.42.42.2(pid=2755): Launched 00:29:26.960767 run osmo-stp_10.42.42.5: Starting osmo-stp 00:29:27.489389 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2757): Launched 00:29:27.810057 run osmo-stp_10.42.42.5(pid=2758): Launched 00:29:27.933334 run osmo-msc_10.42.42.6: Starting osmo-msc 00:29:28.485516 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2760): Launched 00:29:28.806881 run osmo-msc_10.42.42.6(pid=2761): Launched 00:29:28.985361 run osmo-stp_10.42.42.5(pid=2758): ERR: Terminated: ERROR {rc=1} [trial-2366↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2758)] 00:29:29.120499 run osmo-stp_10.42.42.5(pid=2758): stdout: | (launched: 2022-12-10_00:29:27.751870) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:29:29.256934 run osmo-stp_10.42.42.5(pid=2758): stderr: | 20221210002927944 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002927944 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002927944 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002927945 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002927945 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002927945 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002927945 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:29:29.391440 run osmo-stp_10.42.42.5(pid=2758): stdout: | (launched: 2022-12-10_00:29:27.751870) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:29:29.519451 run osmo-stp_10.42.42.5(pid=2758): stderr: | 20221210002927944 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002927944 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002927944 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002927945 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002927945 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002927945 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002927945 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:29:29.672341 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2758): Process ended prematurely: osmo-stp_10.42.42.5(pid=2758) [trial-2366↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2758)] [trial-2366↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18] 00:29:29.681519 tst handover.py:18: Test FAILED (6.6 sec) 00:29:29.709205 run osmo-hlr_10.42.42.2(pid=2755): ERR: Terminated: ERROR {rc=237} [trial-2366↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2755)] 00:29:29.759274 run osmo-hlr_10.42.42.2(pid=2755): stdout: | (launched: 2022-12-10_00:29:26.779790) 00:29:29.811105 run osmo-hlr_10.42.42.2(pid=2755): stderr: | 20221210002926977 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210002926977 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210002926977 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210002926977 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210002926977 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210002926978 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210002926996 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/handover_2G:nanobts+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210002927006 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210002927006 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210002927006 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:29:29.883015 run osmo-msc_10.42.42.6(pid=2761): ERR: Terminated: ERROR {rc=2} [trial-2366↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2761)] 00:29:29.933025 run osmo-msc_10.42.42.6(pid=2761): stdout: | (launched: 2022-12-10_00:29:28.748446) 00:29:29.984556 run osmo-msc_10.42.42.6(pid=2761): stderr: | 20221210002929071 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210002929071 DLGLOBAL DEBUG validating counter group 0x7f1cb2b9cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210002929071 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210002929071 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210002929072 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210002929072 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210002929073 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210002929074 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210002929074 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210002929074 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:29:30.036623 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2754): Terminating (SIGTERM) 00:29:30.078593 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2757): Terminating (SIGTERM) 00:29:30.120730 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2760): Terminating (SIGTERM) 00:29:30.163333 --- ParallelTerminationStrategy: PID 2754 died... 00:29:30.183209 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2754): Terminated: ok {rc=0} 00:29:30.229924 --- ParallelTerminationStrategy: PID 2757 died... 00:29:30.249472 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2757): Terminated: ok {rc=0} 00:29:30.296016 --- ParallelTerminationStrategy: PID 2760 died... 00:29:30.315491 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2760): Terminated: ok {rc=0} 00:29:30.402293 bus /sierra_3: Setting Powered False 00:29:31.504827 bus /sierra_3: Setting Powered False 00:29:32.627314 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 handover_2G:nanobts+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 handover_2G:nanobts+bts1-sysmo --------------------------------------------------------------------- 00:29:33.892364 tst handover_2G:nanobts+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:29:33.898068 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x bts (candidates: 11) 00:29:33.941285 tst handover_2G:nanobts+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 00:29:33.968804 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x modem (candidates: 12) 00:29:34.022374 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x bts (candidates: 11) 00:29:34.066217 tst handover_2G:nanobts+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 00:29:34.093751 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x modem (candidates: 12) 00:29:34.643447 tst handover_2G:nanobts+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 handover_2G:nanobts+bts1-sysmo handover.py ---------------------------------------------- 00:29:34.648775 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:29:34.660085 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 00:29:34.698719 tst handover.py: using LAC 24729 00:29:34.830700 tst handover.py: using RAC 249 00:29:34.958740 tst handover.py: using CellId 24729 00:29:35.083909 tst handover.py: using BVCI 24730 00:29:35.202955 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 00:29:35.237773 tst handover.py: using LAC 24730 00:29:35.364647 tst handover.py: using RAC 250 00:29:35.491665 tst handover.py: using CellId 24730 00:29:35.609485 tst handover.py: using BVCI 24731 00:29:35.718709 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:29:35.729807 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:29:35.740786 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:29:35.751645 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:29:35.762616 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:29:35.773545 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 00:29:35.891577 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 00:29:36.007704 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:29:36.447460 run create_hlr_db(pid=2767): Launched 00:29:36.569812 bus /sierra_2: Setting Powered False 00:29:37.629490 run create_hlr_db(pid=2767): Terminated: ok {rc=0} 00:29:38.022485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2769): Launched 00:29:38.321239 run osmo-hlr_10.42.42.2(pid=2770): Launched 00:29:38.435774 run osmo-stp_10.42.42.5: Starting osmo-stp 00:29:38.944481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2772): Launched 00:29:39.244843 run osmo-stp_10.42.42.5(pid=2773): Launched 00:29:39.359849 run osmo-msc_10.42.42.6: Starting osmo-msc 00:29:39.881707 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2775): Launched 00:29:40.183693 run osmo-msc_10.42.42.6(pid=2776): Launched 00:29:40.351915 run osmo-stp_10.42.42.5(pid=2773): ERR: Terminated: ERROR {rc=1} [trial-2366↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2773)] 00:29:40.478966 run osmo-stp_10.42.42.5(pid=2773): stdout: | (launched: 2022-12-10_00:29:39.189850) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:29:40.605943 run osmo-stp_10.42.42.5(pid=2773): stderr: | 20221210002939361 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002939361 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002939361 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002939362 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002939362 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002939362 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002939362 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:29:40.730662 run osmo-stp_10.42.42.5(pid=2773): stdout: | (launched: 2022-12-10_00:29:39.189850) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:29:40.850095 run osmo-stp_10.42.42.5(pid=2773): stderr: | 20221210002939361 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002939361 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002939361 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002939362 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002939362 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002939362 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002939362 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:29:40.994038 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2773): Process ended prematurely: osmo-stp_10.42.42.5(pid=2773) [trial-2366↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2773)] [trial-2366↪handover_2G:nanobts+bts1-sysmo↪handover.py:18] 00:29:41.002327 tst handover.py:18: Test FAILED (6.3 sec) 00:29:41.028050 run osmo-hlr_10.42.42.2(pid=2770): ERR: Terminated: ERROR {rc=237} [trial-2366↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2770)] 00:29:41.075405 run osmo-hlr_10.42.42.2(pid=2770): stdout: | (launched: 2022-12-10_00:29:38.266465) 00:29:41.124911 run osmo-hlr_10.42.42.2(pid=2770): stderr: | 20221210002938443 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210002938443 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210002938443 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210002938443 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210002938443 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210002938443 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210002938454 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/handover_2G:nanobts+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210002938463 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210002938463 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210002938463 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:29:41.193601 run osmo-msc_10.42.42.6(pid=2776): ERR: Terminated: ERROR {rc=2} [trial-2366↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2776)] 00:29:41.241155 run osmo-msc_10.42.42.6(pid=2776): stdout: | (launched: 2022-12-10_00:29:40.128324) 00:29:41.289893 run osmo-msc_10.42.42.6(pid=2776): stderr: | 20221210002940398 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210002940398 DLGLOBAL DEBUG validating counter group 0x7fb4844f5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210002940399 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210002940399 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210002940399 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210002940399 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210002940401 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210002940401 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210002940401 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210002940401 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:29:41.339176 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2769): Terminating (SIGTERM) 00:29:41.378595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2772): Terminating (SIGTERM) 00:29:41.417982 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2775): Terminating (SIGTERM) 00:29:41.457628 --- ParallelTerminationStrategy: PID 2769 died... 00:29:41.476654 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2769): Terminated: ok {rc=0} 00:29:41.520537 --- ParallelTerminationStrategy: PID 2772 died... 00:29:41.539186 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2772): Terminated: ok {rc=0} 00:29:41.582615 --- ParallelTerminationStrategy: PID 2775 died... 00:29:41.601133 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2775): Terminated: ok {rc=0} 00:29:41.686863 bus /sierra_3: Setting Powered False 00:29:42.786373 bus /sierra_3: Setting Powered False 00:29:43.900812 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 handover_2G:nanobts+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 handover_2G:nanobts+bts1-trx-b200 --------------------------------------------------------------------- 00:29:45.149629 tst handover_2G:nanobts+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:29:45.155308 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 00:29:45.208218 tst handover_2G:nanobts+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 00:29:45.234374 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 00:29:45.286824 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 00:29:45.339552 tst handover_2G:nanobts+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 00:29:45.365680 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 00:29:45.939629 tst handover_2G:nanobts+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 handover_2G:nanobts+bts1-trx-b200 handover.py ---------------------------------------------- 00:29:45.946587 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:29:45.970196 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 00:29:46.027647 tst handover.py: using LAC 24731 00:29:46.148076 tst handover.py: using RAC 251 00:29:46.319305 tst handover.py: using CellId 24731 00:29:46.484239 tst handover.py: using BVCI 24732 00:29:46.597742 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 00:29:46.646666 tst handover.py: using LAC 24732 00:29:46.780591 tst handover.py: using RAC 252 00:29:46.924789 tst handover.py: using CellId 24732 00:29:47.085694 tst handover.py: using BVCI 24733 00:29:47.235077 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:29:47.250063 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:29:47.265280 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:29:47.278100 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:29:47.289663 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:29:47.301496 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 00:29:47.428912 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 00:29:47.548868 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:29:48.019303 run create_hlr_db(pid=2782): Launched 00:29:48.141356 bus /sierra_2: Setting Powered False 00:29:49.205184 run create_hlr_db(pid=2782): Terminated: ok {rc=0} 00:29:49.609845 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2784): Launched 00:29:49.913242 run osmo-hlr_10.42.42.2(pid=2785): Launched 00:29:50.028767 run osmo-stp_10.42.42.5: Starting osmo-stp 00:29:50.521094 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2787): Launched 00:29:50.821268 run osmo-stp_10.42.42.5(pid=2788): Launched 00:29:50.935939 run osmo-msc_10.42.42.6: Starting osmo-msc 00:29:51.456393 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2790): Launched 00:29:51.757081 run osmo-msc_10.42.42.6(pid=2791): Launched 00:29:51.925520 run osmo-stp_10.42.42.5(pid=2788): ERR: Terminated: ERROR {rc=1} [trial-2366↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2788)] 00:29:52.052347 run osmo-stp_10.42.42.5(pid=2788): stdout: | (launched: 2022-12-10_00:29:50.766103) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:29:52.180470 run osmo-stp_10.42.42.5(pid=2788): stderr: | 20221210002950936 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002950937 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002950937 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002950937 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002950938 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002950938 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002950938 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:29:52.304745 run osmo-stp_10.42.42.5(pid=2788): stdout: | (launched: 2022-12-10_00:29:50.766103) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:29:52.423677 run osmo-stp_10.42.42.5(pid=2788): stderr: | 20221210002950936 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210002950937 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210002950937 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210002950937 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210002950938 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210002950938 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210002950938 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:29:52.566497 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2788): Process ended prematurely: osmo-stp_10.42.42.5(pid=2788) [trial-2366↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2788)] [trial-2366↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18] 00:29:52.574563 tst handover.py:18: Test FAILED (6.6 sec) 00:29:52.600200 run osmo-hlr_10.42.42.2(pid=2785): ERR: Terminated: ERROR {rc=237} [trial-2366↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2785)] 00:29:52.647233 run osmo-hlr_10.42.42.2(pid=2785): stdout: | (launched: 2022-12-10_00:29:49.858341) 00:29:52.695837 run osmo-hlr_10.42.42.2(pid=2785): stderr: | 20221210002950035 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210002950035 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210002950035 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210002950035 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210002950035 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210002950035 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210002950047 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/handover_2G:nanobts+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210002950058 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210002950058 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210002950058 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:29:52.763986 run osmo-msc_10.42.42.6(pid=2791): ERR: Terminated: ERROR {rc=2} [trial-2366↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2791)] 00:29:52.811028 run osmo-msc_10.42.42.6(pid=2791): stdout: | (launched: 2022-12-10_00:29:51.701872) 00:29:52.859617 run osmo-msc_10.42.42.6(pid=2791): stderr: | 20221210002951973 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210002951973 DLGLOBAL DEBUG validating counter group 0x7fe917367c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210002951973 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210002951973 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210002951973 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210002951974 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210002951976 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210002951977 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210002951977 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210002951977 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:29:52.908413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2784): Terminating (SIGTERM) 00:29:52.947404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2787): Terminating (SIGTERM) 00:29:52.986219 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2790): Terminating (SIGTERM) 00:29:53.026221 --- ParallelTerminationStrategy: PID 2784 died... 00:29:53.044868 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2784): Terminated: ok {rc=0} 00:29:53.088377 --- ParallelTerminationStrategy: PID 2787 died... 00:29:53.106780 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2787): Terminated: ok {rc=0} 00:29:53.149952 --- ParallelTerminationStrategy: PID 2790 died... 00:29:53.168246 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2790): Terminated: ok {rc=0} 00:29:53.252378 bus /sierra_3: Setting Powered False 00:29:54.351158 bus /sierra_3: Setting Powered False 00:29:55.465499 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 handover_2G:nanobts+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 handover_2G:nanobts+bts1-trx-umtrx --------------------------------------------------------------------- 00:29:56.726735 tst handover_2G:nanobts+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:29:56.732267 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 00:29:56.786477 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 00:29:56.814101 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 00:29:56.871439 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 00:29:56.927267 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 00:29:56.954802 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 00:29:57.499576 tst handover_2G:nanobts+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 handover_2G:nanobts+bts1-trx-umtrx handover.py ---------------------------------------------- 00:29:57.504890 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:29:57.516508 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 00:29:57.554871 tst handover.py: using LAC 24733 00:29:57.681394 tst handover.py: using RAC 253 00:29:57.805247 tst handover.py: using CellId 24733 00:29:57.934887 tst handover.py: using BVCI 24734 00:29:58.053362 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 00:29:58.101298 tst handover.py: using LAC 24734 00:29:58.225316 tst handover.py: using RAC 254 00:29:58.349104 tst handover.py: using CellId 24734 00:29:58.474090 tst handover.py: using BVCI 24735 00:29:58.584056 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:29:58.595075 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:29:58.605963 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:29:58.617027 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:29:58.628103 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:29:58.639089 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 00:29:58.757025 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 00:29:58.874114 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:29:59.345188 run create_hlr_db(pid=2797): Launched 00:29:59.468053 bus /sierra_2: Setting Powered False 00:30:00.532038 run create_hlr_db(pid=2797): Terminated: ok {rc=0} 00:30:00.967632 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2799): Launched 00:30:01.294925 run osmo-hlr_10.42.42.2(pid=2800): Launched 00:30:01.548803 run osmo-stp_10.42.42.5: Starting osmo-stp 00:30:02.113855 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2805): Launched 00:30:02.420032 run osmo-stp_10.42.42.5(pid=2806): Launched 00:30:02.534714 run osmo-msc_10.42.42.6: Starting osmo-msc 00:30:03.051488 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2808): Launched 00:30:03.352410 run osmo-msc_10.42.42.6(pid=2809): Launched 00:30:03.520786 run osmo-stp_10.42.42.5(pid=2806): ERR: Terminated: ERROR {rc=1} [trial-2366↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2806)] 00:30:03.648526 run osmo-stp_10.42.42.5(pid=2806): stdout: | (launched: 2022-12-10_00:30:02.364911) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:30:03.776013 run osmo-stp_10.42.42.5(pid=2806): stderr: | 20221210003002536 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210003002536 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210003002537 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210003002537 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210003002537 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210003002538 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210003002538 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:30:03.901280 run osmo-stp_10.42.42.5(pid=2806): stdout: | (launched: 2022-12-10_00:30:02.364911) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:30:04.020858 run osmo-stp_10.42.42.5(pid=2806): stderr: | 20221210003002536 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210003002536 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210003002537 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210003002537 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210003002537 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210003002538 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210003002538 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:30:04.164383 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2806): Process ended prematurely: osmo-stp_10.42.42.5(pid=2806) [trial-2366↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2806)] [trial-2366↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18] 00:30:04.172586 tst handover.py:18: Test FAILED (6.7 sec) 00:30:04.198565 run osmo-hlr_10.42.42.2(pid=2800): ERR: Terminated: ERROR {rc=237} [trial-2366↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2800)] 00:30:04.245746 run osmo-hlr_10.42.42.2(pid=2800): stdout: | (launched: 2022-12-10_00:30:01.232189) 00:30:04.294800 run osmo-hlr_10.42.42.2(pid=2800): stderr: | 20221210003001426 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210003001426 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210003001426 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210003001426 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210003001426 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210003001426 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210003001439 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/handover_2G:nanobts+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210003001454 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210003001455 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210003001455 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:30:04.362962 run osmo-msc_10.42.42.6(pid=2809): ERR: Terminated: ERROR {rc=2} [trial-2366↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2809)] 00:30:04.410200 run osmo-msc_10.42.42.6(pid=2809): stdout: | (launched: 2022-12-10_00:30:03.297408) 00:30:04.458961 run osmo-msc_10.42.42.6(pid=2809): stderr: | 20221210003003567 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210003003567 DLGLOBAL DEBUG validating counter group 0x7fc3aa207c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210003003567 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210003003567 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210003003567 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210003003568 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210003003569 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210003003570 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210003003570 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210003003570 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:30:04.508164 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2799): Terminating (SIGTERM) 00:30:04.547156 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2805): Terminating (SIGTERM) 00:30:04.586179 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2808): Terminating (SIGTERM) 00:30:04.625416 --- ParallelTerminationStrategy: PID 2799 died... 00:30:04.644162 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2799): Terminated: ok {rc=0} 00:30:04.688161 --- ParallelTerminationStrategy: PID 2805 died... 00:30:04.706723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2805): Terminated: ok {rc=0} 00:30:04.750120 --- ParallelTerminationStrategy: PID 2808 died... 00:30:04.769005 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2808): Terminated: ok {rc=0} 00:30:04.852191 bus /sierra_3: Setting Powered False 00:30:05.951122 bus /sierra_3: Setting Powered False 00:30:07.069402 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 handover_2G:nanobts+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 handover_2G:oc2g+bts1-octphy --------------------------------------------------------------------- 00:30:08.324819 tst handover_2G:oc2g+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:30:08.329886 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x bts (candidates: 11) 00:30:08.366080 tst handover_2G:oc2g+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 00:30:08.392321 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x modem (candidates: 12) 00:30:08.448677 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x bts (candidates: 11) 00:30:08.485172 tst handover_2G:oc2g+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 00:30:08.511824 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x modem (candidates: 12) 00:30:09.056692 tst handover_2G:oc2g+bts1-octphy: RESERVED RESOURCES for handover_2G: bts OC-2G OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 handover_2G:oc2g+bts1-octphy handover.py ---------------------------------------------- 00:30:09.061732 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 00:30:09.072303 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 00:30:09.106397 tst handover.py: using LAC 24735 00:30:09.226982 tst handover.py: using RAC 255 00:30:09.345314 tst handover.py: using CellId 24735 00:30:09.464290 tst handover.py: using BVCI 24736 00:30:09.583797 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 00:30:09.617528 tst handover.py: using LAC 24736 00:30:09.734957 tst handover.py: using RAC 1 00:30:09.862421 tst handover.py: using CellId 24736 00:30:09.987574 tst handover.py: using BVCI 24737 00:30:10.097582 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 00:30:10.108497 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 00:30:10.119239 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 00:30:10.129817 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 00:30:10.140368 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 00:30:10.150989 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 00:30:10.268808 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 00:30:10.386607 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:30:10.829020 run create_hlr_db(pid=2814): Launched 00:30:10.951287 bus /sierra_2: Setting Powered False 00:30:12.011635 run create_hlr_db(pid=2814): Terminated: ok {rc=0} 00:30:12.422787 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2816): Launched 00:30:12.745976 run osmo-hlr_10.42.42.2(pid=2817): Launched 00:30:12.869956 run osmo-stp_10.42.42.5: Starting osmo-stp 00:30:13.401280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2819): Launched 00:30:13.721584 run osmo-stp_10.42.42.5(pid=2820): Launched 00:30:13.845592 run osmo-msc_10.42.42.6: Starting osmo-msc 00:30:14.401409 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2822): Launched 00:30:14.724076 run osmo-msc_10.42.42.6(pid=2823): Launched 00:30:14.903182 run osmo-stp_10.42.42.5(pid=2820): ERR: Terminated: ERROR {rc=1} [trial-2366↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2820)] 00:30:15.038906 run osmo-stp_10.42.42.5(pid=2820): stdout: | (launched: 2022-12-10_00:30:13.663323) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:30:15.174872 run osmo-stp_10.42.42.5(pid=2820): stderr: | 20221210003013855 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210003013855 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210003013855 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210003013856 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210003013858 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210003013858 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210003013858 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:30:15.310436 run osmo-stp_10.42.42.5(pid=2820): stdout: | (launched: 2022-12-10_00:30:13.663323) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:30:15.438961 run osmo-stp_10.42.42.5(pid=2820): stderr: | 20221210003013855 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210003013855 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210003013855 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210003013856 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210003013858 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210003013858 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210003013858 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:30:15.592797 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2820): Process ended prematurely: osmo-stp_10.42.42.5(pid=2820) [trial-2366↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2820)] [trial-2366↪handover_2G:oc2g+bts1-octphy↪handover.py:18] 00:30:15.601673 tst handover.py:18: Test FAILED (6.5 sec) 00:30:15.630059 run osmo-hlr_10.42.42.2(pid=2817): ERR: Terminated: ERROR {rc=237} [trial-2366↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2817)] 00:30:15.680276 run osmo-hlr_10.42.42.2(pid=2817): stdout: | (launched: 2022-12-10_00:30:12.687489) 00:30:15.732327 run osmo-hlr_10.42.42.2(pid=2817): stderr: | 20221210003012884 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210003012884 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210003012884 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210003012884 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210003012884 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210003012884 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210003012897 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/handover_2G:oc2g+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210003012905 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210003012906 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210003012906 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:30:15.804653 run osmo-msc_10.42.42.6(pid=2823): ERR: Terminated: ERROR {rc=2} [trial-2366↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2823)] 00:30:15.874478 run osmo-msc_10.42.42.6(pid=2823): stdout: | (launched: 2022-12-10_00:30:14.665460) 00:30:15.937160 run osmo-msc_10.42.42.6(pid=2823): stderr: | 20221210003014990 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210003014990 DLGLOBAL DEBUG validating counter group 0x7f1e54713c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210003014990 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210003014990 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210003014990 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210003014990 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210003014992 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210003014992 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210003014992 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210003014992 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:30:15.990491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2816): Terminating (SIGTERM) 00:30:16.033449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2819): Terminating (SIGTERM) 00:30:16.076316 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2822): Terminating (SIGTERM) 00:30:16.119442 --- ParallelTerminationStrategy: PID 2816 died... 00:30:16.139553 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2816): Terminated: ok {rc=0} 00:30:16.187385 --- ParallelTerminationStrategy: PID 2819 died... 00:30:16.207481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2819): Terminated: ok {rc=0} 00:30:16.255120 --- ParallelTerminationStrategy: PID 2822 died... 00:30:16.275264 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2822): Terminated: ok {rc=0} 00:30:16.366071 bus /sierra_3: Setting Powered False 00:30:17.465478 bus /sierra_3: Setting Powered False 00:30:18.580343 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 handover_2G:oc2g+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 handover_2G:oc2g+bts1-trx-lms --------------------------------------------------------------------- 00:30:19.819976 tst handover_2G:oc2g+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:30:19.825554 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 00:30:19.877875 tst handover_2G:oc2g+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 00:30:19.905216 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 00:30:19.958857 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 00:30:20.010452 tst handover_2G:oc2g+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 00:30:20.037973 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 00:30:20.587814 tst handover_2G:oc2g+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OC-2G LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 handover_2G:oc2g+bts1-trx-lms handover.py ---------------------------------------------- 00:30:20.593267 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 00:30:20.604591 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 00:30:20.639872 tst handover.py: using LAC 24737 00:30:20.766561 tst handover.py: using RAC 2 00:30:20.892645 tst handover.py: using CellId 24737 00:30:21.018678 tst handover.py: using BVCI 24738 00:30:21.137703 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 00:30:21.187158 tst handover.py: using LAC 24738 00:30:21.315217 tst handover.py: using RAC 3 00:30:21.441254 tst handover.py: using CellId 24738 00:30:21.565998 tst handover.py: using BVCI 24739 00:30:21.683232 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 00:30:21.694421 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 00:30:21.705377 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 00:30:21.716651 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 00:30:21.728015 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 00:30:21.739259 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 00:30:21.857874 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 00:30:22.007313 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:30:22.479559 run create_hlr_db(pid=2828): Launched 00:30:22.602462 bus /sierra_2: Setting Powered False 00:30:23.666273 run create_hlr_db(pid=2828): Terminated: ok {rc=0} 00:30:24.086040 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2830): Launched 00:30:24.407377 run osmo-hlr_10.42.42.2(pid=2831): Launched 00:30:24.531331 run osmo-stp_10.42.42.5: Starting osmo-stp 00:30:25.024782 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2833): Launched 00:30:25.326592 run osmo-stp_10.42.42.5(pid=2834): Launched 00:30:25.441742 run osmo-msc_10.42.42.6: Starting osmo-msc 00:30:25.958534 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2836): Launched 00:30:26.259224 run osmo-msc_10.42.42.6(pid=2837): Launched 00:30:26.428010 run osmo-stp_10.42.42.5(pid=2834): ERR: Terminated: ERROR {rc=1} [trial-2366↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2834)] 00:30:26.554920 run osmo-stp_10.42.42.5(pid=2834): stdout: | (launched: 2022-12-10_00:30:25.271065) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:30:26.681920 run osmo-stp_10.42.42.5(pid=2834): stderr: | 20221210003025441 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210003025441 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210003025442 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210003025442 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210003025442 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210003025443 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210003025443 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:30:26.806509 run osmo-stp_10.42.42.5(pid=2834): stdout: | (launched: 2022-12-10_00:30:25.271065) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:30:26.926455 run osmo-stp_10.42.42.5(pid=2834): stderr: | 20221210003025441 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210003025441 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210003025442 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210003025442 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210003025442 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210003025443 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210003025443 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:30:27.069911 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2834): Process ended prematurely: osmo-stp_10.42.42.5(pid=2834) [trial-2366↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2834)] [trial-2366↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18] 00:30:27.078113 tst handover.py:18: Test FAILED (6.5 sec) 00:30:27.103844 run osmo-hlr_10.42.42.2(pid=2831): ERR: Terminated: ERROR {rc=237} [trial-2366↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2831)] 00:30:27.150817 run osmo-hlr_10.42.42.2(pid=2831): stdout: | (launched: 2022-12-10_00:30:24.349420) 00:30:27.199513 run osmo-hlr_10.42.42.2(pid=2831): stderr: | 20221210003024545 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210003024545 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210003024545 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210003024545 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210003024545 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210003024545 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210003024558 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/handover_2G:oc2g+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210003024566 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210003024566 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210003024566 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:30:27.267475 run osmo-msc_10.42.42.6(pid=2837): ERR: Terminated: ERROR {rc=2} [trial-2366↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2837)] 00:30:27.314858 run osmo-msc_10.42.42.6(pid=2837): stdout: | (launched: 2022-12-10_00:30:26.203822) 00:30:27.363182 run osmo-msc_10.42.42.6(pid=2837): stderr: | 20221210003026473 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210003026473 DLGLOBAL DEBUG validating counter group 0x7fe7321c7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210003026473 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210003026473 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210003026473 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210003026474 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210003026475 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210003026476 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210003026476 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210003026476 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:30:27.411897 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2830): Terminating (SIGTERM) 00:30:27.450639 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2833): Terminating (SIGTERM) 00:30:27.489484 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2836): Terminating (SIGTERM) 00:30:27.529349 --- ParallelTerminationStrategy: PID 2830 died... 00:30:27.548051 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2830): Terminated: ok {rc=0} 00:30:27.591422 --- ParallelTerminationStrategy: PID 2833 died... 00:30:27.609940 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2833): Terminated: ok {rc=0} 00:30:27.653233 --- ParallelTerminationStrategy: PID 2836 died... 00:30:27.671719 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2836): Terminated: ok {rc=0} 00:30:27.757103 bus /sierra_3: Setting Powered False 00:30:28.855014 bus /sierra_3: Setting Powered False 00:30:29.969483 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 handover_2G:oc2g+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 handover_2G:oc2g+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 00:30:31.231009 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:30:31.239624 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 00:30:31.300312 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 00:30:31.330459 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 00:30:31.386798 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 00:30:31.443625 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 00:30:31.476846 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 00:30:32.012515 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OC-2G LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 handover_2G:oc2g+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 00:30:32.021039 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:30:32.034950 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 00:30:32.069435 tst handover.py: using LAC 24739 00:30:32.197273 tst handover.py: using RAC 4 00:30:32.326006 tst handover.py: using CellId 24739 00:30:32.451913 tst handover.py: using BVCI 24740 00:30:32.570394 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 00:30:32.614963 tst handover.py: using LAC 24740 00:30:32.741930 tst handover.py: using RAC 5 00:30:32.861112 tst handover.py: using CellId 24740 00:30:32.977888 tst handover.py: using BVCI 24741 00:30:33.086764 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:30:33.097951 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:30:33.108997 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:30:33.119717 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:30:33.130742 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:30:33.141415 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 00:30:33.258858 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 00:30:33.379422 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:30:33.851630 run create_hlr_db(pid=2842): Launched 00:30:33.974963 bus /sierra_2: Setting Powered False 00:30:35.041094 run create_hlr_db(pid=2842): Terminated: ok {rc=0} 00:30:35.461973 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2844): Launched 00:30:35.783672 run osmo-hlr_10.42.42.2(pid=2845): Launched 00:30:35.907767 run osmo-stp_10.42.42.5: Starting osmo-stp 00:30:36.437815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2847): Launched 00:30:36.759796 run osmo-stp_10.42.42.5(pid=2848): Launched 00:30:36.883017 run osmo-msc_10.42.42.6: Starting osmo-msc 00:30:37.437638 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2850): Launched 00:30:37.761355 run osmo-msc_10.42.42.6(pid=2851): Launched 00:30:37.943047 run osmo-stp_10.42.42.5(pid=2848): ERR: Terminated: ERROR {rc=1} [trial-2366↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2848)] 00:30:38.080315 run osmo-stp_10.42.42.5(pid=2848): stdout: | (launched: 2022-12-10_00:30:36.700721) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:30:38.218215 run osmo-stp_10.42.42.5(pid=2848): stderr: | 20221210003036891 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210003036891 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210003036891 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210003036891 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210003036892 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210003036892 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210003036892 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:30:38.355292 run osmo-stp_10.42.42.5(pid=2848): stdout: | (launched: 2022-12-10_00:30:36.700721) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:30:38.484349 run osmo-stp_10.42.42.5(pid=2848): stderr: | 20221210003036891 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210003036891 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210003036891 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210003036891 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210003036892 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210003036892 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210003036892 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:30:38.638641 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2848): Process ended prematurely: osmo-stp_10.42.42.5(pid=2848) [trial-2366↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2848)] [trial-2366↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18] 00:30:38.647827 tst handover.py:18: Test FAILED (6.6 sec) 00:30:38.676368 run osmo-hlr_10.42.42.2(pid=2845): ERR: Terminated: ERROR {rc=237} [trial-2366↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2845)] 00:30:38.726614 run osmo-hlr_10.42.42.2(pid=2845): stdout: | (launched: 2022-12-10_00:30:35.725403) 00:30:38.778515 run osmo-hlr_10.42.42.2(pid=2845): stderr: | 20221210003035925 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210003035925 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210003035925 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210003035925 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210003035925 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210003035925 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210003035951 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/handover_2G:oc2g+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210003035961 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210003035961 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210003035961 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:30:38.850833 run osmo-msc_10.42.42.6(pid=2851): ERR: Terminated: ERROR {rc=2} [trial-2366↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2851)] 00:30:38.901115 run osmo-msc_10.42.42.6(pid=2851): stdout: | (launched: 2022-12-10_00:30:37.702334) 00:30:38.952677 run osmo-msc_10.42.42.6(pid=2851): stderr: | 20221210003038022 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210003038023 DLGLOBAL DEBUG validating counter group 0x7f42dd7bec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210003038023 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210003038023 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210003038023 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210003038023 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210003038025 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210003038025 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210003038025 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210003038025 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:30:39.004869 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2844): Terminating (SIGTERM) 00:30:39.046832 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2847): Terminating (SIGTERM) 00:30:39.088785 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2850): Terminating (SIGTERM) 00:30:39.131396 --- ParallelTerminationStrategy: PID 2844 died... 00:30:39.151251 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2844): Terminated: ok {rc=0} 00:30:39.198580 --- ParallelTerminationStrategy: PID 2847 died... 00:30:39.218245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2847): Terminated: ok {rc=0} 00:30:39.265250 --- ParallelTerminationStrategy: PID 2850 died... 00:30:39.284912 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2850): Terminated: ok {rc=0} 00:30:39.374692 bus /sierra_3: Setting Powered False 00:30:40.473763 bus /sierra_3: Setting Powered False 00:30:41.591586 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 handover_2G:oc2g+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 handover_2G:oc2g+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 00:30:42.844661 tst handover_2G:oc2g+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:30:42.850107 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 00:30:42.900640 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 00:30:42.926970 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 00:30:42.978573 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 00:30:43.028376 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 00:30:43.054563 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 00:30:43.605899 tst handover_2G:oc2g+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 handover_2G:oc2g+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 00:30:43.610900 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:30:43.621868 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 00:30:43.657809 tst handover.py: using LAC 24741 00:30:43.790148 tst handover.py: using RAC 6 00:30:43.917772 tst handover.py: using CellId 24741 00:30:44.046289 tst handover.py: using BVCI 24742 00:30:44.164378 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 00:30:44.213746 tst handover.py: using LAC 24742 00:30:44.332726 tst handover.py: using RAC 7 00:30:44.452239 tst handover.py: using CellId 24742 00:30:44.571036 tst handover.py: using BVCI 24743 00:30:44.682382 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:30:44.693280 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:30:44.703870 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:30:44.714590 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:30:44.725342 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:30:44.735957 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 00:30:44.852021 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 00:30:44.974057 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:30:45.446288 run create_hlr_db(pid=2856): Launched 00:30:45.569822 bus /sierra_2: Setting Powered False 00:30:46.650834 run create_hlr_db(pid=2856): Terminated: ok {rc=0} 00:30:47.128595 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2858): Launched 00:30:47.454303 run osmo-hlr_10.42.42.2(pid=2859): Launched 00:30:47.579205 run osmo-stp_10.42.42.5: Starting osmo-stp 00:30:48.110263 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2861): Launched 00:30:48.432780 run osmo-stp_10.42.42.5(pid=2862): Launched 00:30:48.556628 run osmo-msc_10.42.42.6: Starting osmo-msc 00:30:49.110853 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2864): Launched 00:30:49.433343 run osmo-msc_10.42.42.6(pid=2865): Launched 00:30:49.613916 run osmo-stp_10.42.42.5(pid=2862): ERR: Terminated: ERROR {rc=1} [trial-2366↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2862)] 00:30:49.750586 run osmo-stp_10.42.42.5(pid=2862): stdout: | (launched: 2022-12-10_00:30:48.374376) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:30:49.887487 run osmo-stp_10.42.42.5(pid=2862): stderr: | 20221210003048565 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210003048566 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210003048566 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210003048566 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210003048567 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210003048567 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210003048567 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:30:50.023805 run osmo-stp_10.42.42.5(pid=2862): stdout: | (launched: 2022-12-10_00:30:48.374376) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:30:50.152861 run osmo-stp_10.42.42.5(pid=2862): stderr: | 20221210003048565 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210003048566 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210003048566 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210003048566 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210003048567 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210003048567 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210003048567 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:30:50.307748 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2862): Process ended prematurely: osmo-stp_10.42.42.5(pid=2862) [trial-2366↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2862)] [trial-2366↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18] 00:30:50.316905 tst handover.py:18: Test FAILED (6.7 sec) 00:30:50.345100 run osmo-hlr_10.42.42.2(pid=2859): ERR: Terminated: ERROR {rc=237} [trial-2366↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2859)] 00:30:50.394868 run osmo-hlr_10.42.42.2(pid=2859): stdout: | (launched: 2022-12-10_00:30:47.395748) 00:30:50.446418 run osmo-hlr_10.42.42.2(pid=2859): stderr: | 20221210003047594 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210003047594 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210003047594 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210003047594 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210003047594 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210003047594 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210003047606 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/handover_2G:oc2g+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210003047615 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210003047615 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210003047615 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:30:50.518290 run osmo-msc_10.42.42.6(pid=2865): ERR: Terminated: ERROR {rc=2} [trial-2366↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2865)] 00:30:50.568224 run osmo-msc_10.42.42.6(pid=2865): stdout: | (launched: 2022-12-10_00:30:49.374892) 00:30:50.619732 run osmo-msc_10.42.42.6(pid=2865): stderr: | 20221210003049697 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210003049697 DLGLOBAL DEBUG validating counter group 0x7f9df5d29c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210003049697 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210003049697 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210003049697 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210003049697 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210003049699 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210003049699 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210003049700 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210003049700 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:30:50.671522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2858): Terminating (SIGTERM) 00:30:50.712760 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2861): Terminating (SIGTERM) 00:30:50.754409 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2864): Terminating (SIGTERM) 00:30:50.796164 --- ParallelTerminationStrategy: PID 2858 died... 00:30:50.815842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2858): Terminated: ok {rc=0} 00:30:50.862524 --- ParallelTerminationStrategy: PID 2861 died... 00:30:50.881909 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2861): Terminated: ok {rc=0} 00:30:50.928003 --- ParallelTerminationStrategy: PID 2864 died... 00:30:50.947293 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2864): Terminated: ok {rc=0} 00:30:51.034533 bus /sierra_3: Setting Powered False 00:30:52.133447 bus /sierra_3: Setting Powered False 00:30:53.249143 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 handover_2G:oc2g+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 handover_2G:oc2g+bts1-sysmo --------------------------------------------------------------------- 00:30:54.507252 tst handover_2G:oc2g+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:30:54.512789 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x bts (candidates: 11) 00:30:54.552805 tst handover_2G:oc2g+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 00:30:54.580318 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x modem (candidates: 12) 00:30:54.634058 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x bts (candidates: 11) 00:30:54.674758 tst handover_2G:oc2g+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 00:30:54.702324 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x modem (candidates: 12) 00:30:55.251688 tst handover_2G:oc2g+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 handover_2G:oc2g+bts1-sysmo handover.py ---------------------------------------------- 00:30:55.257208 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:30:55.268288 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 00:30:55.302897 tst handover.py: using LAC 24743 00:30:55.430484 tst handover.py: using RAC 8 00:30:55.561509 tst handover.py: using CellId 24743 00:30:55.679885 tst handover.py: using BVCI 24744 00:30:55.789773 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 00:30:55.823000 tst handover.py: using LAC 24744 00:30:55.940456 tst handover.py: using RAC 9 00:30:56.058240 tst handover.py: using CellId 24744 00:30:56.177993 tst handover.py: using BVCI 24745 00:30:56.287594 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:30:56.298425 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:30:56.309206 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:30:56.319828 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:30:56.330629 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:30:56.341450 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 00:30:56.459230 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 00:30:56.577511 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:30:57.049145 run create_hlr_db(pid=2870): Launched 00:30:57.172001 bus /sierra_2: Setting Powered False 00:30:58.235510 run create_hlr_db(pid=2870): Terminated: ok {rc=0} 00:30:58.655578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2872): Launched 00:30:58.977231 run osmo-hlr_10.42.42.2(pid=2873): Launched 00:30:59.101372 run osmo-stp_10.42.42.5: Starting osmo-stp 00:30:59.630505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2875): Launched 00:30:59.951990 run osmo-stp_10.42.42.5(pid=2876): Launched 00:31:00.075439 run osmo-msc_10.42.42.6: Starting osmo-msc 00:31:00.628824 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2878): Launched 00:31:00.967833 run osmo-msc_10.42.42.6(pid=2879): Launched 00:31:01.226372 run osmo-stp_10.42.42.5(pid=2876): ERR: Terminated: ERROR {rc=1} [trial-2366↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2876)] 00:31:01.471723 run osmo-stp_10.42.42.5(pid=2876): stdout: | (launched: 2022-12-10_00:30:59.893719) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:31:01.825543 run osmo-stp_10.42.42.5(pid=2876): stderr: | 20221210003100085 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210003100085 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210003100085 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210003100086 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210003100086 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210003100086 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210003100086 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:31:02.018899 run osmo-stp_10.42.42.5(pid=2876): stdout: | (launched: 2022-12-10_00:30:59.893719) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:31:02.150802 run osmo-stp_10.42.42.5(pid=2876): stderr: | 20221210003100085 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210003100085 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210003100085 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210003100086 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210003100086 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210003100086 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210003100086 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:31:02.308820 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2876): Process ended prematurely: osmo-stp_10.42.42.5(pid=2876) [trial-2366↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2876)] [trial-2366↪handover_2G:oc2g+bts1-sysmo↪handover.py:18] 00:31:02.318764 tst handover.py:18: Test FAILED (7.1 sec) 00:31:02.349653 run osmo-hlr_10.42.42.2(pid=2873): ERR: Terminated: ERROR {rc=237} [trial-2366↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2873)] 00:31:02.401358 run osmo-hlr_10.42.42.2(pid=2873): stdout: | (launched: 2022-12-10_00:30:58.918766) 00:31:02.453149 run osmo-hlr_10.42.42.2(pid=2873): stderr: | 20221210003059116 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210003059116 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210003059116 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210003059116 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210003059116 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210003059116 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210003059128 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/handover_2G:oc2g+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210003059137 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210003059137 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210003059137 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:31:02.525071 run osmo-msc_10.42.42.6(pid=2879): ERR: Terminated: ERROR {rc=2} [trial-2366↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2879)] 00:31:02.575527 run osmo-msc_10.42.42.6(pid=2879): stdout: | (launched: 2022-12-10_00:31:00.905974) 00:31:02.627252 run osmo-msc_10.42.42.6(pid=2879): stderr: | 20221210003101457 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210003101457 DLGLOBAL DEBUG validating counter group 0x7fcd7fb41c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210003101457 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210003101457 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210003101457 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210003101457 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210003101459 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210003101459 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210003101460 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210003101460 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:31:02.679190 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2872): Terminating (SIGTERM) 00:31:02.720847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2875): Terminating (SIGTERM) 00:31:02.762507 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2878): Terminating (SIGTERM) 00:31:02.804429 --- ParallelTerminationStrategy: PID 2872 died... 00:31:02.824803 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2872): Terminated: ok {rc=0} 00:31:02.871516 --- ParallelTerminationStrategy: PID 2875 died... 00:31:02.890986 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2875): Terminated: ok {rc=0} 00:31:02.937551 --- ParallelTerminationStrategy: PID 2878 died... 00:31:02.957376 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2878): Terminated: ok {rc=0} 00:31:03.045861 bus /sierra_3: Setting Powered False 00:31:04.145388 bus /sierra_3: Setting Powered False 00:31:05.261146 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 handover_2G:oc2g+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 handover_2G:oc2g+bts1-trx-b200 --------------------------------------------------------------------- 00:31:06.500285 tst handover_2G:oc2g+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:31:06.506012 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 00:31:06.557700 tst handover_2G:oc2g+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 00:31:06.585616 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 00:31:06.638934 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 00:31:06.690908 tst handover_2G:oc2g+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 00:31:06.718660 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 00:31:07.272776 tst handover_2G:oc2g+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OC-2G Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 handover_2G:oc2g+bts1-trx-b200 handover.py ---------------------------------------------- 00:31:07.278476 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:31:07.289799 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 00:31:07.326251 tst handover.py: using LAC 24745 00:31:07.454843 tst handover.py: using RAC 10 00:31:07.584580 tst handover.py: using CellId 24745 00:31:07.711863 tst handover.py: using BVCI 24746 00:31:07.829369 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 00:31:07.879560 tst handover.py: using LAC 24746 00:31:08.008497 tst handover.py: using RAC 11 00:31:08.139532 tst handover.py: using CellId 24746 00:31:08.265692 tst handover.py: using BVCI 24747 00:31:08.383664 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:31:08.394972 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:31:08.406092 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:31:08.417344 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:31:08.428610 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:31:08.439862 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 00:31:08.555747 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 00:31:08.673256 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:31:09.143844 run create_hlr_db(pid=2885): Launched 00:31:09.266651 bus /sierra_2: Setting Powered False 00:31:10.330134 run create_hlr_db(pid=2885): Terminated: ok {rc=0} 00:31:10.749991 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2887): Launched 00:31:11.071171 run osmo-hlr_10.42.42.2(pid=2888): Launched 00:31:11.195095 run osmo-stp_10.42.42.5: Starting osmo-stp 00:31:11.724535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2890): Launched 00:31:12.045302 run osmo-stp_10.42.42.5(pid=2891): Launched 00:31:12.169189 run osmo-msc_10.42.42.6: Starting osmo-msc 00:31:12.723877 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2893): Launched 00:31:13.029797 run osmo-msc_10.42.42.6(pid=2894): Launched 00:31:13.198311 run osmo-stp_10.42.42.5(pid=2891): ERR: Terminated: ERROR {rc=1} [trial-2366↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2891)] 00:31:13.325698 run osmo-stp_10.42.42.5(pid=2891): stdout: | (launched: 2022-12-10_00:31:11.987194) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:31:13.452132 run osmo-stp_10.42.42.5(pid=2891): stderr: | 20221210003112179 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210003112179 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210003112179 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210003112180 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210003112182 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210003112182 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210003112182 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:31:13.577307 run osmo-stp_10.42.42.5(pid=2891): stdout: | (launched: 2022-12-10_00:31:11.987194) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:31:13.697873 run osmo-stp_10.42.42.5(pid=2891): stderr: | 20221210003112179 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210003112179 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210003112179 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210003112180 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210003112182 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210003112182 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210003112182 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:31:13.841259 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2891): Process ended prematurely: osmo-stp_10.42.42.5(pid=2891) [trial-2366↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2891)] [trial-2366↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18] 00:31:13.849683 tst handover.py:18: Test FAILED (6.6 sec) 00:31:13.875711 run osmo-hlr_10.42.42.2(pid=2888): ERR: Terminated: ERROR {rc=237} [trial-2366↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2888)] 00:31:13.923236 run osmo-hlr_10.42.42.2(pid=2888): stdout: | (launched: 2022-12-10_00:31:11.012782) 00:31:13.972198 run osmo-hlr_10.42.42.2(pid=2888): stderr: | 20221210003111211 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210003111211 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210003111211 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210003111211 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210003111211 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210003111211 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210003111223 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/handover_2G:oc2g+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210003111231 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210003111231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210003111231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:31:14.040537 run osmo-msc_10.42.42.6(pid=2894): ERR: Terminated: ERROR {rc=2} [trial-2366↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2894)] 00:31:14.087615 run osmo-msc_10.42.42.6(pid=2894): stdout: | (launched: 2022-12-10_00:31:12.974685) 00:31:14.135959 run osmo-msc_10.42.42.6(pid=2894): stderr: | 20221210003113245 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210003113245 DLGLOBAL DEBUG validating counter group 0x7f5f1fa5ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210003113245 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210003113245 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210003113245 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210003113246 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210003113247 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210003113248 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210003113248 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210003113248 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:31:14.185072 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2887): Terminating (SIGTERM) 00:31:14.223917 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2890): Terminating (SIGTERM) 00:31:14.263174 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2893): Terminating (SIGTERM) 00:31:14.302804 --- ParallelTerminationStrategy: PID 2887 died... 00:31:14.321681 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2887): Terminated: ok {rc=0} 00:31:14.365235 --- ParallelTerminationStrategy: PID 2890 died... 00:31:14.383656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2890): Terminated: ok {rc=0} 00:31:14.426958 --- ParallelTerminationStrategy: PID 2893 died... 00:31:14.445438 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2893): Terminated: ok {rc=0} 00:31:14.528383 bus /sierra_3: Setting Powered False 00:31:15.622568 bus /sierra_3: Setting Powered False 00:31:16.741365 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 handover_2G:oc2g+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 handover_2G:oc2g+bts1-trx-umtrx --------------------------------------------------------------------- 00:31:18.013359 tst handover_2G:oc2g+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:31:18.018958 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 00:31:18.069943 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 00:31:18.097882 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 00:31:18.151588 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 00:31:18.202794 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 00:31:18.230713 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 00:31:18.779841 tst handover_2G:oc2g+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OC-2G UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 handover_2G:oc2g+bts1-trx-umtrx handover.py ---------------------------------------------- 00:31:18.785239 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:31:18.796364 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 00:31:18.831796 tst handover.py: using LAC 24747 00:31:18.958277 tst handover.py: using RAC 12 00:31:19.091009 tst handover.py: using CellId 24747 00:31:19.215915 tst handover.py: using BVCI 24748 00:31:19.325280 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 00:31:19.371785 tst handover.py: using LAC 24748 00:31:19.489745 tst handover.py: using RAC 13 00:31:19.607259 tst handover.py: using CellId 24748 00:31:19.726392 tst handover.py: using BVCI 24749 00:31:19.835696 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:31:19.847011 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:31:19.858184 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:31:19.869105 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:31:19.880064 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:31:19.891019 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 00:31:20.010454 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 00:31:20.130099 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:31:20.602623 run create_hlr_db(pid=2899): Launched 00:31:20.726896 bus /sierra_2: Setting Powered False 00:31:21.791619 run create_hlr_db(pid=2899): Terminated: ok {rc=0} 00:31:22.196665 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2901): Launched 00:31:22.498841 run osmo-hlr_10.42.42.2(pid=2902): Launched 00:31:22.615109 run osmo-stp_10.42.42.5: Starting osmo-stp 00:31:23.105815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2904): Launched 00:31:23.405287 run osmo-stp_10.42.42.5(pid=2905): Launched 00:31:23.520408 run osmo-msc_10.42.42.6: Starting osmo-msc 00:31:24.039713 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2907): Launched 00:31:24.340491 run osmo-msc_10.42.42.6(pid=2908): Launched 00:31:24.509302 run osmo-stp_10.42.42.5(pid=2905): ERR: Terminated: ERROR {rc=1} [trial-2366↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2905)] 00:31:24.637333 run osmo-stp_10.42.42.5(pid=2905): stdout: | (launched: 2022-12-10_00:31:23.350426) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:31:24.764002 run osmo-stp_10.42.42.5(pid=2905): stderr: | 20221210003123521 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210003123521 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210003123521 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210003123522 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210003123522 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210003123522 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210003123522 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:31:24.889283 run osmo-stp_10.42.42.5(pid=2905): stdout: | (launched: 2022-12-10_00:31:23.350426) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:31:25.010609 run osmo-stp_10.42.42.5(pid=2905): stderr: | 20221210003123521 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210003123521 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210003123521 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210003123522 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210003123522 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210003123522 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210003123522 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:31:25.153901 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2905): Process ended prematurely: osmo-stp_10.42.42.5(pid=2905) [trial-2366↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2905)] [trial-2366↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18] 00:31:25.162316 tst handover.py:18: Test FAILED (6.4 sec) 00:31:25.188353 run osmo-hlr_10.42.42.2(pid=2902): ERR: Terminated: ERROR {rc=237} [trial-2366↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2902)] 00:31:25.236048 run osmo-hlr_10.42.42.2(pid=2902): stdout: | (launched: 2022-12-10_00:31:22.443740) 00:31:25.284920 run osmo-hlr_10.42.42.2(pid=2902): stderr: | 20221210003122618 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210003122618 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210003122618 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210003122618 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210003122618 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210003122618 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210003122634 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/handover_2G:oc2g+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210003122643 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210003122643 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210003122643 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:31:25.353024 run osmo-msc_10.42.42.6(pid=2908): ERR: Terminated: ERROR {rc=2} [trial-2366↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2908)] 00:31:25.400125 run osmo-msc_10.42.42.6(pid=2908): stdout: | (launched: 2022-12-10_00:31:24.285595) 00:31:25.448640 run osmo-msc_10.42.42.6(pid=2908): stderr: | 20221210003124555 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210003124555 DLGLOBAL DEBUG validating counter group 0x7f4277deac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210003124555 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210003124555 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210003124555 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210003124555 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210003124557 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210003124557 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210003124558 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210003124558 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:31:25.497600 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2901): Terminating (SIGTERM) 00:31:25.536841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2904): Terminating (SIGTERM) 00:31:25.576132 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2907): Terminating (SIGTERM) 00:31:25.615590 --- ParallelTerminationStrategy: PID 2901 died... 00:31:25.634397 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2901): Terminated: ok {rc=0} 00:31:25.678053 --- ParallelTerminationStrategy: PID 2904 died... 00:31:25.696407 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2904): Terminated: ok {rc=0} 00:31:25.740286 --- ParallelTerminationStrategy: PID 2907 died... 00:31:25.758884 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2907): Terminated: ok {rc=0} 00:31:25.840923 bus /sierra_3: Setting Powered False 00:31:26.938249 bus /sierra_3: Setting Powered False 00:31:28.053758 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 handover_2G:oc2g+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 handover_2G:octphy+bts1-trx-lms --------------------------------------------------------------------- 00:31:29.303395 tst handover_2G:octphy+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:31:29.308561 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 00:31:29.357146 tst handover_2G:octphy+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 00:31:29.383754 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 00:31:29.435100 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 00:31:29.482720 tst handover_2G:octphy+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 00:31:29.508746 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 00:31:30.060678 tst handover_2G:octphy+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 handover_2G:octphy+bts1-trx-lms handover.py ---------------------------------------------- 00:31:30.066027 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 00:31:30.076768 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 00:31:30.114694 tst handover.py: using LAC 24749 00:31:30.243443 tst handover.py: using RAC 14 00:31:30.369501 tst handover.py: using CellId 24749 00:31:30.496076 tst handover.py: using BVCI 24750 00:31:30.613948 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 00:31:30.661651 tst handover.py: using LAC 24750 00:31:30.789102 tst handover.py: using RAC 15 00:31:30.951380 tst handover.py: using CellId 24750 00:31:31.086132 tst handover.py: using BVCI 24751 00:31:31.206337 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 00:31:31.218619 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 00:31:31.230697 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 00:31:31.242842 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 00:31:31.254809 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 00:31:31.266939 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 00:31:31.389764 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 00:31:31.544317 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:31:32.083637 run create_hlr_db(pid=2913): Launched 00:31:32.235441 bus /sierra_2: Setting Powered False 00:31:33.295388 run create_hlr_db(pid=2913): Terminated: ok {rc=0} 00:31:33.689702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2915): Launched 00:31:33.991021 run osmo-hlr_10.42.42.2(pid=2916): Launched 00:31:34.106395 run osmo-stp_10.42.42.5: Starting osmo-stp 00:31:34.598114 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2918): Launched 00:31:34.898338 run osmo-stp_10.42.42.5(pid=2919): Launched 00:31:35.012526 run osmo-msc_10.42.42.6: Starting osmo-msc 00:31:35.534691 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2921): Launched 00:31:35.836678 run osmo-msc_10.42.42.6(pid=2922): Launched 00:31:36.005750 run osmo-stp_10.42.42.5(pid=2919): ERR: Terminated: ERROR {rc=1} [trial-2366↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2919)] 00:31:36.133576 run osmo-stp_10.42.42.5(pid=2919): stdout: | (launched: 2022-12-10_00:31:34.843230) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:31:36.260794 run osmo-stp_10.42.42.5(pid=2919): stderr: | 20221210003135012 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210003135012 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210003135013 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210003135013 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210003135015 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210003135016 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210003135016 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:31:36.386525 run osmo-stp_10.42.42.5(pid=2919): stdout: | (launched: 2022-12-10_00:31:34.843230) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:31:36.506709 run osmo-stp_10.42.42.5(pid=2919): stderr: | 20221210003135012 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210003135012 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210003135013 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210003135013 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210003135015 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210003135016 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210003135016 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:31:36.650444 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2919): Process ended prematurely: osmo-stp_10.42.42.5(pid=2919) [trial-2366↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2919)] [trial-2366↪handover_2G:octphy+bts1-trx-lms↪handover.py:18] 00:31:36.658815 tst handover.py:18: Test FAILED (6.6 sec) 00:31:36.684795 run osmo-hlr_10.42.42.2(pid=2916): ERR: Terminated: ERROR {rc=237} [trial-2366↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2916)] 00:31:36.731995 run osmo-hlr_10.42.42.2(pid=2916): stdout: | (launched: 2022-12-10_00:31:33.935956) 00:31:36.780932 run osmo-hlr_10.42.42.2(pid=2916): stderr: | 20221210003134111 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210003134111 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210003134111 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210003134111 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210003134111 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210003134112 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210003134124 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/handover_2G:octphy+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210003134134 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210003134134 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210003134134 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:31:36.849630 run osmo-msc_10.42.42.6(pid=2922): ERR: Terminated: ERROR {rc=2} [trial-2366↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2922)] 00:31:36.896578 run osmo-msc_10.42.42.6(pid=2922): stdout: | (launched: 2022-12-10_00:31:35.780800) 00:31:36.945140 run osmo-msc_10.42.42.6(pid=2922): stderr: | 20221210003136053 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210003136053 DLGLOBAL DEBUG validating counter group 0x7fe664e41c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210003136053 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210003136053 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210003136053 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210003136054 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210003136055 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210003136056 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210003136056 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210003136056 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:31:36.993911 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2915): Terminating (SIGTERM) 00:31:37.032881 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2918): Terminating (SIGTERM) 00:31:37.072142 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2921): Terminating (SIGTERM) 00:31:37.111685 --- ParallelTerminationStrategy: PID 2915 died... 00:31:37.130720 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2915): Terminated: ok {rc=0} 00:31:37.174244 --- ParallelTerminationStrategy: PID 2918 died... 00:31:37.192584 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2918): Terminated: ok {rc=0} 00:31:37.236114 --- ParallelTerminationStrategy: PID 2921 died... 00:31:37.254572 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2921): Terminated: ok {rc=0} 00:31:37.338952 bus /sierra_3: Setting Powered False 00:31:38.438317 bus /sierra_3: Setting Powered False 00:31:39.552362 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 handover_2G:octphy+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 handover_2G:octphy+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 00:31:40.803407 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:31:40.808453 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 00:31:40.853272 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 00:31:40.879974 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 00:31:40.930928 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 00:31:40.975254 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 00:31:41.001489 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 00:31:41.556331 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 handover_2G:octphy+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 00:31:41.562120 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:31:41.573364 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 00:31:41.607508 tst handover.py: using LAC 24751 00:31:41.729340 tst handover.py: using RAC 16 00:31:41.849815 tst handover.py: using CellId 24751 00:31:41.971692 tst handover.py: using BVCI 24752 00:31:42.082817 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 00:31:42.127229 tst handover.py: using LAC 24752 00:31:42.247840 tst handover.py: using RAC 17 00:31:42.366688 tst handover.py: using CellId 24752 00:31:42.493638 tst handover.py: using BVCI 24753 00:31:42.605975 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:31:42.617114 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:31:42.628028 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:31:42.639186 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:31:42.650265 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:31:42.661078 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 00:31:42.779227 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 00:31:42.896159 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:31:43.339845 run create_hlr_db(pid=2927): Launched 00:31:43.462820 bus /sierra_2: Setting Powered False 00:31:44.523529 run create_hlr_db(pid=2927): Terminated: ok {rc=0} 00:31:44.918892 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2929): Launched 00:31:45.221572 run osmo-hlr_10.42.42.2(pid=2930): Launched 00:31:45.336790 run osmo-stp_10.42.42.5: Starting osmo-stp 00:31:45.831323 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2932): Launched 00:31:46.173686 run osmo-stp_10.42.42.5(pid=2933): Launched 00:31:46.406558 run osmo-msc_10.42.42.6: Starting osmo-msc 00:31:47.066487 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2935): Launched 00:31:47.383388 run osmo-msc_10.42.42.6(pid=2936): Launched 00:31:47.553496 run osmo-stp_10.42.42.5(pid=2933): ERR: Terminated: ERROR {rc=1} [trial-2366↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2933)] 00:31:47.680941 run osmo-stp_10.42.42.5(pid=2933): stdout: | (launched: 2022-12-10_00:31:46.102801) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:31:47.808323 run osmo-stp_10.42.42.5(pid=2933): stderr: | 20221210003146420 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210003146420 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210003146420 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210003146421 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210003146421 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210003146421 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210003146421 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:31:47.934700 run osmo-stp_10.42.42.5(pid=2933): stdout: | (launched: 2022-12-10_00:31:46.102801) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:31:48.055446 run osmo-stp_10.42.42.5(pid=2933): stderr: | 20221210003146420 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210003146420 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210003146420 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210003146421 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210003146421 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210003146421 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210003146421 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:31:48.199632 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2933): Process ended prematurely: osmo-stp_10.42.42.5(pid=2933) [trial-2366↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2933)] [trial-2366↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18] 00:31:48.208069 tst handover.py:18: Test FAILED (6.6 sec) 00:31:48.234033 run osmo-hlr_10.42.42.2(pid=2930): ERR: Terminated: ERROR {rc=237} [trial-2366↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2930)] 00:31:48.281307 run osmo-hlr_10.42.42.2(pid=2930): stdout: | (launched: 2022-12-10_00:31:45.165996) 00:31:48.330113 run osmo-hlr_10.42.42.2(pid=2930): stderr: | 20221210003145345 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210003145345 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210003145345 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210003145345 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210003145345 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210003145345 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210003145357 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/handover_2G:octphy+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210003145367 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210003145367 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210003145368 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:31:48.398500 run osmo-msc_10.42.42.6(pid=2936): ERR: Terminated: ERROR {rc=2} [trial-2366↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2936)] 00:31:48.445815 run osmo-msc_10.42.42.6(pid=2936): stdout: | (launched: 2022-12-10_00:31:47.328368) 00:31:48.494454 run osmo-msc_10.42.42.6(pid=2936): stderr: | 20221210003147600 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210003147600 DLGLOBAL DEBUG validating counter group 0x7fd5f1f54c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210003147600 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210003147601 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210003147601 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210003147601 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210003147603 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210003147603 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210003147603 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210003147604 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:31:48.543240 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2929): Terminating (SIGTERM) 00:31:48.582306 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2932): Terminating (SIGTERM) 00:31:48.621636 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2935): Terminating (SIGTERM) 00:31:48.661209 --- ParallelTerminationStrategy: PID 2929 died... 00:31:48.679959 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2929): Terminated: ok {rc=0} 00:31:48.723649 --- ParallelTerminationStrategy: PID 2932 died... 00:31:48.742158 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2932): Terminated: ok {rc=0} 00:31:48.785418 --- ParallelTerminationStrategy: PID 2935 died... 00:31:48.803775 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2935): Terminated: ok {rc=0} 00:31:48.888754 bus /sierra_3: Setting Powered False 00:31:49.987966 bus /sierra_3: Setting Powered False 00:31:51.103051 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 handover_2G:octphy+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 handover_2G:octphy+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 00:31:52.353800 tst handover_2G:octphy+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:31:52.358935 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 00:31:52.407795 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 00:31:52.434168 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 00:31:52.485937 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 00:31:52.535011 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 00:31:52.561259 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 00:31:53.114461 tst handover_2G:octphy+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 handover_2G:octphy+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 00:31:53.119544 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:31:53.130537 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 00:31:53.162613 tst handover.py: using LAC 24753 00:31:53.291452 tst handover.py: using RAC 18 00:31:53.417910 tst handover.py: using CellId 24753 00:31:53.546624 tst handover.py: using BVCI 24754 00:31:53.666328 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 00:31:53.716259 tst handover.py: using LAC 24754 00:31:53.847775 tst handover.py: using RAC 19 00:31:53.974420 tst handover.py: using CellId 24754 00:31:54.099424 tst handover.py: using BVCI 24755 00:31:54.218583 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:31:54.230142 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:31:54.241807 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:31:54.253536 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:31:54.265076 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:31:54.276763 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 00:31:54.393234 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 00:31:54.509119 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:31:54.951130 run create_hlr_db(pid=2941): Launched 00:31:55.074762 bus /sierra_2: Setting Powered False 00:31:56.135294 run create_hlr_db(pid=2941): Terminated: ok {rc=0} 00:31:56.548076 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2943): Launched 00:31:56.870739 run osmo-hlr_10.42.42.2(pid=2944): Launched 00:31:56.993995 run osmo-stp_10.42.42.5: Starting osmo-stp 00:31:57.525877 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2946): Launched 00:31:57.847626 run osmo-stp_10.42.42.5(pid=2947): Launched 00:31:57.970856 run osmo-msc_10.42.42.6: Starting osmo-msc 00:31:58.525242 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2949): Launched 00:31:58.848253 run osmo-msc_10.42.42.6(pid=2950): Launched 00:31:59.028392 run osmo-stp_10.42.42.5(pid=2947): ERR: Terminated: ERROR {rc=1} [trial-2366↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2947)] 00:31:59.164552 run osmo-stp_10.42.42.5(pid=2947): stdout: | (launched: 2022-12-10_00:31:57.789059) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:31:59.301573 run osmo-stp_10.42.42.5(pid=2947): stderr: | 20221210003157981 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210003157982 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210003157982 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210003157982 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210003157983 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210003157983 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210003157983 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:31:59.437499 run osmo-stp_10.42.42.5(pid=2947): stdout: | (launched: 2022-12-10_00:31:57.789059) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:31:59.566526 run osmo-stp_10.42.42.5(pid=2947): stderr: | 20221210003157981 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210003157982 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210003157982 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210003157982 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210003157983 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210003157983 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210003157983 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:31:59.721128 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2947): Process ended prematurely: osmo-stp_10.42.42.5(pid=2947) [trial-2366↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2947)] [trial-2366↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18] 00:31:59.730229 tst handover.py:18: Test FAILED (6.6 sec) 00:31:59.758334 run osmo-hlr_10.42.42.2(pid=2944): ERR: Terminated: ERROR {rc=237} [trial-2366↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2944)] 00:31:59.808757 run osmo-hlr_10.42.42.2(pid=2944): stdout: | (launched: 2022-12-10_00:31:56.812259) 00:31:59.861186 run osmo-hlr_10.42.42.2(pid=2944): stderr: | 20221210003157011 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210003157011 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210003157011 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210003157011 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210003157011 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210003157011 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210003157023 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/handover_2G:octphy+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210003157031 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210003157032 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210003157032 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:31:59.933398 run osmo-msc_10.42.42.6(pid=2950): ERR: Terminated: ERROR {rc=2} [trial-2366↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2950)] 00:31:59.983757 run osmo-msc_10.42.42.6(pid=2950): stdout: | (launched: 2022-12-10_00:31:58.789274) 00:32:00.035937 run osmo-msc_10.42.42.6(pid=2950): stderr: | 20221210003159111 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210003159111 DLGLOBAL DEBUG validating counter group 0x7f2fd65e5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210003159111 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210003159111 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210003159111 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210003159111 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210003159113 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210003159114 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210003159114 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210003159114 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:32:00.088429 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2943): Terminating (SIGTERM) 00:32:00.130435 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2946): Terminating (SIGTERM) 00:32:00.172273 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2949): Terminating (SIGTERM) 00:32:00.214619 --- ParallelTerminationStrategy: PID 2943 died... 00:32:00.234991 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2943): Terminated: ok {rc=0} 00:32:00.282545 --- ParallelTerminationStrategy: PID 2946 died... 00:32:00.302327 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2946): Terminated: ok {rc=0} 00:32:00.349097 --- ParallelTerminationStrategy: PID 2949 died... 00:32:00.369155 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2949): Terminated: ok {rc=0} 00:32:00.458294 bus /sierra_3: Setting Powered False 00:32:01.566036 bus /sierra_3: Setting Powered False 00:32:02.692175 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 handover_2G:octphy+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 handover_2G:octphy+bts1-sysmo --------------------------------------------------------------------- 00:32:03.952234 tst handover_2G:octphy+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:32:03.957984 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x bts (candidates: 11) 00:32:03.996468 tst handover_2G:octphy+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 00:32:04.023963 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x modem (candidates: 12) 00:32:04.075982 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x bts (candidates: 11) 00:32:04.113765 tst handover_2G:octphy+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 00:32:04.141258 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x modem (candidates: 12) 00:32:04.693802 tst handover_2G:octphy+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 handover_2G:octphy+bts1-sysmo handover.py ---------------------------------------------- 00:32:04.699097 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:32:04.710315 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 00:32:04.743941 tst handover.py: using LAC 24755 00:32:04.873651 tst handover.py: using RAC 20 00:32:05.002194 tst handover.py: using CellId 24755 00:32:05.130772 tst handover.py: using BVCI 24756 00:32:05.250760 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 00:32:05.285498 tst handover.py: using LAC 24756 00:32:05.414065 tst handover.py: using RAC 21 00:32:05.542434 tst handover.py: using CellId 24756 00:32:05.671148 tst handover.py: using BVCI 24757 00:32:05.789325 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:32:05.800314 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:32:05.811348 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:32:05.822699 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:32:05.834013 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:32:05.845209 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 00:32:05.960553 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 00:32:06.075565 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:32:06.517725 run create_hlr_db(pid=2955): Launched 00:32:06.643304 bus /sierra_2: Setting Powered False 00:32:07.703825 run create_hlr_db(pid=2955): Terminated: ok {rc=0} 00:32:08.109670 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2957): Launched 00:32:08.411202 run osmo-hlr_10.42.42.2(pid=2958): Launched 00:32:08.526699 run osmo-stp_10.42.42.5: Starting osmo-stp 00:32:09.032034 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2960): Launched 00:32:09.332642 run osmo-stp_10.42.42.5(pid=2961): Launched 00:32:09.447195 run osmo-msc_10.42.42.6: Starting osmo-msc 00:32:09.969954 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2963): Launched 00:32:10.271105 run osmo-msc_10.42.42.6(pid=2964): Launched 00:32:10.439647 run osmo-stp_10.42.42.5(pid=2961): ERR: Terminated: ERROR {rc=1} [trial-2366↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2961)] 00:32:10.567023 run osmo-stp_10.42.42.5(pid=2961): stdout: | (launched: 2022-12-10_00:32:09.277642) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:32:10.693602 run osmo-stp_10.42.42.5(pid=2961): stderr: | 20221210003209447 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210003209447 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210003209447 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210003209448 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210003209448 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210003209448 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210003209448 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:32:10.818443 run osmo-stp_10.42.42.5(pid=2961): stdout: | (launched: 2022-12-10_00:32:09.277642) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:32:10.938286 run osmo-stp_10.42.42.5(pid=2961): stderr: | 20221210003209447 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210003209447 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210003209447 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210003209448 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210003209448 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210003209448 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210003209448 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:32:11.081801 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2961): Process ended prematurely: osmo-stp_10.42.42.5(pid=2961) [trial-2366↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2961)] [trial-2366↪handover_2G:octphy+bts1-sysmo↪handover.py:18] 00:32:11.090226 tst handover.py:18: Test FAILED (6.4 sec) 00:32:11.116053 run osmo-hlr_10.42.42.2(pid=2958): ERR: Terminated: ERROR {rc=237} [trial-2366↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2958)] 00:32:11.163227 run osmo-hlr_10.42.42.2(pid=2958): stdout: | (launched: 2022-12-10_00:32:08.356104) 00:32:11.211748 run osmo-hlr_10.42.42.2(pid=2958): stderr: | 20221210003208529 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210003208529 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210003208529 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210003208529 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210003208529 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210003208530 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210003208542 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/handover_2G:octphy+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210003208551 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210003208551 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210003208551 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:32:11.279773 run osmo-msc_10.42.42.6(pid=2964): ERR: Terminated: ERROR {rc=2} [trial-2366↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2964)] 00:32:11.326511 run osmo-msc_10.42.42.6(pid=2964): stdout: | (launched: 2022-12-10_00:32:10.215805) 00:32:11.374904 run osmo-msc_10.42.42.6(pid=2964): stderr: | 20221210003210485 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210003210485 DLGLOBAL DEBUG validating counter group 0x7fd4d0b76c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210003210485 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210003210485 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210003210486 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210003210486 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210003210487 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210003210488 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210003210488 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210003210488 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:32:11.423739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2957): Terminating (SIGTERM) 00:32:11.462505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2960): Terminating (SIGTERM) 00:32:11.501641 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2963): Terminating (SIGTERM) 00:32:11.541161 --- ParallelTerminationStrategy: PID 2957 died... 00:32:11.560055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2957): Terminated: ok {rc=0} 00:32:11.603444 --- ParallelTerminationStrategy: PID 2960 died... 00:32:11.621817 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2960): Terminated: ok {rc=0} 00:32:11.664942 --- ParallelTerminationStrategy: PID 2963 died... 00:32:11.683425 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2963): Terminated: ok {rc=0} 00:32:11.768326 bus /sierra_3: Setting Powered False 00:32:12.866473 bus /sierra_3: Setting Powered False 00:32:13.981464 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 handover_2G:octphy+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 handover_2G:octphy+bts1-trx-b200 --------------------------------------------------------------------- 00:32:15.219501 tst handover_2G:octphy+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:32:15.225131 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 00:32:15.275545 tst handover_2G:octphy+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 00:32:15.303100 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 00:32:15.356882 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 00:32:15.407478 tst handover_2G:octphy+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 00:32:15.434850 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 00:32:16.000587 tst handover_2G:octphy+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 handover_2G:octphy+bts1-trx-b200 handover.py ---------------------------------------------- 00:32:16.007246 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:32:16.019224 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 00:32:16.052777 tst handover.py: using LAC 24757 00:32:16.181050 tst handover.py: using RAC 22 00:32:16.312263 tst handover.py: using CellId 24757 00:32:16.441024 tst handover.py: using BVCI 24758 00:32:16.557954 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 00:32:16.619309 tst handover.py: using LAC 24758 00:32:16.748308 tst handover.py: using RAC 23 00:32:16.883737 tst handover.py: using CellId 24758 00:32:17.036800 tst handover.py: using BVCI 24759 00:32:17.161095 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:32:17.173444 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:32:17.185522 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:32:17.198220 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:32:17.211329 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:32:17.224111 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 00:32:17.349583 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 00:32:17.468425 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:32:17.939514 run create_hlr_db(pid=2969): Launched 00:32:18.061720 bus /sierra_2: Setting Powered False 00:32:19.125552 run create_hlr_db(pid=2969): Terminated: ok {rc=0} 00:32:19.530109 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2971): Launched 00:32:19.830072 run osmo-hlr_10.42.42.2(pid=2972): Launched 00:32:19.945042 run osmo-stp_10.42.42.5: Starting osmo-stp 00:32:20.437887 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2974): Launched 00:32:20.738991 run osmo-stp_10.42.42.5(pid=2975): Launched 00:32:20.854483 run osmo-msc_10.42.42.6: Starting osmo-msc 00:32:21.371849 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2977): Launched 00:32:21.672802 run osmo-msc_10.42.42.6(pid=2978): Launched 00:32:21.841381 run osmo-stp_10.42.42.5(pid=2975): ERR: Terminated: ERROR {rc=1} [trial-2366↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2975)] 00:32:21.968762 run osmo-stp_10.42.42.5(pid=2975): stdout: | (launched: 2022-12-10_00:32:20.683621) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:32:22.095583 run osmo-stp_10.42.42.5(pid=2975): stderr: | 20221210003220853 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210003220853 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210003220853 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210003220854 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210003220854 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210003220854 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210003220854 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:32:22.221346 run osmo-stp_10.42.42.5(pid=2975): stdout: | (launched: 2022-12-10_00:32:20.683621) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:32:22.341266 run osmo-stp_10.42.42.5(pid=2975): stderr: | 20221210003220853 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210003220853 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210003220853 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210003220854 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210003220854 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210003220854 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210003220854 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:32:22.484382 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2975): Process ended prematurely: osmo-stp_10.42.42.5(pid=2975) [trial-2366↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2975)] [trial-2366↪handover_2G:octphy+bts1-trx-b200↪handover.py:18] 00:32:22.492878 tst handover.py:18: Test FAILED (6.5 sec) 00:32:22.518724 run osmo-hlr_10.42.42.2(pid=2972): ERR: Terminated: ERROR {rc=237} [trial-2366↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2972)] 00:32:22.565667 run osmo-hlr_10.42.42.2(pid=2972): stdout: | (launched: 2022-12-10_00:32:19.775026) 00:32:22.614169 run osmo-hlr_10.42.42.2(pid=2972): stderr: | 20221210003219951 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210003219951 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210003219952 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210003219952 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210003219952 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210003219952 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210003219964 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/handover_2G:octphy+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210003219974 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210003219974 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210003219974 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:32:22.682235 run osmo-msc_10.42.42.6(pid=2978): ERR: Terminated: ERROR {rc=2} [trial-2366↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2978)] 00:32:22.729083 run osmo-msc_10.42.42.6(pid=2978): stdout: | (launched: 2022-12-10_00:32:21.617728) 00:32:22.777669 run osmo-msc_10.42.42.6(pid=2978): stderr: | 20221210003221887 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210003221887 DLGLOBAL DEBUG validating counter group 0x7fdc68f0cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210003221887 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210003221887 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210003221887 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210003221887 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210003221889 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210003221890 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210003221890 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210003221890 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:32:22.826976 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2971): Terminating (SIGTERM) 00:32:22.865927 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2974): Terminating (SIGTERM) 00:32:22.905289 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2977): Terminating (SIGTERM) 00:32:22.944862 --- ParallelTerminationStrategy: PID 2971 died... 00:32:22.963727 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2971): Terminated: ok {rc=0} 00:32:23.007351 --- ParallelTerminationStrategy: PID 2974 died... 00:32:23.025649 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2974): Terminated: ok {rc=0} 00:32:23.068889 --- ParallelTerminationStrategy: PID 2977 died... 00:32:23.087683 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2977): Terminated: ok {rc=0} 00:32:23.172386 bus /sierra_3: Setting Powered False 00:32:24.271412 bus /sierra_3: Setting Powered False 00:32:25.385496 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 handover_2G:octphy+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 handover_2G:octphy+bts1-trx-umtrx --------------------------------------------------------------------- 00:32:26.635013 tst handover_2G:octphy+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:32:26.640005 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 00:32:26.688079 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 00:32:26.714509 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 00:32:26.766743 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 00:32:26.814674 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 00:32:26.840819 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 00:32:27.390730 tst handover_2G:octphy+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 handover_2G:octphy+bts1-trx-umtrx handover.py ---------------------------------------------- 00:32:27.395758 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:32:27.406686 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 00:32:27.439345 tst handover.py: using LAC 24759 00:32:27.566577 tst handover.py: using RAC 24 00:32:27.693670 tst handover.py: using CellId 24759 00:32:27.820722 tst handover.py: using BVCI 24760 00:32:27.938367 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 00:32:27.986775 tst handover.py: using LAC 24760 00:32:28.115324 tst handover.py: using RAC 25 00:32:28.241161 tst handover.py: using CellId 24760 00:32:28.369338 tst handover.py: using BVCI 24761 00:32:28.486802 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:32:28.498389 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:32:28.509581 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:32:28.521093 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:32:28.532583 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:32:28.544248 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 00:32:28.663363 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 00:32:28.784155 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:32:29.228845 run create_hlr_db(pid=2983): Launched 00:32:29.352474 bus /sierra_2: Setting Powered False 00:32:30.413467 run create_hlr_db(pid=2983): Terminated: ok {rc=0} 00:32:30.826547 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2985): Launched 00:32:31.178120 run osmo-hlr_10.42.42.2(pid=2986): Launched 00:32:31.426633 run osmo-stp_10.42.42.5: Starting osmo-stp 00:32:32.101394 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2988): Launched 00:32:32.433264 run osmo-stp_10.42.42.5(pid=2989): Launched 00:32:32.557719 run osmo-msc_10.42.42.6: Starting osmo-msc 00:32:33.113568 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2991): Launched 00:32:33.437602 run osmo-msc_10.42.42.6(pid=2992): Launched 00:32:33.619193 run osmo-stp_10.42.42.5(pid=2989): ERR: Terminated: ERROR {rc=1} [trial-2366↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2989)] 00:32:33.756240 run osmo-stp_10.42.42.5(pid=2989): stdout: | (launched: 2022-12-10_00:32:32.374963) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:32:33.894276 run osmo-stp_10.42.42.5(pid=2989): stderr: | 20221210003232566 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210003232566 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210003232567 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210003232567 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210003232567 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210003232567 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210003232567 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:32:34.030818 run osmo-stp_10.42.42.5(pid=2989): stdout: | (launched: 2022-12-10_00:32:32.374963) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:32:34.160061 run osmo-stp_10.42.42.5(pid=2989): stderr: | 20221210003232566 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210003232566 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210003232567 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210003232567 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210003232567 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210003232567 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210003232567 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:32:34.315808 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2989): Process ended prematurely: osmo-stp_10.42.42.5(pid=2989) [trial-2366↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2989)] [trial-2366↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18] 00:32:34.324823 tst handover.py:18: Test FAILED (6.9 sec) 00:32:34.352612 run osmo-hlr_10.42.42.2(pid=2986): ERR: Terminated: ERROR {rc=237} [trial-2366↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2986)] 00:32:34.403500 run osmo-hlr_10.42.42.2(pid=2986): stdout: | (launched: 2022-12-10_00:32:31.114722) 00:32:34.455781 run osmo-hlr_10.42.42.2(pid=2986): stderr: | 20221210003231418 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210003231418 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210003231418 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210003231418 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210003231418 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210003231418 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210003231439 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/handover_2G:octphy+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210003231447 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210003231447 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210003231447 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:32:34.528794 run osmo-msc_10.42.42.6(pid=2992): ERR: Terminated: ERROR {rc=2} [trial-2366↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2992)] 00:32:34.579352 run osmo-msc_10.42.42.6(pid=2992): stdout: | (launched: 2022-12-10_00:32:33.378928) 00:32:34.631397 run osmo-msc_10.42.42.6(pid=2992): stderr: | 20221210003233699 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210003233699 DLGLOBAL DEBUG validating counter group 0x7f3648af3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210003233699 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210003233699 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210003233699 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210003233699 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210003233701 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210003233701 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210003233702 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210003233702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:32:34.683665 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2985): Terminating (SIGTERM) 00:32:34.725775 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2988): Terminating (SIGTERM) 00:32:34.767804 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2991): Terminating (SIGTERM) 00:32:34.810100 --- ParallelTerminationStrategy: PID 2985 died... 00:32:34.830103 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2985): Terminated: ok {rc=0} 00:32:34.877016 --- ParallelTerminationStrategy: PID 2988 died... 00:32:34.896597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2988): Terminated: ok {rc=0} 00:32:34.943350 --- ParallelTerminationStrategy: PID 2991 died... 00:32:34.962978 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2991): Terminated: ok {rc=0} 00:32:35.051141 bus /sierra_3: Setting Powered False 00:32:36.150217 bus /sierra_3: Setting Powered False 00:32:37.268875 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 handover_2G:octphy+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 handover_2G:trx-lms+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 00:32:38.533943 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:32:38.539479 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 00:32:38.598894 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 00:32:38.625391 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 00:32:38.681652 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 00:32:38.743669 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 00:32:38.771369 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 00:32:39.315800 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 00:32:39.321336 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:32:39.332396 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 00:32:39.380450 tst handover.py: using LAC 24761 00:32:39.500547 tst handover.py: using RAC 26 00:32:39.619526 tst handover.py: using CellId 24761 00:32:39.740229 tst handover.py: using BVCI 24762 00:32:39.851576 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 00:32:39.895692 tst handover.py: using LAC 24762 00:32:40.014870 tst handover.py: using RAC 27 00:32:40.138918 tst handover.py: using CellId 24762 00:32:40.258285 tst handover.py: using BVCI 24763 00:32:40.368018 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:32:40.379284 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:32:40.390358 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:32:40.401512 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:32:40.412375 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 00:32:40.423342 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 00:32:40.542178 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 00:32:40.657880 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:32:41.099582 run create_hlr_db(pid=2997): Launched 00:32:41.222298 bus /sierra_2: Setting Powered False 00:32:42.283277 run create_hlr_db(pid=2997): Terminated: ok {rc=0} 00:32:42.696507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2999): Launched 00:32:43.019251 run osmo-hlr_10.42.42.2(pid=3000): Launched 00:32:43.143858 run osmo-stp_10.42.42.5: Starting osmo-stp 00:32:43.671409 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3002): Launched 00:32:43.995489 run osmo-stp_10.42.42.5(pid=3003): Launched 00:32:44.119711 run osmo-msc_10.42.42.6: Starting osmo-msc 00:32:44.676740 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3005): Launched 00:32:44.999585 run osmo-msc_10.42.42.6(pid=3006): Launched 00:32:45.179452 run osmo-stp_10.42.42.5(pid=3003): ERR: Terminated: ERROR {rc=1} [trial-2366↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3003)] 00:32:45.316317 run osmo-stp_10.42.42.5(pid=3003): stdout: | (launched: 2022-12-10_00:32:43.936085) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:32:45.452779 run osmo-stp_10.42.42.5(pid=3003): stderr: | 20221210003244127 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210003244127 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210003244128 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210003244128 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210003244128 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210003244128 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210003244129 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:32:45.588055 run osmo-stp_10.42.42.5(pid=3003): stdout: | (launched: 2022-12-10_00:32:43.936085) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:32:45.716691 run osmo-stp_10.42.42.5(pid=3003): stderr: | 20221210003244127 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210003244127 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210003244128 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210003244128 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210003244128 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210003244128 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210003244129 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:32:45.872476 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3003): Process ended prematurely: osmo-stp_10.42.42.5(pid=3003) [trial-2366↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3003)] [trial-2366↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18] 00:32:45.882325 tst handover.py:18: Test FAILED (6.6 sec) 00:32:45.925306 run osmo-hlr_10.42.42.2(pid=3000): ERR: Terminated: ERROR {rc=237} [trial-2366↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3000)] 00:32:45.976749 run osmo-hlr_10.42.42.2(pid=3000): stdout: | (launched: 2022-12-10_00:32:42.960746) 00:32:46.029957 run osmo-hlr_10.42.42.2(pid=3000): stderr: | 20221210003243156 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210003243156 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210003243156 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210003243156 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210003243156 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210003243156 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210003243212 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/handover_2G:trx-lms+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210003243221 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210003243221 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210003243221 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:32:46.105608 run osmo-msc_10.42.42.6(pid=3006): ERR: Terminated: ERROR {rc=2} [trial-2366↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3006)] 00:32:46.157873 run osmo-msc_10.42.42.6(pid=3006): stdout: | (launched: 2022-12-10_00:32:44.940786) 00:32:46.211732 run osmo-msc_10.42.42.6(pid=3006): stderr: | 20221210003245262 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210003245262 DLGLOBAL DEBUG validating counter group 0x7f5688d5ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210003245262 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210003245262 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210003245262 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210003245263 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210003245264 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210003245265 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210003245265 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210003245265 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:32:46.266476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2999): Terminating (SIGTERM) 00:32:46.310618 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3002): Terminating (SIGTERM) 00:32:46.354599 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3005): Terminating (SIGTERM) 00:32:46.398942 --- ParallelTerminationStrategy: PID 2999 died... 00:32:46.419468 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2999): Terminated: ok {rc=0} 00:32:46.468937 --- ParallelTerminationStrategy: PID 3002 died... 00:32:46.489465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3002): Terminated: ok {rc=0} 00:32:46.538789 --- ParallelTerminationStrategy: PID 3005 died... 00:32:46.559245 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3005): Terminated: ok {rc=0} 00:32:46.650741 bus /sierra_3: Setting Powered False 00:32:47.750798 bus /sierra_3: Setting Powered False 00:32:48.866856 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 handover_2G:trx-lms+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 handover_2G:trx-lms+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 00:32:50.134643 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:32:50.140803 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 00:32:50.203845 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 00:32:50.230235 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 00:32:50.279476 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 00:32:50.341991 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 00:32:50.368183 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 00:32:50.922810 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 handover_2G:trx-lms+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 00:32:50.927884 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:32:50.938839 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 00:32:50.986665 tst handover.py: using LAC 24763 00:32:51.114090 tst handover.py: using RAC 28 00:32:51.241200 tst handover.py: using CellId 24763 00:32:51.371450 tst handover.py: using BVCI 24764 00:32:51.490116 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 00:32:51.538520 tst handover.py: using LAC 24764 00:32:51.665749 tst handover.py: using RAC 29 00:32:51.793136 tst handover.py: using CellId 24764 00:32:51.919165 tst handover.py: using BVCI 24765 00:32:52.036859 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:32:52.048320 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:32:52.059634 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:32:52.071134 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:32:52.082691 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:32:52.094249 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 00:32:52.209089 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 00:32:52.330906 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:32:52.773579 run create_hlr_db(pid=3011): Launched 00:32:52.897470 bus /sierra_2: Setting Powered False 00:32:53.957620 run create_hlr_db(pid=3011): Terminated: ok {rc=0} 00:32:54.369981 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3013): Launched 00:32:54.691624 run osmo-hlr_10.42.42.2(pid=3014): Launched 00:32:54.815283 run osmo-stp_10.42.42.5: Starting osmo-stp 00:32:55.341333 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3016): Launched 00:32:55.664719 run osmo-stp_10.42.42.5(pid=3017): Launched 00:32:55.788146 run osmo-msc_10.42.42.6: Starting osmo-msc 00:32:56.343311 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3019): Launched 00:32:56.649422 run osmo-msc_10.42.42.6(pid=3020): Launched 00:32:56.819498 run osmo-stp_10.42.42.5(pid=3017): ERR: Terminated: ERROR {rc=1} [trial-2366↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3017)] 00:32:56.947108 run osmo-stp_10.42.42.5(pid=3017): stdout: | (launched: 2022-12-10_00:32:55.605441) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:32:57.074035 run osmo-stp_10.42.42.5(pid=3017): stderr: | 20221210003255796 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210003255796 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210003255796 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210003255797 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210003255797 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210003255797 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210003255797 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:32:57.199327 run osmo-stp_10.42.42.5(pid=3017): stdout: | (launched: 2022-12-10_00:32:55.605441) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:32:57.319252 run osmo-stp_10.42.42.5(pid=3017): stderr: | 20221210003255796 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210003255796 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210003255796 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210003255797 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210003255797 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210003255797 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210003255797 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:32:57.462844 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3017): Process ended prematurely: osmo-stp_10.42.42.5(pid=3017) [trial-2366↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3017)] [trial-2366↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18] 00:32:57.470924 tst handover.py:18: Test FAILED (6.5 sec) 00:32:57.496933 run osmo-hlr_10.42.42.2(pid=3014): ERR: Terminated: ERROR {rc=237} [trial-2366↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3014)] 00:32:57.544746 run osmo-hlr_10.42.42.2(pid=3014): stdout: | (launched: 2022-12-10_00:32:54.633324) 00:32:57.594328 run osmo-hlr_10.42.42.2(pid=3014): stderr: | 20221210003254833 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210003254833 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210003254833 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210003254833 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210003254833 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210003254833 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210003254846 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/handover_2G:trx-lms+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210003254855 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210003254855 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210003254855 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:32:57.663442 run osmo-msc_10.42.42.6(pid=3020): ERR: Terminated: ERROR {rc=2} [trial-2366↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3020)] 00:32:57.711108 run osmo-msc_10.42.42.6(pid=3020): stdout: | (launched: 2022-12-10_00:32:56.594384) 00:32:57.760476 run osmo-msc_10.42.42.6(pid=3020): stderr: | 20221210003256864 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210003256864 DLGLOBAL DEBUG validating counter group 0x7f12b1181c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210003256864 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210003256864 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210003256864 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210003256864 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210003256866 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210003256866 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210003256867 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210003256867 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:32:57.810351 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3013): Terminating (SIGTERM) 00:32:57.850068 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3016): Terminating (SIGTERM) 00:32:57.889788 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3019): Terminating (SIGTERM) 00:32:57.929736 --- ParallelTerminationStrategy: PID 3013 died... 00:32:57.948876 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3013): Terminated: ok {rc=0} 00:32:57.992789 --- ParallelTerminationStrategy: PID 3016 died... 00:32:58.011475 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3016): Terminated: ok {rc=0} 00:32:58.055274 --- ParallelTerminationStrategy: PID 3019 died... 00:32:58.074001 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3019): Terminated: ok {rc=0} 00:32:58.159968 bus /sierra_3: Setting Powered False 00:32:59.262436 bus /sierra_3: Setting Powered False 00:33:00.380463 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 handover_2G:trx-lms+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 handover_2G:trx-lms+bts1-sysmo --------------------------------------------------------------------- 00:33:01.691902 tst handover_2G:trx-lms+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:33:01.698233 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x bts (candidates: 11) 00:33:01.764780 tst handover_2G:trx-lms+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 00:33:01.794134 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x modem (candidates: 12) 00:33:01.846991 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x bts (candidates: 11) 00:33:01.902495 tst handover_2G:trx-lms+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 00:33:01.931678 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x modem (candidates: 12) 00:33:02.479628 tst handover_2G:trx-lms+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 handover_2G:trx-lms+bts1-sysmo handover.py ---------------------------------------------- 00:33:02.485757 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:33:02.497412 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 00:33:02.546286 tst handover.py: using LAC 24765 00:33:02.673746 tst handover.py: using RAC 30 00:33:02.801633 tst handover.py: using CellId 24765 00:33:02.921799 tst handover.py: using BVCI 24766 00:33:03.031787 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 00:33:03.066150 tst handover.py: using LAC 24766 00:33:03.183983 tst handover.py: using RAC 31 00:33:03.301539 tst handover.py: using CellId 24766 00:33:03.420907 tst handover.py: using BVCI 24767 00:33:03.530313 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:33:03.541001 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:33:03.551545 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:33:03.562202 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:33:03.572755 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:33:03.583326 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 00:33:03.701992 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 00:33:03.821486 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:33:04.292876 run create_hlr_db(pid=3026): Launched 00:33:04.417494 bus /sierra_2: Setting Powered False 00:33:05.481297 run create_hlr_db(pid=3026): Terminated: ok {rc=0} 00:33:05.902839 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3028): Launched 00:33:06.226263 run osmo-hlr_10.42.42.2(pid=3029): Launched 00:33:06.351152 run osmo-stp_10.42.42.5: Starting osmo-stp 00:33:06.882591 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3031): Launched 00:33:07.204917 run osmo-stp_10.42.42.5(pid=3032): Launched 00:33:07.329741 run osmo-msc_10.42.42.6: Starting osmo-msc 00:33:07.888440 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3034): Launched 00:33:08.210426 run osmo-msc_10.42.42.6(pid=3035): Launched 00:33:08.391122 run osmo-stp_10.42.42.5(pid=3032): ERR: Terminated: ERROR {rc=1} [trial-2366↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3032)] 00:33:08.527307 run osmo-stp_10.42.42.5(pid=3032): stdout: | (launched: 2022-12-10_00:33:07.146294) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:33:08.663960 run osmo-stp_10.42.42.5(pid=3032): stderr: | 20221210003307337 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210003307337 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210003307337 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210003307338 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210003307338 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210003307338 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210003307338 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:33:08.800362 run osmo-stp_10.42.42.5(pid=3032): stdout: | (launched: 2022-12-10_00:33:07.146294) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:33:08.928892 run osmo-stp_10.42.42.5(pid=3032): stderr: | 20221210003307337 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210003307337 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210003307337 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210003307338 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210003307338 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210003307338 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210003307338 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:33:09.083311 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3032): Process ended prematurely: osmo-stp_10.42.42.5(pid=3032) [trial-2366↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3032)] [trial-2366↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18] 00:33:09.092110 tst handover.py:18: Test FAILED (6.6 sec) 00:33:09.119709 run osmo-hlr_10.42.42.2(pid=3029): ERR: Terminated: ERROR {rc=237} [trial-2366↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3029)] 00:33:09.170134 run osmo-hlr_10.42.42.2(pid=3029): stdout: | (launched: 2022-12-10_00:33:06.167300) 00:33:09.221632 run osmo-hlr_10.42.42.2(pid=3029): stderr: | 20221210003306366 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210003306366 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210003306366 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210003306366 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210003306366 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210003306366 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210003306378 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/handover_2G:trx-lms+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210003306387 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210003306387 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210003306387 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:33:09.293803 run osmo-msc_10.42.42.6(pid=3035): ERR: Terminated: ERROR {rc=2} [trial-2366↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3035)] 00:33:09.343862 run osmo-msc_10.42.42.6(pid=3035): stdout: | (launched: 2022-12-10_00:33:08.151584) 00:33:09.395434 run osmo-msc_10.42.42.6(pid=3035): stderr: | 20221210003308472 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210003308472 DLGLOBAL DEBUG validating counter group 0x7f4265f68c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210003308473 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210003308473 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210003308473 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210003308473 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210003308475 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210003308475 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210003308475 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210003308475 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:33:09.447282 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3028): Terminating (SIGTERM) 00:33:09.488544 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3031): Terminating (SIGTERM) 00:33:09.529985 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3034): Terminating (SIGTERM) 00:33:09.571559 --- ParallelTerminationStrategy: PID 3028 died... 00:33:09.591240 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3028): Terminated: ok {rc=0} 00:33:09.637467 --- ParallelTerminationStrategy: PID 3031 died... 00:33:09.656532 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3031): Terminated: ok {rc=0} 00:33:09.702712 --- ParallelTerminationStrategy: PID 3034 died... 00:33:09.721954 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3034): Terminated: ok {rc=0} 00:33:09.809466 bus /sierra_3: Setting Powered False 00:33:10.907337 bus /sierra_3: Setting Powered False 00:33:12.023447 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 handover_2G:trx-lms+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 handover_2G:trx-lms+bts1-trx-b200 --------------------------------------------------------------------- 00:33:13.274865 tst handover_2G:trx-lms+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:33:13.280038 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 00:33:13.341868 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 00:33:13.368405 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 00:33:13.420134 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 00:33:13.483033 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 00:33:13.509937 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 00:33:14.060445 tst handover_2G:trx-lms+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 handover_2G:trx-lms+bts1-trx-b200 handover.py ---------------------------------------------- 00:33:14.065901 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:33:14.076777 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 00:33:14.124877 tst handover.py: using LAC 24767 00:33:14.243621 tst handover.py: using RAC 32 00:33:14.363893 tst handover.py: using CellId 24767 00:33:14.490689 tst handover.py: using BVCI 24768 00:33:14.608540 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 00:33:14.657415 tst handover.py: using LAC 24768 00:33:14.785237 tst handover.py: using RAC 33 00:33:14.904584 tst handover.py: using CellId 24768 00:33:15.026657 tst handover.py: using BVCI 24769 00:33:15.146272 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:33:15.157626 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:33:15.168674 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:33:15.180066 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:33:15.191430 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:33:15.202725 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 00:33:15.321854 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 00:33:15.436663 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:33:15.916573 run create_hlr_db(pid=3040): Launched 00:33:16.085719 bus /sierra_2: Setting Powered False 00:33:17.148559 run create_hlr_db(pid=3040): Terminated: ok {rc=0} 00:33:17.558550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3042): Launched 00:33:17.861240 run osmo-hlr_10.42.42.2(pid=3043): Launched 00:33:17.976532 run osmo-stp_10.42.42.5: Starting osmo-stp 00:33:18.470675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3045): Launched 00:33:18.772408 run osmo-stp_10.42.42.5(pid=3046): Launched 00:33:18.888208 run osmo-msc_10.42.42.6: Starting osmo-msc 00:33:19.410913 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3048): Launched 00:33:19.712622 run osmo-msc_10.42.42.6(pid=3049): Launched 00:33:19.882029 run osmo-stp_10.42.42.5(pid=3046): ERR: Terminated: ERROR {rc=1} [trial-2366↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3046)] 00:33:20.010589 run osmo-stp_10.42.42.5(pid=3046): stdout: | (launched: 2022-12-10_00:33:18.716928) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:33:20.138100 run osmo-stp_10.42.42.5(pid=3046): stderr: | 20221210003318887 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210003318888 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210003318888 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210003318888 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210003318889 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210003318889 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210003318889 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:33:20.264341 run osmo-stp_10.42.42.5(pid=3046): stdout: | (launched: 2022-12-10_00:33:18.716928) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:33:20.385193 run osmo-stp_10.42.42.5(pid=3046): stderr: | 20221210003318887 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210003318888 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210003318888 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210003318888 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210003318889 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210003318889 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210003318889 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:33:20.528932 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3046): Process ended prematurely: osmo-stp_10.42.42.5(pid=3046) [trial-2366↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3046)] [trial-2366↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18] 00:33:20.537305 tst handover.py:18: Test FAILED (6.5 sec) 00:33:20.563310 run osmo-hlr_10.42.42.2(pid=3043): ERR: Terminated: ERROR {rc=237} [trial-2366↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3043)] 00:33:20.610816 run osmo-hlr_10.42.42.2(pid=3043): stdout: | (launched: 2022-12-10_00:33:17.805889) 00:33:20.660124 run osmo-hlr_10.42.42.2(pid=3043): stderr: | 20221210003317981 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210003317981 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210003317981 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210003317981 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210003317981 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210003317981 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210003317994 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/handover_2G:trx-lms+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210003318002 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210003318003 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210003318003 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:33:20.728860 run osmo-msc_10.42.42.6(pid=3049): ERR: Terminated: ERROR {rc=2} [trial-2366↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3049)] 00:33:20.776068 run osmo-msc_10.42.42.6(pid=3049): stdout: | (launched: 2022-12-10_00:33:19.657394) 00:33:20.825090 run osmo-msc_10.42.42.6(pid=3049): stderr: | 20221210003319928 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210003319928 DLGLOBAL DEBUG validating counter group 0x7f65d9064c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210003319928 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210003319928 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210003319929 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210003319929 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210003319930 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210003319931 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210003319931 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210003319931 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:33:20.874361 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3042): Terminating (SIGTERM) 00:33:20.913510 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3045): Terminating (SIGTERM) 00:33:20.952595 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3048): Terminating (SIGTERM) 00:33:20.991962 --- ParallelTerminationStrategy: PID 3042 died... 00:33:21.010945 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3042): Terminated: ok {rc=0} 00:33:21.054601 --- ParallelTerminationStrategy: PID 3045 died... 00:33:21.073677 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3045): Terminated: ok {rc=0} 00:33:21.117444 --- ParallelTerminationStrategy: PID 3048 died... 00:33:21.136013 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3048): Terminated: ok {rc=0} 00:33:21.220339 bus /sierra_3: Setting Powered False 00:33:22.320205 bus /sierra_3: Setting Powered False 00:33:23.435910 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 handover_2G:trx-lms+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 handover_2G:trx-lms+bts1-trx-umtrx --------------------------------------------------------------------- 00:33:24.709243 tst handover_2G:trx-lms+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:33:24.715034 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 00:33:24.778205 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 00:33:24.805669 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 00:33:24.861988 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 00:33:24.926813 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 00:33:24.954351 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 00:33:25.499367 tst handover_2G:trx-lms+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 handover_2G:trx-lms+bts1-trx-umtrx handover.py ---------------------------------------------- 00:33:25.504667 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:33:25.515930 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 00:33:25.565281 tst handover.py: using LAC 24769 00:33:25.691919 tst handover.py: using RAC 34 00:33:25.817277 tst handover.py: using CellId 24769 00:33:25.941976 tst handover.py: using BVCI 24770 00:33:26.059779 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 00:33:26.109342 tst handover.py: using LAC 24770 00:33:26.235446 tst handover.py: using RAC 35 00:33:26.362890 tst handover.py: using CellId 24770 00:33:26.488783 tst handover.py: using BVCI 24771 00:33:26.606715 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:33:26.617963 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:33:26.629003 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:33:26.640330 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:33:26.651660 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:33:26.662801 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 00:33:26.780449 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 00:33:26.896933 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:33:27.371378 run create_hlr_db(pid=3054): Launched 00:33:27.494009 bus /sierra_2: Setting Powered False 00:33:28.557954 run create_hlr_db(pid=3054): Terminated: ok {rc=0} 00:33:28.978486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3056): Launched 00:33:29.300288 run osmo-hlr_10.42.42.2(pid=3057): Launched 00:33:29.424546 run osmo-stp_10.42.42.5: Starting osmo-stp 00:33:29.953292 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3059): Launched 00:33:30.275309 run osmo-stp_10.42.42.5(pid=3060): Launched 00:33:30.399823 run osmo-msc_10.42.42.6: Starting osmo-msc 00:33:30.974425 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3062): Launched 00:33:31.316080 run osmo-msc_10.42.42.6(pid=3063): Launched 00:33:31.754593 run osmo-stp_10.42.42.5(pid=3060): ERR: Terminated: ERROR {rc=1} [trial-2366↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3060)] 00:33:31.911035 run osmo-stp_10.42.42.5(pid=3060): stdout: | (launched: 2022-12-10_00:33:30.216571) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:33:32.048050 run osmo-stp_10.42.42.5(pid=3060): stderr: | 20221210003330409 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210003330409 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210003330410 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210003330410 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210003330410 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210003330411 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210003330411 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:33:32.185548 run osmo-stp_10.42.42.5(pid=3060): stdout: | (launched: 2022-12-10_00:33:30.216571) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:33:32.317308 run osmo-stp_10.42.42.5(pid=3060): stderr: | 20221210003330409 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210003330409 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210003330410 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210003330410 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210003330410 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210003330411 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210003330411 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:33:32.472695 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3060): Process ended prematurely: osmo-stp_10.42.42.5(pid=3060) [trial-2366↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3060)] [trial-2366↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18] 00:33:32.481707 tst handover.py:18: Test FAILED (7.0 sec) 00:33:32.509362 run osmo-hlr_10.42.42.2(pid=3057): ERR: Terminated: ERROR {rc=237} [trial-2366↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3057)] 00:33:32.559696 run osmo-hlr_10.42.42.2(pid=3057): stdout: | (launched: 2022-12-10_00:33:29.241218) 00:33:32.611449 run osmo-hlr_10.42.42.2(pid=3057): stderr: | 20221210003329440 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210003329440 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210003329440 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210003329440 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210003329440 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210003329440 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210003329452 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/handover_2G:trx-lms+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210003329460 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210003329460 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210003329460 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:33:32.683672 run osmo-msc_10.42.42.6(pid=3063): ERR: Terminated: ERROR {rc=2} [trial-2366↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3063)] 00:33:32.733708 run osmo-msc_10.42.42.6(pid=3063): stdout: | (launched: 2022-12-10_00:33:31.251894) 00:33:32.785670 run osmo-msc_10.42.42.6(pid=3063): stderr: | 20221210003331622 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210003331623 DLGLOBAL DEBUG validating counter group 0x7fbbc5701c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210003331624 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210003331626 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210003331626 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210003331626 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210003331628 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210003331628 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210003331629 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210003331629 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:33:32.837794 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3056): Terminating (SIGTERM) 00:33:32.879462 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3059): Terminating (SIGTERM) 00:33:32.921239 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3062): Terminating (SIGTERM) 00:33:32.963549 --- ParallelTerminationStrategy: PID 3056 died... 00:33:32.983632 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3056): Terminated: ok {rc=0} 00:33:33.030731 --- ParallelTerminationStrategy: PID 3059 died... 00:33:33.050434 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3059): Terminated: ok {rc=0} 00:33:33.097193 --- ParallelTerminationStrategy: PID 3062 died... 00:33:33.116552 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3062): Terminated: ok {rc=0} 00:33:33.204433 bus /sierra_3: Setting Powered False 00:33:34.302339 bus /sierra_3: Setting Powered False 00:33:35.418957 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 handover_2G:trx-lms+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 00:33:36.690320 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:33:36.695436 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 00:33:36.753688 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 00:33:36.780365 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 00:33:36.830325 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 00:33:36.889224 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 00:33:36.915481 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 00:33:37.472410 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 00:33:37.477596 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:33:37.488739 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 00:33:37.532080 tst handover.py: using LAC 24771 00:33:37.649033 tst handover.py: using RAC 36 00:33:37.765641 tst handover.py: using CellId 24771 00:33:37.883282 tst handover.py: using BVCI 24772 00:33:37.994291 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 00:33:38.041915 tst handover.py: using LAC 24772 00:33:38.160083 tst handover.py: using RAC 37 00:33:38.276611 tst handover.py: using CellId 24772 00:33:38.393513 tst handover.py: using BVCI 24773 00:33:38.502450 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:33:38.513716 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:33:38.524627 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:33:38.535695 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:33:38.546786 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 00:33:38.557750 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 00:33:38.677508 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 00:33:38.797982 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:33:39.271179 run create_hlr_db(pid=3069): Launched 00:33:39.395646 bus /sierra_2: Setting Powered False 00:33:40.460467 run create_hlr_db(pid=3069): Terminated: ok {rc=0} 00:33:40.882264 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3071): Launched 00:33:41.205071 run osmo-hlr_10.42.42.2(pid=3072): Launched 00:33:41.330041 run osmo-stp_10.42.42.5: Starting osmo-stp 00:33:41.856299 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3074): Launched 00:33:42.179753 run osmo-stp_10.42.42.5(pid=3075): Launched 00:33:42.303911 run osmo-msc_10.42.42.6: Starting osmo-msc 00:33:42.862847 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3078): Launched 00:33:43.185955 run osmo-msc_10.42.42.6(pid=3079): Launched 00:33:43.370452 run osmo-stp_10.42.42.5(pid=3075): ERR: Terminated: ERROR {rc=1} [trial-2366↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3075)] 00:33:43.507094 run osmo-stp_10.42.42.5(pid=3075): stdout: | (launched: 2022-12-10_00:33:42.120798) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:33:43.643906 run osmo-stp_10.42.42.5(pid=3075): stderr: | 20221210003342312 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210003342312 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210003342313 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210003342313 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210003342314 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210003342314 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210003342314 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:33:43.780336 run osmo-stp_10.42.42.5(pid=3075): stdout: | (launched: 2022-12-10_00:33:42.120798) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:33:43.909942 run osmo-stp_10.42.42.5(pid=3075): stderr: | 20221210003342312 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210003342312 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210003342313 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210003342313 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210003342314 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210003342314 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210003342314 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:33:44.063861 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3075): Process ended prematurely: osmo-stp_10.42.42.5(pid=3075) [trial-2366↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3075)] [trial-2366↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18] 00:33:44.072849 tst handover.py:18: Test FAILED (6.6 sec) 00:33:44.100861 run osmo-hlr_10.42.42.2(pid=3072): ERR: Terminated: ERROR {rc=237} [trial-2366↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3072)] 00:33:44.151143 run osmo-hlr_10.42.42.2(pid=3072): stdout: | (launched: 2022-12-10_00:33:41.146309) 00:33:44.203074 run osmo-hlr_10.42.42.2(pid=3072): stderr: | 20221210003341346 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210003341346 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210003341346 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210003341346 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210003341346 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210003341346 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210003341388 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210003341398 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210003341398 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210003341398 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:33:44.275145 run osmo-msc_10.42.42.6(pid=3079): ERR: Terminated: ERROR {rc=2} [trial-2366↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3079)] 00:33:44.325597 run osmo-msc_10.42.42.6(pid=3079): stdout: | (launched: 2022-12-10_00:33:43.127333) 00:33:44.377459 run osmo-msc_10.42.42.6(pid=3079): stderr: | 20221210003343448 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210003343448 DLGLOBAL DEBUG validating counter group 0x7f9aa7defc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210003343448 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210003343448 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210003343448 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210003343448 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210003343450 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210003343451 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210003343451 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210003343451 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:33:44.429424 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3071): Terminating (SIGTERM) 00:33:44.471371 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3074): Terminating (SIGTERM) 00:33:44.513269 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3078): Terminating (SIGTERM) 00:33:44.555618 --- ParallelTerminationStrategy: PID 3071 died... 00:33:44.575574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3071): Terminated: ok {rc=0} 00:33:44.622502 --- ParallelTerminationStrategy: PID 3074 died... 00:33:44.642105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3074): Terminated: ok {rc=0} 00:33:44.688627 --- ParallelTerminationStrategy: PID 3078 died... 00:33:44.708144 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3078): Terminated: ok {rc=0} 00:33:44.794881 bus /sierra_3: Setting Powered False 00:33:45.892741 bus /sierra_3: Setting Powered False 00:33:47.033337 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 handover_2G:trx-lms-limenet-micro+bts1-sysmo --------------------------------------------------------------------- 00:33:48.298270 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:33:48.303515 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x bts (candidates: 11) 00:33:48.349664 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 00:33:48.375948 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x modem (candidates: 12) 00:33:48.427535 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x bts (candidates: 11) 00:33:48.473767 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 00:33:48.500242 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x modem (candidates: 12) 00:33:49.053902 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover.py ---------------------------------------------- 00:33:49.060590 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:33:49.073268 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 00:33:49.118139 tst handover.py: using LAC 24773 00:33:49.247440 tst handover.py: using RAC 38 00:33:49.374336 tst handover.py: using CellId 24773 00:33:49.495353 tst handover.py: using BVCI 24774 00:33:49.606103 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 00:33:49.641418 tst handover.py: using LAC 24774 00:33:49.759733 tst handover.py: using RAC 39 00:33:49.880481 tst handover.py: using CellId 24774 00:33:50.000633 tst handover.py: using BVCI 24775 00:33:50.111517 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:33:50.122491 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:33:50.133277 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:33:50.144017 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:33:50.154742 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:33:50.165414 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 00:33:50.284001 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 00:33:50.401306 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:33:50.841058 run create_hlr_db(pid=3084): Launched 00:33:50.963939 bus /sierra_2: Setting Powered False 00:33:52.025091 run create_hlr_db(pid=3084): Terminated: ok {rc=0} 00:33:52.437509 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3086): Launched 00:33:52.761662 run osmo-hlr_10.42.42.2(pid=3087): Launched 00:33:52.885628 run osmo-stp_10.42.42.5: Starting osmo-stp 00:33:53.417311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3089): Launched 00:33:53.738959 run osmo-stp_10.42.42.5(pid=3090): Launched 00:33:53.862400 run osmo-msc_10.42.42.6: Starting osmo-msc 00:33:54.416796 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3092): Launched 00:33:54.738521 run osmo-msc_10.42.42.6(pid=3093): Launched 00:33:54.918632 run osmo-stp_10.42.42.5(pid=3090): ERR: Terminated: ERROR {rc=1} [trial-2366↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3090)] 00:33:55.054694 run osmo-stp_10.42.42.5(pid=3090): stdout: | (launched: 2022-12-10_00:33:53.680361) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:33:55.191235 run osmo-stp_10.42.42.5(pid=3090): stderr: | 20221210003353873 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210003353873 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210003353873 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210003353874 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210003353874 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210003353874 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210003353874 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:33:55.327523 run osmo-stp_10.42.42.5(pid=3090): stdout: | (launched: 2022-12-10_00:33:53.680361) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:33:55.456152 run osmo-stp_10.42.42.5(pid=3090): stderr: | 20221210003353873 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210003353873 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210003353873 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210003353874 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210003353874 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210003353874 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210003353874 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:33:55.609861 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3090): Process ended prematurely: osmo-stp_10.42.42.5(pid=3090) [trial-2366↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3090)] [trial-2366↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18] 00:33:55.618904 tst handover.py:18: Test FAILED (6.6 sec) 00:33:55.646576 run osmo-hlr_10.42.42.2(pid=3087): ERR: Terminated: ERROR {rc=237} [trial-2366↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3087)] 00:33:55.697165 run osmo-hlr_10.42.42.2(pid=3087): stdout: | (launched: 2022-12-10_00:33:52.702663) 00:33:55.749115 run osmo-hlr_10.42.42.2(pid=3087): stderr: | 20221210003352901 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210003352901 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210003352901 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210003352901 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210003352902 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210003352902 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210003352916 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/handover_2G:trx-lms-limenet-micro+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210003352924 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210003352925 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210003352925 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:33:55.821390 run osmo-msc_10.42.42.6(pid=3093): ERR: Terminated: ERROR {rc=2} [trial-2366↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3093)] 00:33:55.871410 run osmo-msc_10.42.42.6(pid=3093): stdout: | (launched: 2022-12-10_00:33:54.679878) 00:33:55.923060 run osmo-msc_10.42.42.6(pid=3093): stderr: | 20221210003355001 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210003355002 DLGLOBAL DEBUG validating counter group 0x7efbfd9dbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210003355002 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210003355002 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210003355002 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210003355002 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210003355004 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210003355004 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210003355004 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210003355004 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:33:55.975114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3086): Terminating (SIGTERM) 00:33:56.016881 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3089): Terminating (SIGTERM) 00:33:56.059055 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3092): Terminating (SIGTERM) 00:33:56.101203 --- ParallelTerminationStrategy: PID 3086 died... 00:33:56.121171 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3086): Terminated: ok {rc=0} 00:33:56.167517 --- ParallelTerminationStrategy: PID 3089 died... 00:33:56.187182 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3089): Terminated: ok {rc=0} 00:33:56.233561 --- ParallelTerminationStrategy: PID 3092 died... 00:33:56.253092 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3092): Terminated: ok {rc=0} 00:33:56.340601 bus /sierra_3: Setting Powered False 00:33:57.439256 bus /sierra_3: Setting Powered False 00:33:58.554913 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 handover_2G:trx-lms-limenet-micro+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 --------------------------------------------------------------------- 00:33:59.804196 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:33:59.809634 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 00:33:59.867687 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 00:33:59.894203 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 00:33:59.946187 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 00:34:00.005491 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 00:34:00.031767 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 00:34:00.583606 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover.py ---------------------------------------------- 00:34:00.588618 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:34:00.599686 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 00:34:00.643444 tst handover.py: using LAC 24775 00:34:00.764164 tst handover.py: using RAC 40 00:34:00.912903 tst handover.py: using CellId 24775 00:34:01.069956 tst handover.py: using BVCI 24776 00:34:01.193791 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 00:34:01.245187 tst handover.py: using LAC 24776 00:34:01.369134 tst handover.py: using RAC 41 00:34:01.505200 tst handover.py: using CellId 24776 00:34:01.643226 tst handover.py: using BVCI 24777 00:34:01.784272 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:34:01.796180 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:34:01.807854 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:34:01.819351 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:34:01.830819 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:34:01.842289 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 00:34:01.958295 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 00:34:02.075690 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:34:02.557342 run create_hlr_db(pid=3098): Launched 00:34:02.680881 bus /sierra_2: Setting Powered False 00:34:03.744780 run create_hlr_db(pid=3098): Terminated: ok {rc=0} 00:34:04.150279 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3100): Launched 00:34:04.452648 run osmo-hlr_10.42.42.2(pid=3101): Launched 00:34:04.568115 run osmo-stp_10.42.42.5: Starting osmo-stp 00:34:05.063374 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3103): Launched 00:34:05.364803 run osmo-stp_10.42.42.5(pid=3104): Launched 00:34:05.479356 run osmo-msc_10.42.42.6: Starting osmo-msc 00:34:05.997472 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3106): Launched 00:34:06.298776 run osmo-msc_10.42.42.6(pid=3107): Launched 00:34:06.467365 run osmo-stp_10.42.42.5(pid=3104): ERR: Terminated: ERROR {rc=1} [trial-2366↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3104)] 00:34:06.595091 run osmo-stp_10.42.42.5(pid=3104): stdout: | (launched: 2022-12-10_00:34:05.309274) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:34:06.721855 run osmo-stp_10.42.42.5(pid=3104): stderr: | 20221210003405478 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210003405478 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210003405478 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210003405479 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210003405481 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210003405481 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210003405481 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:34:06.846694 run osmo-stp_10.42.42.5(pid=3104): stdout: | (launched: 2022-12-10_00:34:05.309274) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:34:06.966398 run osmo-stp_10.42.42.5(pid=3104): stderr: | 20221210003405478 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210003405478 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210003405478 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210003405479 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210003405481 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210003405481 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210003405481 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:34:07.110281 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3104): Process ended prematurely: osmo-stp_10.42.42.5(pid=3104) [trial-2366↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3104)] [trial-2366↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18] 00:34:07.118412 tst handover.py:18: Test FAILED (6.5 sec) 00:34:07.144069 run osmo-hlr_10.42.42.2(pid=3101): ERR: Terminated: ERROR {rc=237} [trial-2366↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3101)] 00:34:07.191015 run osmo-hlr_10.42.42.2(pid=3101): stdout: | (launched: 2022-12-10_00:34:04.397216) 00:34:07.239936 run osmo-hlr_10.42.42.2(pid=3101): stderr: | 20221210003404574 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210003404574 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210003404574 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210003404574 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210003404574 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210003404574 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210003404585 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/handover_2G:trx-lms-limenet-micro+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210003404594 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210003404594 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210003404594 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:34:07.308269 run osmo-msc_10.42.42.6(pid=3107): ERR: Terminated: ERROR {rc=2} [trial-2366↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3107)] 00:34:07.355275 run osmo-msc_10.42.42.6(pid=3107): stdout: | (launched: 2022-12-10_00:34:06.243126) 00:34:07.403779 run osmo-msc_10.42.42.6(pid=3107): stderr: | 20221210003406513 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210003406513 DLGLOBAL DEBUG validating counter group 0x7fca26137c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210003406513 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210003406513 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210003406513 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210003406513 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210003406515 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210003406515 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210003406516 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210003406516 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:34:07.452748 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3100): Terminating (SIGTERM) 00:34:07.491608 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3103): Terminating (SIGTERM) 00:34:07.530661 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3106): Terminating (SIGTERM) 00:34:07.569935 --- ParallelTerminationStrategy: PID 3100 died... 00:34:07.588702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3100): Terminated: ok {rc=0} 00:34:07.632158 --- ParallelTerminationStrategy: PID 3103 died... 00:34:07.650510 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3103): Terminated: ok {rc=0} 00:34:07.693566 --- ParallelTerminationStrategy: PID 3106 died... 00:34:07.711771 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3106): Terminated: ok {rc=0} 00:34:07.792906 bus /sierra_3: Setting Powered False 00:34:08.890393 bus /sierra_3: Setting Powered False 00:34:10.005817 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx --------------------------------------------------------------------- 00:34:11.270373 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:34:11.275765 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 00:34:11.333133 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 00:34:11.359489 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 00:34:11.411140 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 00:34:11.468535 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 00:34:11.495040 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 00:34:12.048333 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover.py ---------------------------------------------- 00:34:12.053430 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:34:12.064459 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 00:34:12.108029 tst handover.py: using LAC 24777 00:34:12.242150 tst handover.py: using RAC 42 00:34:12.370811 tst handover.py: using CellId 24777 00:34:12.496081 tst handover.py: using BVCI 24778 00:34:12.614788 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 00:34:12.662800 tst handover.py: using LAC 24778 00:34:12.789858 tst handover.py: using RAC 43 00:34:12.915842 tst handover.py: using CellId 24778 00:34:13.042997 tst handover.py: using BVCI 24779 00:34:13.161492 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:34:13.172770 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:34:13.184536 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:34:13.196469 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:34:13.208415 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:34:13.220153 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 00:34:13.337424 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 00:34:13.457340 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:34:13.931218 run create_hlr_db(pid=3112): Launched 00:34:14.055394 bus /sierra_2: Setting Powered False 00:34:15.119377 run create_hlr_db(pid=3112): Terminated: ok {rc=0} 00:34:15.541733 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3114): Launched 00:34:15.872059 run osmo-hlr_10.42.42.2(pid=3115): Launched 00:34:16.059556 run osmo-stp_10.42.42.5: Starting osmo-stp 00:34:16.785969 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3117): Launched 00:34:17.157626 run osmo-stp_10.42.42.5(pid=3118): Launched 00:34:17.438014 run osmo-msc_10.42.42.6: Starting osmo-msc 00:34:18.021776 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3120): Launched 00:34:18.346302 run osmo-msc_10.42.42.6(pid=3121): Launched 00:34:18.526982 run osmo-stp_10.42.42.5(pid=3118): ERR: Terminated: ERROR {rc=1} [trial-2366↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3118)] 00:34:18.663386 run osmo-stp_10.42.42.5(pid=3118): stdout: | (launched: 2022-12-10_00:34:17.098180) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:34:18.800060 run osmo-stp_10.42.42.5(pid=3118): stderr: | 20221210003417342 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210003417342 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210003417342 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210003417343 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210003417343 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210003417344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210003417344 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:34:18.935542 run osmo-stp_10.42.42.5(pid=3118): stdout: | (launched: 2022-12-10_00:34:17.098180) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:34:19.064511 run osmo-stp_10.42.42.5(pid=3118): stderr: | 20221210003417342 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210003417342 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210003417342 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210003417343 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210003417343 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210003417344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210003417344 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:34:19.218660 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3118): Process ended prematurely: osmo-stp_10.42.42.5(pid=3118) [trial-2366↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3118)] [trial-2366↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18] 00:34:19.227808 tst handover.py:18: Test FAILED (7.2 sec) 00:34:19.256209 run osmo-hlr_10.42.42.2(pid=3115): ERR: Terminated: ERROR {rc=237} [trial-2366↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3115)] 00:34:19.306945 run osmo-hlr_10.42.42.2(pid=3115): stdout: | (launched: 2022-12-10_00:34:15.806535) 00:34:19.359331 run osmo-hlr_10.42.42.2(pid=3115): stderr: | 20221210003416152 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210003416152 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210003416152 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210003416152 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210003416152 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210003416152 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210003416178 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210003416199 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210003416200 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210003416200 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:34:19.431765 run osmo-msc_10.42.42.6(pid=3121): ERR: Terminated: ERROR {rc=2} [trial-2366↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3121)] 00:34:19.481904 run osmo-msc_10.42.42.6(pid=3121): stdout: | (launched: 2022-12-10_00:34:18.286730) 00:34:19.533820 run osmo-msc_10.42.42.6(pid=3121): stderr: | 20221210003418607 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210003418607 DLGLOBAL DEBUG validating counter group 0x7fee6d64bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210003418607 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210003418607 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210003418607 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210003418607 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210003418609 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210003418610 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210003418610 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210003418610 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:34:19.586114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3114): Terminating (SIGTERM) 00:34:19.627855 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3117): Terminating (SIGTERM) 00:34:19.669709 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3120): Terminating (SIGTERM) 00:34:19.711939 --- ParallelTerminationStrategy: PID 3114 died... 00:34:19.731892 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3114): Terminated: ok {rc=0} 00:34:19.778756 --- ParallelTerminationStrategy: PID 3117 died... 00:34:19.798220 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3117): Terminated: ok {rc=0} 00:34:19.845144 --- ParallelTerminationStrategy: PID 3120 died... 00:34:19.864641 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3120): Terminated: ok {rc=0} 00:34:19.953166 bus /sierra_3: Setting Powered False 00:34:21.052088 bus /sierra_3: Setting Powered False 00:34:22.168795 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 handover_2G:trx-sysmocell5000+bts1-sysmo --------------------------------------------------------------------- 00:34:23.435151 tst handover_2G:trx-sysmocell5000+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:34:23.440389 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x bts (candidates: 11) 00:34:23.490843 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 00:34:23.517197 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x modem (candidates: 12) 00:34:23.567670 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x bts (candidates: 11) 00:34:23.620692 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 00:34:23.648586 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x modem (candidates: 12) 00:34:24.198734 tst handover_2G:trx-sysmocell5000+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 handover_2G:trx-sysmocell5000+bts1-sysmo handover.py ---------------------------------------------- 00:34:24.204097 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:34:24.215281 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 00:34:24.263993 tst handover.py: using LAC 24779 00:34:24.391904 tst handover.py: using RAC 44 00:34:24.518499 tst handover.py: using CellId 24779 00:34:24.645833 tst handover.py: using BVCI 24780 00:34:24.763918 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 00:34:24.798317 tst handover.py: using LAC 24780 00:34:24.923607 tst handover.py: using RAC 45 00:34:25.048906 tst handover.py: using CellId 24780 00:34:25.173777 tst handover.py: using BVCI 24781 00:34:25.291858 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:34:25.303209 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:34:25.314935 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:34:25.326477 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:34:25.338076 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 00:34:25.349444 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 00:34:25.465270 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 00:34:25.584563 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:34:26.058912 run create_hlr_db(pid=3126): Launched 00:34:26.182290 bus /sierra_2: Setting Powered False 00:34:27.246456 run create_hlr_db(pid=3126): Terminated: ok {rc=0} 00:34:27.668781 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3128): Launched 00:34:27.991561 run osmo-hlr_10.42.42.2(pid=3129): Launched 00:34:28.116122 run osmo-stp_10.42.42.5: Starting osmo-stp 00:34:28.649827 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3131): Launched 00:34:28.972739 run osmo-stp_10.42.42.5(pid=3132): Launched 00:34:29.097490 run osmo-msc_10.42.42.6: Starting osmo-msc 00:34:29.653860 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3134): Launched 00:34:29.976563 run osmo-msc_10.42.42.6(pid=3135): Launched 00:34:30.157685 run osmo-stp_10.42.42.5(pid=3132): ERR: Terminated: ERROR {rc=1} [trial-2366↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3132)] 00:34:30.294160 run osmo-stp_10.42.42.5(pid=3132): stdout: | (launched: 2022-12-10_00:34:28.913993) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:34:30.431492 run osmo-stp_10.42.42.5(pid=3132): stderr: | 20221210003429104 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210003429105 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210003429105 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210003429105 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210003429108 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210003429108 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210003429108 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:34:30.567346 run osmo-stp_10.42.42.5(pid=3132): stdout: | (launched: 2022-12-10_00:34:28.913993) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:34:30.695852 run osmo-stp_10.42.42.5(pid=3132): stderr: | 20221210003429104 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210003429105 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210003429105 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210003429105 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210003429108 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210003429108 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210003429108 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:34:30.854017 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3132): Process ended prematurely: osmo-stp_10.42.42.5(pid=3132) [trial-2366↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3132)] [trial-2366↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18] 00:34:30.863388 tst handover.py:18: Test FAILED (6.7 sec) 00:34:30.900429 run osmo-hlr_10.42.42.2(pid=3129): ERR: Terminated: ERROR {rc=237} [trial-2366↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3129)] 00:34:30.953589 run osmo-hlr_10.42.42.2(pid=3129): stdout: | (launched: 2022-12-10_00:34:27.932652) 00:34:31.007842 run osmo-hlr_10.42.42.2(pid=3129): stderr: | 20221210003428129 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210003428129 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210003428129 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210003428130 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210003428130 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210003428130 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210003428142 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/handover_2G:trx-sysmocell5000+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210003428150 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210003428150 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210003428150 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:34:31.083407 run osmo-msc_10.42.42.6(pid=3135): ERR: Terminated: ERROR {rc=2} [trial-2366↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3135)] 00:34:31.135962 run osmo-msc_10.42.42.6(pid=3135): stdout: | (launched: 2022-12-10_00:34:29.917737) 00:34:31.190127 run osmo-msc_10.42.42.6(pid=3135): stderr: | 20221210003430238 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210003430238 DLGLOBAL DEBUG validating counter group 0x7ffa8742dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210003430238 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210003430238 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210003430238 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210003430238 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210003430240 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210003430240 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210003430240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210003430241 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:34:31.244842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3128): Terminating (SIGTERM) 00:34:31.289278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3131): Terminating (SIGTERM) 00:34:31.333869 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3134): Terminating (SIGTERM) 00:34:31.378751 --- ParallelTerminationStrategy: PID 3128 died... 00:34:31.399716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3128): Terminated: ok {rc=0} 00:34:31.449254 --- ParallelTerminationStrategy: PID 3131 died... 00:34:31.470092 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3131): Terminated: ok {rc=0} 00:34:31.519342 --- ParallelTerminationStrategy: PID 3134 died... 00:34:31.540268 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3134): Terminated: ok {rc=0} 00:34:31.633467 bus /sierra_3: Setting Powered False 00:34:32.734101 bus /sierra_3: Setting Powered False 00:34:33.849331 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 handover_2G:trx-sysmocell5000+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 handover_2G:trx-sysmocell5000+bts1-trx-b200 --------------------------------------------------------------------- 00:34:35.107101 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:34:35.113178 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 00:34:35.178156 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 00:34:35.205603 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 00:34:35.258307 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 00:34:35.327409 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 00:34:35.354654 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 00:34:35.902591 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 handover_2G:trx-sysmocell5000+bts1-trx-b200 handover.py ---------------------------------------------- 00:34:35.907875 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:34:35.919338 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 00:34:35.968809 tst handover.py: using LAC 24781 00:34:36.095960 tst handover.py: using RAC 46 00:34:36.223107 tst handover.py: using CellId 24781 00:34:36.351543 tst handover.py: using BVCI 24782 00:34:36.471760 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 00:34:36.521092 tst handover.py: using LAC 24782 00:34:36.649383 tst handover.py: using RAC 47 00:34:36.777574 tst handover.py: using CellId 24782 00:34:36.906059 tst handover.py: using BVCI 24783 00:34:37.026132 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:34:37.037584 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:34:37.048663 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:34:37.060222 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:34:37.071751 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:34:37.083182 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 00:34:37.198976 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 00:34:37.314739 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:34:37.757661 run create_hlr_db(pid=3140): Launched 00:34:37.882284 bus /sierra_2: Setting Powered False 00:34:38.942464 run create_hlr_db(pid=3140): Terminated: ok {rc=0} 00:34:39.338818 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3142): Launched 00:34:39.641507 run osmo-hlr_10.42.42.2(pid=3143): Launched 00:34:39.758205 run osmo-stp_10.42.42.5: Starting osmo-stp 00:34:40.253368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3145): Launched 00:34:40.555842 run osmo-stp_10.42.42.5(pid=3146): Launched 00:34:40.671503 run osmo-msc_10.42.42.6: Starting osmo-msc 00:34:41.191671 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3148): Launched 00:34:41.493874 run osmo-msc_10.42.42.6(pid=3149): Launched 00:34:41.662091 run osmo-stp_10.42.42.5(pid=3146): ERR: Terminated: ERROR {rc=1} [trial-2366↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3146)] 00:34:41.788681 run osmo-stp_10.42.42.5(pid=3146): stdout: | (launched: 2022-12-10_00:34:40.500484) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:34:41.915408 run osmo-stp_10.42.42.5(pid=3146): stderr: | 20221210003440671 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210003440671 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210003440672 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210003440672 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210003440673 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210003440673 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210003440673 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:34:42.040671 run osmo-stp_10.42.42.5(pid=3146): stdout: | (launched: 2022-12-10_00:34:40.500484) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:34:42.160265 run osmo-stp_10.42.42.5(pid=3146): stderr: | 20221210003440671 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210003440671 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210003440672 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210003440672 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210003440673 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210003440673 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210003440673 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:34:42.303295 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3146): Process ended prematurely: osmo-stp_10.42.42.5(pid=3146) [trial-2366↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3146)] [trial-2366↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18] 00:34:42.311635 tst handover.py:18: Test FAILED (6.4 sec) 00:34:42.337864 run osmo-hlr_10.42.42.2(pid=3143): ERR: Terminated: ERROR {rc=237} [trial-2366↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3143)] 00:34:42.385076 run osmo-hlr_10.42.42.2(pid=3143): stdout: | (launched: 2022-12-10_00:34:39.585765) 00:34:42.434042 run osmo-hlr_10.42.42.2(pid=3143): stderr: | 20221210003439763 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210003439763 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210003439763 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210003439763 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210003439763 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210003439763 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210003439775 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/handover_2G:trx-sysmocell5000+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210003439785 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210003439785 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210003439785 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:34:42.502377 run osmo-msc_10.42.42.6(pid=3149): ERR: Terminated: ERROR {rc=2} [trial-2366↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3149)] 00:34:42.549653 run osmo-msc_10.42.42.6(pid=3149): stdout: | (launched: 2022-12-10_00:34:41.438310) 00:34:42.598132 run osmo-msc_10.42.42.6(pid=3149): stderr: | 20221210003441710 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210003441710 DLGLOBAL DEBUG validating counter group 0x7fd841f95c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210003441710 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210003441710 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210003441710 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210003441710 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210003441713 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210003441713 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210003441714 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210003441714 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:34:42.647237 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3142): Terminating (SIGTERM) 00:34:42.686536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3145): Terminating (SIGTERM) 00:34:42.725940 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3148): Terminating (SIGTERM) 00:34:42.765817 --- ParallelTerminationStrategy: PID 3142 died... 00:34:42.784767 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3142): Terminated: ok {rc=0} 00:34:42.828822 --- ParallelTerminationStrategy: PID 3145 died... 00:34:42.847765 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3145): Terminated: ok {rc=0} 00:34:42.891182 --- ParallelTerminationStrategy: PID 3148 died... 00:34:42.910244 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3148): Terminated: ok {rc=0} 00:34:42.995010 bus /sierra_3: Setting Powered False 00:34:44.094808 bus /sierra_3: Setting Powered False 00:34:45.211480 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 handover_2G:trx-sysmocell5000+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 handover_2G:trx-sysmocell5000+bts1-trx-umtrx --------------------------------------------------------------------- 00:34:46.523615 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:34:46.531894 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 00:34:46.598282 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 00:34:46.625872 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 00:34:46.680540 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 00:34:46.772284 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 00:34:46.801978 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 00:34:47.317704 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover.py ---------------------------------------------- 00:34:47.323552 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:34:47.335096 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 00:34:47.385241 tst handover.py: using LAC 24783 00:34:47.503662 tst handover.py: using RAC 48 00:34:47.632357 tst handover.py: using CellId 24783 00:34:47.758629 tst handover.py: using BVCI 24784 00:34:47.876303 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 00:34:47.931141 tst handover.py: using LAC 24784 00:34:48.057798 tst handover.py: using RAC 49 00:34:48.184689 tst handover.py: using CellId 24784 00:34:48.310167 tst handover.py: using BVCI 24785 00:34:48.428486 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:34:48.440043 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:34:48.451331 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:34:48.462885 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:34:48.474682 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:34:48.486380 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 00:34:48.602506 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 00:34:48.716671 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:34:49.159125 run create_hlr_db(pid=3154): Launched 00:34:49.283120 bus /sierra_2: Setting Powered False 00:34:50.343409 run create_hlr_db(pid=3154): Terminated: ok {rc=0} 00:34:50.737626 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3156): Launched 00:34:51.039585 run osmo-hlr_10.42.42.2(pid=3157): Launched 00:34:51.155061 run osmo-stp_10.42.42.5: Starting osmo-stp 00:34:51.664308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3159): Launched 00:34:51.965250 run osmo-stp_10.42.42.5(pid=3160): Launched 00:34:52.080429 run osmo-msc_10.42.42.6: Starting osmo-msc 00:34:52.599035 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3162): Launched 00:34:52.899509 run osmo-msc_10.42.42.6(pid=3163): Launched 00:34:53.067846 run osmo-stp_10.42.42.5(pid=3160): ERR: Terminated: ERROR {rc=1} [trial-2366↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3160)] 00:34:53.194509 run osmo-stp_10.42.42.5(pid=3160): stdout: | (launched: 2022-12-10_00:34:51.909875) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:34:53.320601 run osmo-stp_10.42.42.5(pid=3160): stderr: | 20221210003452080 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210003452080 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210003452080 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210003452081 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210003452081 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210003452081 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210003452081 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:34:53.446157 run osmo-stp_10.42.42.5(pid=3160): stdout: | (launched: 2022-12-10_00:34:51.909875) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:34:53.565743 run osmo-stp_10.42.42.5(pid=3160): stderr: | 20221210003452080 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210003452080 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210003452080 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210003452081 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210003452081 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210003452081 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210003452081 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:34:53.708287 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3160): Process ended prematurely: osmo-stp_10.42.42.5(pid=3160) [trial-2366↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3160)] [trial-2366↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18] 00:34:53.716424 tst handover.py:18: Test FAILED (6.4 sec) 00:34:53.742224 run osmo-hlr_10.42.42.2(pid=3157): ERR: Terminated: ERROR {rc=237} [trial-2366↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3157)] 00:34:53.789713 run osmo-hlr_10.42.42.2(pid=3157): stdout: | (launched: 2022-12-10_00:34:50.984213) 00:34:53.839010 run osmo-hlr_10.42.42.2(pid=3157): stderr: | 20221210003451161 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210003451161 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210003451161 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210003451161 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210003451161 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210003451161 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210003451173 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/handover_2G:trx-sysmocell5000+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210003451183 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210003451183 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210003451183 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:34:53.907446 run osmo-msc_10.42.42.6(pid=3163): ERR: Terminated: ERROR {rc=2} [trial-2366↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3163)] 00:34:53.954831 run osmo-msc_10.42.42.6(pid=3163): stdout: | (launched: 2022-12-10_00:34:52.844274) 00:34:54.003760 run osmo-msc_10.42.42.6(pid=3163): stderr: | 20221210003453117 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210003453118 DLGLOBAL DEBUG validating counter group 0x7f16b177ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210003453118 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221210003453119 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210003453119 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210003453119 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210003453121 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210003453121 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210003453121 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210003453121 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:34:54.053245 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3156): Terminating (SIGTERM) 00:34:54.092536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3159): Terminating (SIGTERM) 00:34:54.131879 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3162): Terminating (SIGTERM) 00:34:54.171473 --- ParallelTerminationStrategy: PID 3156 died... 00:34:54.190477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3156): Terminated: ok {rc=0} 00:34:54.234741 --- ParallelTerminationStrategy: PID 3159 died... 00:34:54.253344 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3159): Terminated: ok {rc=0} 00:34:54.297071 --- ParallelTerminationStrategy: PID 3162 died... 00:34:54.315654 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3162): Terminated: ok {rc=0} 00:34:54.399547 bus /sierra_3: Setting Powered False 00:34:55.496055 bus /sierra_3: Setting Powered False 00:34:56.613765 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 handover_2G:trx-sysmocell5000+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 handover_2G:sysmo+bts1-trx-b200 --------------------------------------------------------------------- 00:34:57.887281 tst handover_2G:sysmo+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:34:57.892199 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 00:34:57.942861 tst handover_2G:sysmo+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 00:34:57.969658 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 00:34:58.019137 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 00:34:58.069296 tst handover_2G:sysmo+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 00:34:58.095960 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 00:34:58.650215 tst handover_2G:sysmo+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 handover_2G:sysmo+bts1-trx-b200 handover.py ---------------------------------------------- 00:34:58.655224 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:34:58.666182 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 00:34:58.700842 tst handover.py: using LAC 24785 00:34:58.817448 tst handover.py: using RAC 50 00:34:58.937630 tst handover.py: using CellId 24785 00:34:59.057542 tst handover.py: using BVCI 24786 00:34:59.177647 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 00:34:59.225436 tst handover.py: using LAC 24786 00:34:59.343227 tst handover.py: using RAC 51 00:34:59.460325 tst handover.py: using CellId 24786 00:34:59.577281 tst handover.py: using BVCI 24787 00:34:59.695889 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:34:59.707323 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:34:59.718580 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:34:59.729987 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:34:59.741635 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 00:34:59.752795 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 00:34:59.870572 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 00:34:59.986574 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:35:00.428766 run create_hlr_db(pid=3168): Launched 00:35:00.551388 bus /sierra_2: Setting Powered False 00:35:01.612577 run create_hlr_db(pid=3168): Terminated: ok {rc=0} 00:35:02.051055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3173): Launched 00:35:02.390326 run osmo-hlr_10.42.42.2(pid=3174): Launched 00:35:02.514755 run osmo-stp_10.42.42.5: Starting osmo-stp 00:35:03.047024 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3176): Launched 00:35:03.370487 run osmo-stp_10.42.42.5(pid=3177): Launched 00:35:03.494212 run osmo-msc_10.42.42.6: Starting osmo-msc 00:35:04.050518 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3179): Launched 00:35:04.373328 run osmo-msc_10.42.42.6(pid=3180): Launched 00:35:04.554669 run osmo-stp_10.42.42.5(pid=3177): ERR: Terminated: ERROR {rc=1} [trial-2366↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3177)] 00:35:04.692028 run osmo-stp_10.42.42.5(pid=3177): stdout: | (launched: 2022-12-10_00:35:03.311343) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:35:04.829346 run osmo-stp_10.42.42.5(pid=3177): stderr: | 20221210003503506 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210003503506 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210003503506 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210003503507 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210003503507 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210003503507 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210003503507 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:35:04.965160 run osmo-stp_10.42.42.5(pid=3177): stdout: | (launched: 2022-12-10_00:35:03.311343) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:35:05.093944 run osmo-stp_10.42.42.5(pid=3177): stderr: | 20221210003503506 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210003503506 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210003503506 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210003503507 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210003503507 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210003503507 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210003503507 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:35:05.247756 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3177): Process ended prematurely: osmo-stp_10.42.42.5(pid=3177) [trial-2366↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3177)] [trial-2366↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18] 00:35:05.256778 tst handover.py:18: Test FAILED (6.6 sec) 00:35:05.284273 run osmo-hlr_10.42.42.2(pid=3174): ERR: Terminated: ERROR {rc=237} [trial-2366↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3174)] 00:35:05.334721 run osmo-hlr_10.42.42.2(pid=3174): stdout: | (launched: 2022-12-10_00:35:02.331609) 00:35:05.386037 run osmo-hlr_10.42.42.2(pid=3174): stderr: | 20221210003502527 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210003502527 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210003502527 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210003502527 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210003502527 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210003502527 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210003502540 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/handover_2G:sysmo+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210003502550 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210003502550 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210003502550 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:35:05.457594 run osmo-msc_10.42.42.6(pid=3180): ERR: Terminated: ERROR {rc=2} [trial-2366↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3180)] 00:35:05.507275 run osmo-msc_10.42.42.6(pid=3180): stdout: | (launched: 2022-12-10_00:35:04.313999) 00:35:05.558564 run osmo-msc_10.42.42.6(pid=3180): stderr: | 20221210003504635 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210003504635 DLGLOBAL DEBUG validating counter group 0x7f0db7f39c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210003504635 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210003504636 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210003504636 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210003504636 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210003504638 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210003504638 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210003504638 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210003504638 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:35:05.610281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3173): Terminating (SIGTERM) 00:35:05.651844 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3176): Terminating (SIGTERM) 00:35:05.693726 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3179): Terminating (SIGTERM) 00:35:05.735532 --- ParallelTerminationStrategy: PID 3173 died... 00:35:05.755399 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3173): Terminated: ok {rc=0} 00:35:05.802030 --- ParallelTerminationStrategy: PID 3176 died... 00:35:05.821517 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3176): Terminated: ok {rc=0} 00:35:05.867634 --- ParallelTerminationStrategy: PID 3179 died... 00:35:05.887120 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3179): Terminated: ok {rc=0} 00:35:05.974069 bus /sierra_3: Setting Powered False 00:35:07.072066 bus /sierra_3: Setting Powered False 00:35:08.185741 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 handover_2G:sysmo+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 handover_2G:sysmo+bts1-trx-umtrx --------------------------------------------------------------------- 00:35:09.435458 tst handover_2G:sysmo+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:35:09.440328 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 00:35:09.489758 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 00:35:09.516633 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 00:35:09.567726 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 00:35:09.616352 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 00:35:09.642594 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 00:35:10.195220 tst handover_2G:sysmo+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 handover_2G:sysmo+bts1-trx-umtrx handover.py ---------------------------------------------- 00:35:10.200285 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:35:10.211355 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 00:35:10.245341 tst handover.py: using LAC 24787 00:35:10.366021 tst handover.py: using RAC 52 00:35:10.494183 tst handover.py: using CellId 24787 00:35:10.621192 tst handover.py: using BVCI 24788 00:35:10.740332 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 00:35:10.789182 tst handover.py: using LAC 24788 00:35:10.916312 tst handover.py: using RAC 53 00:35:11.042715 tst handover.py: using CellId 24788 00:35:11.168926 tst handover.py: using BVCI 24789 00:35:11.286645 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:35:11.297791 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:35:11.308778 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:35:11.320025 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:35:11.331566 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:35:11.342906 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 00:35:11.463092 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 00:35:11.582900 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:35:12.056621 run create_hlr_db(pid=3185): Launched 00:35:12.179160 bus /sierra_2: Setting Powered False 00:35:13.242474 run create_hlr_db(pid=3185): Terminated: ok {rc=0} 00:35:13.650419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3187): Launched 00:35:13.950608 run osmo-hlr_10.42.42.2(pid=3188): Launched 00:35:14.065784 run osmo-stp_10.42.42.5: Starting osmo-stp 00:35:14.574926 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3190): Launched 00:35:14.874903 run osmo-stp_10.42.42.5(pid=3191): Launched 00:35:14.990422 run osmo-msc_10.42.42.6: Starting osmo-msc 00:35:15.527389 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3193): Launched 00:35:15.834711 run osmo-msc_10.42.42.6(pid=3194): Launched 00:35:16.199780 run osmo-stp_10.42.42.5(pid=3191): ERR: Terminated: ERROR {rc=1} [trial-2366↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3191)] 00:35:16.419770 run osmo-stp_10.42.42.5(pid=3191): stdout: | (launched: 2022-12-10_00:35:14.819687) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:35:16.585213 run osmo-stp_10.42.42.5(pid=3191): stderr: | 20221210003514989 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210003514989 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210003514990 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210003514990 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210003514990 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210003514990 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210003514991 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:35:16.716086 run osmo-stp_10.42.42.5(pid=3191): stdout: | (launched: 2022-12-10_00:35:14.819687) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:35:16.840097 run osmo-stp_10.42.42.5(pid=3191): stderr: | 20221210003514989 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210003514989 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210003514990 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210003514990 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210003514990 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210003514990 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210003514991 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:35:16.987671 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3191): Process ended prematurely: osmo-stp_10.42.42.5(pid=3191) [trial-2366↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3191)] [trial-2366↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18] 00:35:16.996882 tst handover.py:18: Test FAILED (6.8 sec) 00:35:17.025023 run osmo-hlr_10.42.42.2(pid=3188): ERR: Terminated: ERROR {rc=237} [trial-2366↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3188)] 00:35:17.074304 run osmo-hlr_10.42.42.2(pid=3188): stdout: | (launched: 2022-12-10_00:35:13.895617) 00:35:17.125340 run osmo-hlr_10.42.42.2(pid=3188): stderr: | 20221210003514069 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210003514069 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210003514070 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210003514070 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210003514070 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210003514070 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210003514082 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/handover_2G:sysmo+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210003514090 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210003514091 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210003514091 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:35:17.195808 run osmo-msc_10.42.42.6(pid=3194): ERR: Terminated: ERROR {rc=2} [trial-2366↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3194)] 00:35:17.244731 run osmo-msc_10.42.42.6(pid=3194): stdout: | (launched: 2022-12-10_00:35:15.773744) 00:35:17.295245 run osmo-msc_10.42.42.6(pid=3194): stderr: | 20221210003516204 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210003516205 DLGLOBAL DEBUG validating counter group 0x7f25137b7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210003516205 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210003516205 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210003516205 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210003516208 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210003516214 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210003516215 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210003516215 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210003516217 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:35:17.346321 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3187): Terminating (SIGTERM) 00:35:17.386768 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3190): Terminating (SIGTERM) 00:35:17.426120 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3193): Terminating (SIGTERM) 00:35:17.465860 --- ParallelTerminationStrategy: PID 3187 died... 00:35:17.484822 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3187): Terminated: ok {rc=0} 00:35:17.528471 --- ParallelTerminationStrategy: PID 3190 died... 00:35:17.547016 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3190): Terminated: ok {rc=0} 00:35:17.590989 --- ParallelTerminationStrategy: PID 3193 died... 00:35:17.609695 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3193): Terminated: ok {rc=0} 00:35:17.694761 bus /sierra_3: Setting Powered False 00:35:18.794839 bus /sierra_3: Setting Powered False 00:35:19.907029 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 handover_2G:sysmo+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2366 handover_2G:trx-b200+bts1-trx-umtrx --------------------------------------------------------------------- 00:35:21.159022 tst handover_2G:trx-b200+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 00:35:21.164610 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 00:35:21.228575 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 00:35:21.256103 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 00:35:21.307011 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 00:35:21.371825 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 00:35:21.399455 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 00:35:21.952199 tst handover_2G:trx-b200+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts Ettus B200 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2366 handover_2G:trx-b200+bts1-trx-umtrx handover.py ---------------------------------------------- 00:35:21.957673 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:35:21.968799 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 00:35:22.017313 tst handover.py: using LAC 24789 00:35:22.142240 tst handover.py: using RAC 54 00:35:22.267387 tst handover.py: using CellId 24789 00:35:22.392919 tst handover.py: using BVCI 24790 00:35:22.510541 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 00:35:22.557205 tst handover.py: using LAC 24790 00:35:22.681707 tst handover.py: using RAC 55 00:35:22.808387 tst handover.py: using CellId 24790 00:35:22.935387 tst handover.py: using BVCI 24791 00:35:23.053504 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:35:23.064725 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:35:23.075938 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:35:23.087381 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:35:23.098698 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 00:35:23.110120 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 00:35:23.225709 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 00:35:23.343443 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:35:23.786760 run create_hlr_db(pid=3199): Launched 00:35:23.909654 bus /sierra_2: Setting Powered False 00:35:24.970490 run create_hlr_db(pid=3199): Terminated: ok {rc=0} 00:35:25.384857 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3201): Launched 00:35:25.709206 run osmo-hlr_10.42.42.2(pid=3202): Launched 00:35:25.834211 run osmo-stp_10.42.42.5: Starting osmo-stp 00:35:26.365192 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3204): Launched 00:35:26.687619 run osmo-stp_10.42.42.5(pid=3205): Launched 00:35:26.811685 run osmo-msc_10.42.42.6: Starting osmo-msc 00:35:27.369165 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3207): Launched 00:35:27.692009 run osmo-msc_10.42.42.6(pid=3208): Launched 00:35:27.873794 run osmo-stp_10.42.42.5(pid=3205): ERR: Terminated: ERROR {rc=1} [trial-2366↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3205)] 00:35:28.010583 run osmo-stp_10.42.42.5(pid=3205): stdout: | (launched: 2022-12-10_00:35:26.628847) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:35:28.147273 run osmo-stp_10.42.42.5(pid=3205): stderr: | 20221210003526823 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210003526823 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210003526823 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210003526823 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210003526824 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210003526824 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210003526824 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:35:28.283509 run osmo-stp_10.42.42.5(pid=3205): stdout: | (launched: 2022-12-10_00:35:26.628847) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 00:35:28.412806 run osmo-stp_10.42.42.5(pid=3205): stderr: | 20221210003526823 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221210003526823 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221210003526823 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221210003526823 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210003526824 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210003526824 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210003526824 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 00:35:28.567000 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3205): Process ended prematurely: osmo-stp_10.42.42.5(pid=3205) [trial-2366↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3205)] [trial-2366↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18] 00:35:28.575614 tst handover.py:18: Test FAILED (6.6 sec) 00:35:28.603388 run osmo-hlr_10.42.42.2(pid=3202): ERR: Terminated: ERROR {rc=237} [trial-2366↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3202)] 00:35:28.653487 run osmo-hlr_10.42.42.2(pid=3202): stdout: | (launched: 2022-12-10_00:35:25.649855) 00:35:28.705370 run osmo-hlr_10.42.42.2(pid=3202): stderr: | 20221210003525850 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221210003525850 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221210003525850 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221210003525850 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221210003525850 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221210003525850 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221210003525861 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/handover_2G:trx-b200+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221210003525869 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210003525870 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210003525870 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 00:35:28.777740 run osmo-msc_10.42.42.6(pid=3208): ERR: Terminated: ERROR {rc=2} [trial-2366↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3208)] 00:35:28.827876 run osmo-msc_10.42.42.6(pid=3208): stdout: | (launched: 2022-12-10_00:35:27.633052) 00:35:28.879800 run osmo-msc_10.42.42.6(pid=3208): stderr: | 20221210003527954 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221210003527954 DLGLOBAL DEBUG validating counter group 0x7f15bc996c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221210003527955 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221210003527955 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221210003527955 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221210003527955 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221210003527957 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221210003527957 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210003527957 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210003527957 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 00:35:28.931922 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3201): Terminating (SIGTERM) 00:35:28.973700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3204): Terminating (SIGTERM) 00:35:29.015568 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3207): Terminating (SIGTERM) 00:35:29.057804 --- ParallelTerminationStrategy: PID 3201 died... 00:35:29.077799 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3201): Terminated: ok {rc=0} 00:35:29.124510 --- ParallelTerminationStrategy: PID 3204 died... 00:35:29.143915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3204): Terminated: ok {rc=0} 00:35:29.190718 --- ParallelTerminationStrategy: PID 3207 died... 00:35:29.210226 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3207): Terminated: ok {rc=0} 00:35:29.298132 bus /sierra_3: Setting Powered False 00:35:30.395724 bus /sierra_3: Setting Powered False 00:35:31.524605 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2366 handover_2G:trx-b200+bts1-trx-umtrx FAIL --------------------------------------------------------------------- 00:35:32.789712 tst trial-2366: Storing JUnit report in /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366/run.2022-12-09_23-11-33/trial-2366.xml -------------------------------------------------------------------------------------------- trial-2366 FAIL -------------------------------------------------------------------------------------------- 00:35:34.717490 tst trial-2366: trial-2366: FAIL, 200 suites failed FAIL: nitb_sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (5.1 sec) Error: osmo-nitb_10.42.42.2(pid=28427): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28427) [trial-2366↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28427)] FAIL: sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (14.2 sec) Error: osmo-stp_10.42.42.5(pid=28437): Process ended prematurely: osmo-stp_10.42.42.5(pid=28437) [trial-2366↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28437)] FAIL: nitb_ussd:sysmo (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=28447): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28447) [trial-2366↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28447)] FAIL: ussd:sysmo (fail: 1) FAIL: assert_extension.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=28457): Process ended prematurely: osmo-stp_10.42.42.5(pid=28457) [trial-2366↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28457)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=28471): Process ended prematurely: osmo-stp_10.42.42.5(pid=28471) [trial-2366↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28471)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=28482): Process ended prematurely: osmo-stp_10.42.42.5(pid=28482) [trial-2366↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28482)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=28497): Process ended prematurely: osmo-stp_10.42.42.5(pid=28497) [trial-2366↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28497)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=28511): Process ended prematurely: osmo-stp_10.42.42.5(pid=28511) [trial-2366↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28511)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=28525): Process ended prematurely: osmo-stp_10.42.42.5(pid=28525) [trial-2366↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28525)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=28536): Process ended prematurely: osmo-stp_10.42.42.5(pid=28536) [trial-2366↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28536)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28551): Process ended prematurely: osmo-stp_10.42.42.5(pid=28551) [trial-2366↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28551)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=28562): Process ended prematurely: osmo-stp_10.42.42.5(pid=28562) [trial-2366↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28562)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=28576): Process ended prematurely: osmo-stp_10.42.42.5(pid=28576) [trial-2366↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28576)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28587): Process ended prematurely: osmo-stp_10.42.42.5(pid=28587) [trial-2366↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28587)] FAIL: voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=28602): Process ended prematurely: osmo-stp_10.42.42.5(pid=28602) [trial-2366↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28602)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28613): Process ended prematurely: osmo-stp_10.42.42.5(pid=28613) [trial-2366↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28613)] FAIL: voice:sysmo+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=28627): Process ended prematurely: osmo-stp_10.42.42.5(pid=28627) [trial-2366↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28627)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=28638): Process ended prematurely: osmo-stp_10.42.42.5(pid=28638) [trial-2366↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28638)] FAIL: emergency:sysmo (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28655): Process ended prematurely: osmo-stp_10.42.42.5(pid=28655) [trial-2366↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28655)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28666): Process ended prematurely: osmo-stp_10.42.42.5(pid=28666) [trial-2366↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28666)] FAIL: gprs:sysmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.6 sec) Error: osmo-stp_10.42.42.5(pid=28684): Process ended prematurely: osmo-stp_10.42.42.5(pid=28684) [trial-2366↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28684)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=28696): Process ended prematurely: osmo-stp_10.42.42.5(pid=28696) [trial-2366↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28696)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=28714): Process ended prematurely: osmo-stp_10.42.42.5(pid=28714) [trial-2366↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28714)] FAIL: ping.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=28724): Process ended prematurely: osmo-stp_10.42.42.5(pid=28724) [trial-2366↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28724)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=28734): Process ended prematurely: osmo-stp_10.42.42.5(pid=28734) [trial-2366↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28734)] FAIL: gprs:sysmo+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=28751): Process ended prematurely: osmo-stp_10.42.42.5(pid=28751) [trial-2366↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28751)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=28763): Process ended prematurely: osmo-stp_10.42.42.5(pid=28763) [trial-2366↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28763)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=28781): Process ended prematurely: osmo-stp_10.42.42.5(pid=28781) [trial-2366↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28781)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=28791): Process ended prematurely: osmo-stp_10.42.42.5(pid=28791) [trial-2366↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28791)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=28801): Process ended prematurely: osmo-stp_10.42.42.5(pid=28801) [trial-2366↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28801)] FAIL: gprs:sysmo+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=28818): Process ended prematurely: osmo-stp_10.42.42.5(pid=28818) [trial-2366↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28818)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=28830): Process ended prematurely: osmo-stp_10.42.42.5(pid=28830) [trial-2366↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28830)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=28849): Process ended prematurely: osmo-stp_10.42.42.5(pid=28849) [trial-2366↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28849)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=28862): Process ended prematurely: osmo-stp_10.42.42.5(pid=28862) [trial-2366↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28862)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=28872): Process ended prematurely: osmo-stp_10.42.42.5(pid=28872) [trial-2366↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28872)] FAIL: gprs:sysmo+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=28892): Process ended prematurely: osmo-stp_10.42.42.5(pid=28892) [trial-2366↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28892)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=28905): Process ended prematurely: osmo-stp_10.42.42.5(pid=28905) [trial-2366↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28905)] FAIL: iperf3m4.py (10.3 sec) Error: osmo-stp_10.42.42.5(pid=28923): Process ended prematurely: osmo-stp_10.42.42.5(pid=28923) [trial-2366↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28923)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=28933): Process ended prematurely: osmo-stp_10.42.42.5(pid=28933) [trial-2366↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28933)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=28943): Process ended prematurely: osmo-stp_10.42.42.5(pid=28943) [trial-2366↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28943)] FAIL: dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28958): Process ended prematurely: osmo-stp_10.42.42.5(pid=28958) [trial-2366↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28958)] FAIL: dynts:sysmo+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=28971): Process ended prematurely: osmo-stp_10.42.42.5(pid=28971) [trial-2366↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28971)] FAIL: nitb_sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=28979): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28979) [trial-2366↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28979)] FAIL: sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=28989): Process ended prematurely: osmo-stp_10.42.42.5(pid=28989) [trial-2366↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28989)] FAIL: nitb_ussd:oc2g (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=28998): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28998) [trial-2366↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28998)] FAIL: ussd:oc2g (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=29008): Process ended prematurely: osmo-stp_10.42.42.5(pid=29008) [trial-2366↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29008)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=29022): Process ended prematurely: osmo-stp_10.42.42.5(pid=29022) [trial-2366↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29022)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=29033): Process ended prematurely: osmo-stp_10.42.42.5(pid=29033) [trial-2366↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29033)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=29050): Process ended prematurely: osmo-stp_10.42.42.5(pid=29050) [trial-2366↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29050)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=29061): Process ended prematurely: osmo-stp_10.42.42.5(pid=29061) [trial-2366↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29061)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=29086): Process ended prematurely: osmo-stp_10.42.42.5(pid=29086) [trial-2366↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29086)] FAIL: mo_mt_call_osmux.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=29357): Process ended prematurely: osmo-stp_10.42.42.5(pid=29357) [trial-2366↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29357)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=29372): Process ended prematurely: osmo-stp_10.42.42.5(pid=29372) [trial-2366↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29372)] FAIL: mo_mt_call_osmux.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=29383): Process ended prematurely: osmo-stp_10.42.42.5(pid=29383) [trial-2366↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29383)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29397): Process ended prematurely: osmo-stp_10.42.42.5(pid=29397) [trial-2366↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29397)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29408): Process ended prematurely: osmo-stp_10.42.42.5(pid=29408) [trial-2366↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29408)] FAIL: voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=29422): Process ended prematurely: osmo-stp_10.42.42.5(pid=29422) [trial-2366↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29422)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=29433): Process ended prematurely: osmo-stp_10.42.42.5(pid=29433) [trial-2366↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29433)] FAIL: voice:oc2g+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=29447): Process ended prematurely: osmo-stp_10.42.42.5(pid=29447) [trial-2366↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29447)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=29458): Process ended prematurely: osmo-stp_10.42.42.5(pid=29458) [trial-2366↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29458)] FAIL: emergency:oc2g (fail: 2) FAIL: emergency_mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=29472): Process ended prematurely: osmo-stp_10.42.42.5(pid=29472) [trial-2366↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29472)] FAIL: emergency_preemptive_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=29486): Process ended prematurely: osmo-stp_10.42.42.5(pid=29486) [trial-2366↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29486)] FAIL: gprs:oc2g (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=29504): Process ended prematurely: osmo-stp_10.42.42.5(pid=29504) [trial-2366↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29504)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=29516): Process ended prematurely: osmo-stp_10.42.42.5(pid=29516) [trial-2366↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29516)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=29535): Process ended prematurely: osmo-stp_10.42.42.5(pid=29535) [trial-2366↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29535)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=29545): Process ended prematurely: osmo-stp_10.42.42.5(pid=29545) [trial-2366↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29545)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=29555): Process ended prematurely: osmo-stp_10.42.42.5(pid=29555) [trial-2366↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29555)] FAIL: gprs:oc2g+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=29573): Process ended prematurely: osmo-stp_10.42.42.5(pid=29573) [trial-2366↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29573)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=29585): Process ended prematurely: osmo-stp_10.42.42.5(pid=29585) [trial-2366↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29585)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=29603): Process ended prematurely: osmo-stp_10.42.42.5(pid=29603) [trial-2366↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29603)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=29613): Process ended prematurely: osmo-stp_10.42.42.5(pid=29613) [trial-2366↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29613)] FAIL: ping_idle_ping.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=29623): Process ended prematurely: osmo-stp_10.42.42.5(pid=29623) [trial-2366↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29623)] FAIL: gprs:oc2g+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.3 sec) Error: osmo-stp_10.42.42.5(pid=29640): Process ended prematurely: osmo-stp_10.42.42.5(pid=29640) [trial-2366↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29640)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=29652): Process ended prematurely: osmo-stp_10.42.42.5(pid=29652) [trial-2366↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29652)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=29675): Process ended prematurely: osmo-stp_10.42.42.5(pid=29675) [trial-2366↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29675)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=29685): Process ended prematurely: osmo-stp_10.42.42.5(pid=29685) [trial-2366↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29685)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=29695): Process ended prematurely: osmo-stp_10.42.42.5(pid=29695) [trial-2366↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29695)] FAIL: gprs:oc2g+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=29712): Process ended prematurely: osmo-stp_10.42.42.5(pid=29712) [trial-2366↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29712)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=29724): Process ended prematurely: osmo-stp_10.42.42.5(pid=29724) [trial-2366↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29724)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=29742): Process ended prematurely: osmo-stp_10.42.42.5(pid=29742) [trial-2366↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29742)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=29752): Process ended prematurely: osmo-stp_10.42.42.5(pid=29752) [trial-2366↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29752)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=29762): Process ended prematurely: osmo-stp_10.42.42.5(pid=29762) [trial-2366↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29762)] FAIL: dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=29775): Process ended prematurely: osmo-stp_10.42.42.5(pid=29775) [trial-2366↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29775)] FAIL: dynts:oc2g+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=29788): Process ended prematurely: osmo-stp_10.42.42.5(pid=29788) [trial-2366↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29788)] FAIL: nitb_sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=29798): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29798) [trial-2366↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29798)] FAIL: sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=29809): Process ended prematurely: osmo-stp_10.42.42.5(pid=29809) [trial-2366↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29809)] FAIL: nitb_ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=29818): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29818) [trial-2366↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29818)] FAIL: ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (5.7 sec) Error: osmo-stp_10.42.42.5(pid=29831): Process ended prematurely: osmo-stp_10.42.42.5(pid=29831) [trial-2366↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29831)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=29845): Process ended prematurely: osmo-stp_10.42.42.5(pid=29845) [trial-2366↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29845)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=29856): Process ended prematurely: osmo-stp_10.42.42.5(pid=29856) [trial-2366↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29856)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=29870): Process ended prematurely: osmo-stp_10.42.42.5(pid=29870) [trial-2366↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29870)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=29881): Process ended prematurely: osmo-stp_10.42.42.5(pid=29881) [trial-2366↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29881)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=29896): Process ended prematurely: osmo-stp_10.42.42.5(pid=29896) [trial-2366↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29896)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=29907): Process ended prematurely: osmo-stp_10.42.42.5(pid=29907) [trial-2366↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29907)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=29921): Process ended prematurely: osmo-stp_10.42.42.5(pid=29921) [trial-2366↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29921)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=29932): Process ended prematurely: osmo-stp_10.42.42.5(pid=29932) [trial-2366↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29932)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=29946): Process ended prematurely: osmo-stp_10.42.42.5(pid=29946) [trial-2366↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29946)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29957): Process ended prematurely: osmo-stp_10.42.42.5(pid=29957) [trial-2366↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29957)] FAIL: voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=29971): Process ended prematurely: osmo-stp_10.42.42.5(pid=29971) [trial-2366↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29971)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=29982): Process ended prematurely: osmo-stp_10.42.42.5(pid=29982) [trial-2366↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29982)] FAIL: voice:trx-b200+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29996): Process ended prematurely: osmo-stp_10.42.42.5(pid=29996) [trial-2366↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29996)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=30007): Process ended prematurely: osmo-stp_10.42.42.5(pid=30007) [trial-2366↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30007)] FAIL: voice:trx-b200+mod-bts0-trxdversion0 (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=30021): Process ended prematurely: osmo-stp_10.42.42.5(pid=30021) [trial-2366↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30021)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=30032): Process ended prematurely: osmo-stp_10.42.42.5(pid=30032) [trial-2366↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30032)] FAIL: voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=30047): Process ended prematurely: osmo-stp_10.42.42.5(pid=30047) [trial-2366↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30047)] FAIL: mo_mt_call_osmux.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=30058): Process ended prematurely: osmo-stp_10.42.42.5(pid=30058) [trial-2366↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30058)] FAIL: emergency:trx-b200 (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=30072): Process ended prematurely: osmo-stp_10.42.42.5(pid=30072) [trial-2366↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30072)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=30083): Process ended prematurely: osmo-stp_10.42.42.5(pid=30083) [trial-2366↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30083)] FAIL: gprs:trx-b200 (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=30102): Process ended prematurely: osmo-stp_10.42.42.5(pid=30102) [trial-2366↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30102)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=30114): Process ended prematurely: osmo-stp_10.42.42.5(pid=30114) [trial-2366↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30114)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=30132): Process ended prematurely: osmo-stp_10.42.42.5(pid=30132) [trial-2366↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30132)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=30142): Process ended prematurely: osmo-stp_10.42.42.5(pid=30142) [trial-2366↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30142)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=30152): Process ended prematurely: osmo-stp_10.42.42.5(pid=30152) [trial-2366↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30152)] FAIL: gprs:trx-b200+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=30170): Process ended prematurely: osmo-stp_10.42.42.5(pid=30170) [trial-2366↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30170)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=30185): Process ended prematurely: osmo-stp_10.42.42.5(pid=30185) [trial-2366↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30185)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=30203): Process ended prematurely: osmo-stp_10.42.42.5(pid=30203) [trial-2366↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30203)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=30213): Process ended prematurely: osmo-stp_10.42.42.5(pid=30213) [trial-2366↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30213)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=30223): Process ended prematurely: osmo-stp_10.42.42.5(pid=30223) [trial-2366↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30223)] FAIL: gprs:trx-b200+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=30240): Process ended prematurely: osmo-stp_10.42.42.5(pid=30240) [trial-2366↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30240)] FAIL: iperf3.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=30252): Process ended prematurely: osmo-stp_10.42.42.5(pid=30252) [trial-2366↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30252)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=30271): Process ended prematurely: osmo-stp_10.42.42.5(pid=30271) [trial-2366↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30271)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=30281): Process ended prematurely: osmo-stp_10.42.42.5(pid=30281) [trial-2366↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30281)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=30291): Process ended prematurely: osmo-stp_10.42.42.5(pid=30291) [trial-2366↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30291)] FAIL: gprs:trx-b200+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=30359): Process ended prematurely: osmo-stp_10.42.42.5(pid=30359) [trial-2366↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30359)] FAIL: iperf3.py (8.1 sec) Error: osmo-stp_10.42.42.5(pid=30371): Process ended prematurely: osmo-stp_10.42.42.5(pid=30371) [trial-2366↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30371)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=30390): Process ended prematurely: osmo-stp_10.42.42.5(pid=30390) [trial-2366↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30390)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=30400): Process ended prematurely: osmo-stp_10.42.42.5(pid=30400) [trial-2366↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30400)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=30411): Process ended prematurely: osmo-stp_10.42.42.5(pid=30411) [trial-2366↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30411)] FAIL: gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=30428): Process ended prematurely: osmo-stp_10.42.42.5(pid=30428) [trial-2366↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30428)] FAIL: iperf3.py (8.1 sec) Error: osmo-stp_10.42.42.5(pid=30451): Process ended prematurely: osmo-stp_10.42.42.5(pid=30451) [trial-2366↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30451)] FAIL: iperf3m4.py (12.4 sec) Error: osmo-stp_10.42.42.5(pid=30730): Process ended prematurely: osmo-stp_10.42.42.5(pid=30730) [trial-2366↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30730)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=30740): Process ended prematurely: osmo-stp_10.42.42.5(pid=30740) [trial-2366↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30740)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=30750): Process ended prematurely: osmo-stp_10.42.42.5(pid=30750) [trial-2366↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30750)] FAIL: dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30763): Process ended prematurely: osmo-stp_10.42.42.5(pid=30763) [trial-2366↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30763)] FAIL: dynts:trx-b200+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=30778): Process ended prematurely: osmo-stp_10.42.42.5(pid=30778) [trial-2366↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30778)] FAIL: nitb_sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=30786): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30786) [trial-2366↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30786)] FAIL: sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=30796): Process ended prematurely: osmo-stp_10.42.42.5(pid=30796) [trial-2366↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30796)] FAIL: nitb_ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=30805): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30805) [trial-2366↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30805)] FAIL: ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=30815): Process ended prematurely: osmo-stp_10.42.42.5(pid=30815) [trial-2366↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30815)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30829): Process ended prematurely: osmo-stp_10.42.42.5(pid=30829) [trial-2366↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30829)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=30840): Process ended prematurely: osmo-stp_10.42.42.5(pid=30840) [trial-2366↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30840)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=30857): Process ended prematurely: osmo-stp_10.42.42.5(pid=30857) [trial-2366↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30857)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=30868): Process ended prematurely: osmo-stp_10.42.42.5(pid=30868) [trial-2366↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30868)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=30882): Process ended prematurely: osmo-stp_10.42.42.5(pid=30882) [trial-2366↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30882)] FAIL: mo_mt_call_osmux.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=30893): Process ended prematurely: osmo-stp_10.42.42.5(pid=30893) [trial-2366↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30893)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=30907): Process ended prematurely: osmo-stp_10.42.42.5(pid=30907) [trial-2366↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30907)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=30918): Process ended prematurely: osmo-stp_10.42.42.5(pid=30918) [trial-2366↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30918)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=30932): Process ended prematurely: osmo-stp_10.42.42.5(pid=30932) [trial-2366↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30932)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=30943): Process ended prematurely: osmo-stp_10.42.42.5(pid=30943) [trial-2366↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30943)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=30958): Process ended prematurely: osmo-stp_10.42.42.5(pid=30958) [trial-2366↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30958)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=30969): Process ended prematurely: osmo-stp_10.42.42.5(pid=30969) [trial-2366↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30969)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=30983): Process ended prematurely: osmo-stp_10.42.42.5(pid=30983) [trial-2366↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30983)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=30996): Process ended prematurely: osmo-stp_10.42.42.5(pid=30996) [trial-2366↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30996)] FAIL: emergency:trx-sysmocell5000 (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=31010): Process ended prematurely: osmo-stp_10.42.42.5(pid=31010) [trial-2366↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31010)] FAIL: emergency_preemptive_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=31021): Process ended prematurely: osmo-stp_10.42.42.5(pid=31021) [trial-2366↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31021)] FAIL: gprs:trx-sysmocell5000 (fail: 5) FAIL: cs_paging_gprs_active.py (8.2 sec) Error: osmo-stp_10.42.42.5(pid=31039): Process ended prematurely: osmo-stp_10.42.42.5(pid=31039) [trial-2366↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31039)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=31051): Process ended prematurely: osmo-stp_10.42.42.5(pid=31051) [trial-2366↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31051)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=31069): Process ended prematurely: osmo-stp_10.42.42.5(pid=31069) [trial-2366↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31069)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=31080): Process ended prematurely: osmo-stp_10.42.42.5(pid=31080) [trial-2366↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31080)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=31090): Process ended prematurely: osmo-stp_10.42.42.5(pid=31090) [trial-2366↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31090)] FAIL: gprs:trx-sysmocell5000+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=31107): Process ended prematurely: osmo-stp_10.42.42.5(pid=31107) [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31107)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=31119): Process ended prematurely: osmo-stp_10.42.42.5(pid=31119) [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31119)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=31137): Process ended prematurely: osmo-stp_10.42.42.5(pid=31137) [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31137)] FAIL: ping.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=31147): Process ended prematurely: osmo-stp_10.42.42.5(pid=31147) [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31147)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=31157): Process ended prematurely: osmo-stp_10.42.42.5(pid=31157) [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31157)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.2 sec) Error: osmo-stp_10.42.42.5(pid=31176): Process ended prematurely: osmo-stp_10.42.42.5(pid=31176) [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31176)] FAIL: iperf3.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=31188): Process ended prematurely: osmo-stp_10.42.42.5(pid=31188) [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31188)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=31209): Process ended prematurely: osmo-stp_10.42.42.5(pid=31209) [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31209)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=31219): Process ended prematurely: osmo-stp_10.42.42.5(pid=31219) [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31219)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=31229): Process ended prematurely: osmo-stp_10.42.42.5(pid=31229) [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31229)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=31246): Process ended prematurely: osmo-stp_10.42.42.5(pid=31246) [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31246)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=31259): Process ended prematurely: osmo-stp_10.42.42.5(pid=31259) [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31259)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=31277): Process ended prematurely: osmo-stp_10.42.42.5(pid=31277) [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31277)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=31287): Process ended prematurely: osmo-stp_10.42.42.5(pid=31287) [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31287)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=31297): Process ended prematurely: osmo-stp_10.42.42.5(pid=31297) [trial-2366↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31297)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=31310): Process ended prematurely: osmo-stp_10.42.42.5(pid=31310) [trial-2366↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31310)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=31323): Process ended prematurely: osmo-stp_10.42.42.5(pid=31323) [trial-2366↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31323)] FAIL: nitb_sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=31331): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31331) [trial-2366↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31331)] FAIL: sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=31341): Process ended prematurely: osmo-stp_10.42.42.5(pid=31341) [trial-2366↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31341)] FAIL: nitb_ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=31351): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31351) [trial-2366↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31351)] FAIL: ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (5.7 sec) Error: osmo-stp_10.42.42.5(pid=31361): Process ended prematurely: osmo-stp_10.42.42.5(pid=31361) [trial-2366↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31361)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=31375): Process ended prematurely: osmo-stp_10.42.42.5(pid=31375) [trial-2366↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31375)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=31386): Process ended prematurely: osmo-stp_10.42.42.5(pid=31386) [trial-2366↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31386)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=31400): Process ended prematurely: osmo-stp_10.42.42.5(pid=31400) [trial-2366↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31400)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=31411): Process ended prematurely: osmo-stp_10.42.42.5(pid=31411) [trial-2366↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31411)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=31425): Process ended prematurely: osmo-stp_10.42.42.5(pid=31425) [trial-2366↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31425)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=31437): Process ended prematurely: osmo-stp_10.42.42.5(pid=31437) [trial-2366↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31437)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=31452): Process ended prematurely: osmo-stp_10.42.42.5(pid=31452) [trial-2366↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31452)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=31463): Process ended prematurely: osmo-stp_10.42.42.5(pid=31463) [trial-2366↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31463)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=31477): Process ended prematurely: osmo-stp_10.42.42.5(pid=31477) [trial-2366↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31477)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=31488): Process ended prematurely: osmo-stp_10.42.42.5(pid=31488) [trial-2366↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31488)] FAIL: voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=31502): Process ended prematurely: osmo-stp_10.42.42.5(pid=31502) [trial-2366↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31502)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=31513): Process ended prematurely: osmo-stp_10.42.42.5(pid=31513) [trial-2366↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31513)] FAIL: voice:trx-umtrx+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=31527): Process ended prematurely: osmo-stp_10.42.42.5(pid=31527) [trial-2366↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31527)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=31538): Process ended prematurely: osmo-stp_10.42.42.5(pid=31538) [trial-2366↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31538)] FAIL: voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=31552): Process ended prematurely: osmo-stp_10.42.42.5(pid=31552) [trial-2366↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31552)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=31566): Process ended prematurely: osmo-stp_10.42.42.5(pid=31566) [trial-2366↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31566)] FAIL: emergency:trx-umtrx (fail: 2) FAIL: emergency_mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=31580): Process ended prematurely: osmo-stp_10.42.42.5(pid=31580) [trial-2366↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31580)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=31591): Process ended prematurely: osmo-stp_10.42.42.5(pid=31591) [trial-2366↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31591)] FAIL: gprs:trx-umtrx (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=31609): Process ended prematurely: osmo-stp_10.42.42.5(pid=31609) [trial-2366↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31609)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=31621): Process ended prematurely: osmo-stp_10.42.42.5(pid=31621) [trial-2366↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31621)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=31639): Process ended prematurely: osmo-stp_10.42.42.5(pid=31639) [trial-2366↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31639)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=31649): Process ended prematurely: osmo-stp_10.42.42.5(pid=31649) [trial-2366↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31649)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=31659): Process ended prematurely: osmo-stp_10.42.42.5(pid=31659) [trial-2366↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31659)] FAIL: gprs:trx-umtrx+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=31676): Process ended prematurely: osmo-stp_10.42.42.5(pid=31676) [trial-2366↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31676)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=31688): Process ended prematurely: osmo-stp_10.42.42.5(pid=31688) [trial-2366↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31688)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=31706): Process ended prematurely: osmo-stp_10.42.42.5(pid=31706) [trial-2366↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31706)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=31716): Process ended prematurely: osmo-stp_10.42.42.5(pid=31716) [trial-2366↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31716)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=31730): Process ended prematurely: osmo-stp_10.42.42.5(pid=31730) [trial-2366↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31730)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=31747): Process ended prematurely: osmo-stp_10.42.42.5(pid=31747) [trial-2366↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31747)] FAIL: iperf3.py (8.2 sec) Error: osmo-stp_10.42.42.5(pid=31770): Process ended prematurely: osmo-stp_10.42.42.5(pid=31770) [trial-2366↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31770)] FAIL: iperf3m4.py (12.0 sec) Error: osmo-stp_10.42.42.5(pid=32049): Process ended prematurely: osmo-stp_10.42.42.5(pid=32049) [trial-2366↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32049)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=32060): Process ended prematurely: osmo-stp_10.42.42.5(pid=32060) [trial-2366↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32060)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=32071): Process ended prematurely: osmo-stp_10.42.42.5(pid=32071) [trial-2366↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32071)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=32088): Process ended prematurely: osmo-stp_10.42.42.5(pid=32088) [trial-2366↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32088)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=32100): Process ended prematurely: osmo-stp_10.42.42.5(pid=32100) [trial-2366↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32100)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=32118): Process ended prematurely: osmo-stp_10.42.42.5(pid=32118) [trial-2366↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32118)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=32128): Process ended prematurely: osmo-stp_10.42.42.5(pid=32128) [trial-2366↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32128)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=32138): Process ended prematurely: osmo-stp_10.42.42.5(pid=32138) [trial-2366↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32138)] FAIL: gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=32156): Process ended prematurely: osmo-stp_10.42.42.5(pid=32156) [trial-2366↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32156)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=32173): Process ended prematurely: osmo-stp_10.42.42.5(pid=32173) [trial-2366↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32173)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=32191): Process ended prematurely: osmo-stp_10.42.42.5(pid=32191) [trial-2366↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32191)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=32201): Process ended prematurely: osmo-stp_10.42.42.5(pid=32201) [trial-2366↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32201)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=32211): Process ended prematurely: osmo-stp_10.42.42.5(pid=32211) [trial-2366↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32211)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=32224): Process ended prematurely: osmo-stp_10.42.42.5(pid=32224) [trial-2366↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32224)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=32237): Process ended prematurely: osmo-stp_10.42.42.5(pid=32237) [trial-2366↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32237)] FAIL: nitb_sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=32245): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32245) [trial-2366↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32245)] FAIL: sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=32257): Process ended prematurely: osmo-stp_10.42.42.5(pid=32257) [trial-2366↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32257)] FAIL: nitb_ussd:trx-lms (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=32266): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32266) [trial-2366↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32266)] FAIL: ussd:trx-lms (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=32276): Process ended prematurely: osmo-stp_10.42.42.5(pid=32276) [trial-2366↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32276)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=32290): Process ended prematurely: osmo-stp_10.42.42.5(pid=32290) [trial-2366↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32290)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=32301): Process ended prematurely: osmo-stp_10.42.42.5(pid=32301) [trial-2366↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32301)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=32315): Process ended prematurely: osmo-stp_10.42.42.5(pid=32315) [trial-2366↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32315)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=32326): Process ended prematurely: osmo-stp_10.42.42.5(pid=32326) [trial-2366↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32326)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=32341): Process ended prematurely: osmo-stp_10.42.42.5(pid=32341) [trial-2366↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32341)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=32352): Process ended prematurely: osmo-stp_10.42.42.5(pid=32352) [trial-2366↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32352)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=32366): Process ended prematurely: osmo-stp_10.42.42.5(pid=32366) [trial-2366↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32366)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=32377): Process ended prematurely: osmo-stp_10.42.42.5(pid=32377) [trial-2366↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32377)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=32391): Process ended prematurely: osmo-stp_10.42.42.5(pid=32391) [trial-2366↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32391)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=32402): Process ended prematurely: osmo-stp_10.42.42.5(pid=32402) [trial-2366↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32402)] FAIL: voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=32416): Process ended prematurely: osmo-stp_10.42.42.5(pid=32416) [trial-2366↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32416)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=32427): Process ended prematurely: osmo-stp_10.42.42.5(pid=32427) [trial-2366↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32427)] FAIL: voice:trx-lms+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=32442): Process ended prematurely: osmo-stp_10.42.42.5(pid=32442) [trial-2366↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32442)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=32453): Process ended prematurely: osmo-stp_10.42.42.5(pid=32453) [trial-2366↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32453)] FAIL: emergency:trx-lms (fail: 2) FAIL: emergency_mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=32468): Process ended prematurely: osmo-stp_10.42.42.5(pid=32468) [trial-2366↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32468)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=32479): Process ended prematurely: osmo-stp_10.42.42.5(pid=32479) [trial-2366↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32479)] FAIL: gprs:trx-lms (fail: 5) FAIL: cs_paging_gprs_active.py (8.3 sec) Error: osmo-stp_10.42.42.5(pid=32497): Process ended prematurely: osmo-stp_10.42.42.5(pid=32497) [trial-2366↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32497)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=32509): Process ended prematurely: osmo-stp_10.42.42.5(pid=32509) [trial-2366↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32509)] FAIL: iperf3m4.py (11.8 sec) Error: osmo-stp_10.42.42.5(pid=32578): Process ended prematurely: osmo-stp_10.42.42.5(pid=32578) [trial-2366↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32578)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=32597): Process ended prematurely: osmo-stp_10.42.42.5(pid=32597) [trial-2366↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32597)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=32607): Process ended prematurely: osmo-stp_10.42.42.5(pid=32607) [trial-2366↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32607)] FAIL: gprs:trx-lms+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=32625): Process ended prematurely: osmo-stp_10.42.42.5(pid=32625) [trial-2366↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32625)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=32637): Process ended prematurely: osmo-stp_10.42.42.5(pid=32637) [trial-2366↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32637)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=32655): Process ended prematurely: osmo-stp_10.42.42.5(pid=32655) [trial-2366↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32655)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=32665): Process ended prematurely: osmo-stp_10.42.42.5(pid=32665) [trial-2366↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32665)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=32675): Process ended prematurely: osmo-stp_10.42.42.5(pid=32675) [trial-2366↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32675)] FAIL: gprs:trx-lms+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=32693): Process ended prematurely: osmo-stp_10.42.42.5(pid=32693) [trial-2366↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32693)] FAIL: iperf3.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=32705): Process ended prematurely: osmo-stp_10.42.42.5(pid=32705) [trial-2366↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32705)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=32723): Process ended prematurely: osmo-stp_10.42.42.5(pid=32723) [trial-2366↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32723)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=32733): Process ended prematurely: osmo-stp_10.42.42.5(pid=32733) [trial-2366↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32733)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=32743): Process ended prematurely: osmo-stp_10.42.42.5(pid=32743) [trial-2366↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32743)] FAIL: gprs:trx-lms+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=32765): Process ended prematurely: osmo-stp_10.42.42.5(pid=32765) [trial-2366↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32765)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=309): Process ended prematurely: osmo-stp_10.42.42.5(pid=309) [trial-2366↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=309)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=328): Process ended prematurely: osmo-stp_10.42.42.5(pid=328) [trial-2366↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=328)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=338): Process ended prematurely: osmo-stp_10.42.42.5(pid=338) [trial-2366↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=338)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=355): Process ended prematurely: osmo-stp_10.42.42.5(pid=355) [trial-2366↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=355)] FAIL: dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=374): Process ended prematurely: osmo-stp_10.42.42.5(pid=374) [trial-2366↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=374)] FAIL: dynts:trx-lms+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=387): Process ended prematurely: osmo-stp_10.42.42.5(pid=387) [trial-2366↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=387)] FAIL: nitb_sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=395): Process ended prematurely: osmo-nitb_10.42.42.2(pid=395) [trial-2366↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=395)] FAIL: sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=407): Process ended prematurely: osmo-stp_10.42.42.5(pid=407) [trial-2366↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=407)] FAIL: nitb_ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=416): Process ended prematurely: osmo-nitb_10.42.42.2(pid=416) [trial-2366↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=416)] FAIL: ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=439): Process ended prematurely: osmo-stp_10.42.42.5(pid=439) [trial-2366↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=439)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=453): Process ended prematurely: osmo-stp_10.42.42.5(pid=453) [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=453)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=464): Process ended prematurely: osmo-stp_10.42.42.5(pid=464) [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=464)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=478): Process ended prematurely: osmo-stp_10.42.42.5(pid=478) [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=478)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=492): Process ended prematurely: osmo-stp_10.42.42.5(pid=492) [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=492)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=506): Process ended prematurely: osmo-stp_10.42.42.5(pid=506) [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=506)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=517): Process ended prematurely: osmo-stp_10.42.42.5(pid=517) [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=517)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=531): Process ended prematurely: osmo-stp_10.42.42.5(pid=531) [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=531)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=542): Process ended prematurely: osmo-stp_10.42.42.5(pid=542) [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=542)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=556): Process ended prematurely: osmo-stp_10.42.42.5(pid=556) [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=556)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=567): Process ended prematurely: osmo-stp_10.42.42.5(pid=567) [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=567)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=581): Process ended prematurely: osmo-stp_10.42.42.5(pid=581) [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=581)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=592): Process ended prematurely: osmo-stp_10.42.42.5(pid=592) [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=592)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=606): Process ended prematurely: osmo-stp_10.42.42.5(pid=606) [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=606)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=617): Process ended prematurely: osmo-stp_10.42.42.5(pid=617) [trial-2366↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=617)] FAIL: emergency:trx-lms-limenet-micro (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=632): Process ended prematurely: osmo-stp_10.42.42.5(pid=632) [trial-2366↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=632)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=643): Process ended prematurely: osmo-stp_10.42.42.5(pid=643) [trial-2366↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=643)] FAIL: gprs:trx-lms-limenet-micro (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=661): Process ended prematurely: osmo-stp_10.42.42.5(pid=661) [trial-2366↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=661)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=673): Process ended prematurely: osmo-stp_10.42.42.5(pid=673) [trial-2366↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=673)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=691): Process ended prematurely: osmo-stp_10.42.42.5(pid=691) [trial-2366↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=691)] FAIL: ping.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=714): Process ended prematurely: osmo-stp_10.42.42.5(pid=714) [trial-2366↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=714)] FAIL: ping_idle_ping.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=1011): Process ended prematurely: osmo-stp_10.42.42.5(pid=1011) [trial-2366↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1011)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=1029): Process ended prematurely: osmo-stp_10.42.42.5(pid=1029) [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1029)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=1041): Process ended prematurely: osmo-stp_10.42.42.5(pid=1041) [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1041)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=1059): Process ended prematurely: osmo-stp_10.42.42.5(pid=1059) [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1059)] FAIL: ping.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=1071): Process ended prematurely: osmo-stp_10.42.42.5(pid=1071) [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1071)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=1081): Process ended prematurely: osmo-stp_10.42.42.5(pid=1081) [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1081)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=1098): Process ended prematurely: osmo-stp_10.42.42.5(pid=1098) [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1098)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=1110): Process ended prematurely: osmo-stp_10.42.42.5(pid=1110) [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1110)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=1139): Process ended prematurely: osmo-stp_10.42.42.5(pid=1139) [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1139)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1153): Process ended prematurely: osmo-stp_10.42.42.5(pid=1153) [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1153)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=1163): Process ended prematurely: osmo-stp_10.42.42.5(pid=1163) [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1163)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=1184): Process ended prematurely: osmo-stp_10.42.42.5(pid=1184) [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1184)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=1196): Process ended prematurely: osmo-stp_10.42.42.5(pid=1196) [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1196)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=1214): Process ended prematurely: osmo-stp_10.42.42.5(pid=1214) [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1214)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1224): Process ended prematurely: osmo-stp_10.42.42.5(pid=1224) [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1224)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1235): Process ended prematurely: osmo-stp_10.42.42.5(pid=1235) [trial-2366↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1235)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1248): Process ended prematurely: osmo-stp_10.42.42.5(pid=1248) [trial-2366↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1248)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=1261): Process ended prematurely: osmo-stp_10.42.42.5(pid=1261) [trial-2366↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1261)] FAIL: nitb_sms:nanobts (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=1269): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1269) [trial-2366↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1269)] FAIL: sms:nanobts+band-1900 (fail: 1) FAIL: mo_mt_sms.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=1280): Process ended prematurely: osmo-stp_10.42.42.5(pid=1280) [trial-2366↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1280)] FAIL: nitb_ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=1291): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1291) [trial-2366↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1291)] FAIL: ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=1301): Process ended prematurely: osmo-stp_10.42.42.5(pid=1301) [trial-2366↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1301)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=1315): Process ended prematurely: osmo-stp_10.42.42.5(pid=1315) [trial-2366↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1315)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=1326): Process ended prematurely: osmo-stp_10.42.42.5(pid=1326) [trial-2366↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1326)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=1340): Process ended prematurely: osmo-stp_10.42.42.5(pid=1340) [trial-2366↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1340)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=1351): Process ended prematurely: osmo-stp_10.42.42.5(pid=1351) [trial-2366↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1351)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=1365): Process ended prematurely: osmo-stp_10.42.42.5(pid=1365) [trial-2366↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1365)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=1376): Process ended prematurely: osmo-stp_10.42.42.5(pid=1376) [trial-2366↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1376)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=1390): Process ended prematurely: osmo-stp_10.42.42.5(pid=1390) [trial-2366↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1390)] FAIL: mo_mt_call_osmux.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=1402): Process ended prematurely: osmo-stp_10.42.42.5(pid=1402) [trial-2366↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1402)] FAIL: voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=1416): Process ended prematurely: osmo-stp_10.42.42.5(pid=1416) [trial-2366↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1416)] FAIL: mo_mt_call_osmux.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=1427): Process ended prematurely: osmo-stp_10.42.42.5(pid=1427) [trial-2366↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1427)] FAIL: emergency:nanobts+band-1900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=1442): Process ended prematurely: osmo-stp_10.42.42.5(pid=1442) [trial-2366↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1442)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=1453): Process ended prematurely: osmo-stp_10.42.42.5(pid=1453) [trial-2366↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1453)] FAIL: gprs:nanobts+band-1900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=1471): Process ended prematurely: osmo-stp_10.42.42.5(pid=1471) [trial-2366↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1471)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=1483): Process ended prematurely: osmo-stp_10.42.42.5(pid=1483) [trial-2366↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1483)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=1504): Process ended prematurely: osmo-stp_10.42.42.5(pid=1504) [trial-2366↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1504)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=1514): Process ended prematurely: osmo-stp_10.42.42.5(pid=1514) [trial-2366↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1514)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=1524): Process ended prematurely: osmo-stp_10.42.42.5(pid=1524) [trial-2366↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1524)] FAIL: gprs:nanobts+band-1900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=1542): Process ended prematurely: osmo-stp_10.42.42.5(pid=1542) [trial-2366↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1542)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=1557): Process ended prematurely: osmo-stp_10.42.42.5(pid=1557) [trial-2366↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1557)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=1575): Process ended prematurely: osmo-stp_10.42.42.5(pid=1575) [trial-2366↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1575)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1585): Process ended prematurely: osmo-stp_10.42.42.5(pid=1585) [trial-2366↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1585)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1595): Process ended prematurely: osmo-stp_10.42.42.5(pid=1595) [trial-2366↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1595)] FAIL: gprs:nanobts+band-1900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=1612): Process ended prematurely: osmo-stp_10.42.42.5(pid=1612) [trial-2366↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1612)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=1624): Process ended prematurely: osmo-stp_10.42.42.5(pid=1624) [trial-2366↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1624)] FAIL: iperf3m4.py (11.3 sec) Error: osmo-stp_10.42.42.5(pid=1645): Process ended prematurely: osmo-stp_10.42.42.5(pid=1645) [trial-2366↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1645)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=1655): Process ended prematurely: osmo-stp_10.42.42.5(pid=1655) [trial-2366↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1655)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1665): Process ended prematurely: osmo-stp_10.42.42.5(pid=1665) [trial-2366↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1665)] FAIL: dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1679): Process ended prematurely: osmo-stp_10.42.42.5(pid=1679) [trial-2366↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1679)] FAIL: sms:nanobts+band-900 (fail: 1) FAIL: mo_mt_sms.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=1693): Process ended prematurely: osmo-stp_10.42.42.5(pid=1693) [trial-2366↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1693)] FAIL: nitb_ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=1702): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1702) [trial-2366↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1702)] FAIL: ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=1712): Process ended prematurely: osmo-stp_10.42.42.5(pid=1712) [trial-2366↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1712)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=1726): Process ended prematurely: osmo-stp_10.42.42.5(pid=1726) [trial-2366↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1726)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=1737): Process ended prematurely: osmo-stp_10.42.42.5(pid=1737) [trial-2366↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1737)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=1751): Process ended prematurely: osmo-stp_10.42.42.5(pid=1751) [trial-2366↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1751)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=1762): Process ended prematurely: osmo-stp_10.42.42.5(pid=1762) [trial-2366↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1762)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=1777): Process ended prematurely: osmo-stp_10.42.42.5(pid=1777) [trial-2366↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1777)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=1789): Process ended prematurely: osmo-stp_10.42.42.5(pid=1789) [trial-2366↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1789)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1803): Process ended prematurely: osmo-stp_10.42.42.5(pid=1803) [trial-2366↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1803)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=1815): Process ended prematurely: osmo-stp_10.42.42.5(pid=1815) [trial-2366↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1815)] FAIL: voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=1830): Process ended prematurely: osmo-stp_10.42.42.5(pid=1830) [trial-2366↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1830)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1841): Process ended prematurely: osmo-stp_10.42.42.5(pid=1841) [trial-2366↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1841)] FAIL: voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=1856): Process ended prematurely: osmo-stp_10.42.42.5(pid=1856) [trial-2366↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1856)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=1870): Process ended prematurely: osmo-stp_10.42.42.5(pid=1870) [trial-2366↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1870)] FAIL: emergency:nanobts+band-900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=1884): Process ended prematurely: osmo-stp_10.42.42.5(pid=1884) [trial-2366↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1884)] FAIL: emergency_preemptive_call.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=1895): Process ended prematurely: osmo-stp_10.42.42.5(pid=1895) [trial-2366↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1895)] FAIL: gprs:nanobts+band-900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=1913): Process ended prematurely: osmo-stp_10.42.42.5(pid=1913) [trial-2366↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1913)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=1925): Process ended prematurely: osmo-stp_10.42.42.5(pid=1925) [trial-2366↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1925)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=1945): Process ended prematurely: osmo-stp_10.42.42.5(pid=1945) [trial-2366↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1945)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1955): Process ended prematurely: osmo-stp_10.42.42.5(pid=1955) [trial-2366↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1955)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=1966): Process ended prematurely: osmo-stp_10.42.42.5(pid=1966) [trial-2366↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1966)] FAIL: gprs:nanobts+band-900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=1983): Process ended prematurely: osmo-stp_10.42.42.5(pid=1983) [trial-2366↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1983)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=1995): Process ended prematurely: osmo-stp_10.42.42.5(pid=1995) [trial-2366↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1995)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=2013): Process ended prematurely: osmo-stp_10.42.42.5(pid=2013) [trial-2366↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2013)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=2023): Process ended prematurely: osmo-stp_10.42.42.5(pid=2023) [trial-2366↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2023)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=2036): Process ended prematurely: osmo-stp_10.42.42.5(pid=2036) [trial-2366↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2036)] FAIL: gprs:nanobts+band-900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=2053): Process ended prematurely: osmo-stp_10.42.42.5(pid=2053) [trial-2366↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2053)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=2065): Process ended prematurely: osmo-stp_10.42.42.5(pid=2065) [trial-2366↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2065)] FAIL: iperf3m4.py (12.0 sec) Error: osmo-stp_10.42.42.5(pid=2355): Process ended prematurely: osmo-stp_10.42.42.5(pid=2355) [trial-2366↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2355)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=2366): Process ended prematurely: osmo-stp_10.42.42.5(pid=2366) [trial-2366↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2366)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=2376): Process ended prematurely: osmo-stp_10.42.42.5(pid=2376) [trial-2366↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2376)] FAIL: gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=2396): Process ended prematurely: osmo-stp_10.42.42.5(pid=2396) [trial-2366↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2396)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=2408): Process ended prematurely: osmo-stp_10.42.42.5(pid=2408) [trial-2366↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2408)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=2426): Process ended prematurely: osmo-stp_10.42.42.5(pid=2426) [trial-2366↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2426)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=2436): Process ended prematurely: osmo-stp_10.42.42.5(pid=2436) [trial-2366↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2436)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=2446): Process ended prematurely: osmo-stp_10.42.42.5(pid=2446) [trial-2366↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2446)] FAIL: dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=2459): Process ended prematurely: osmo-stp_10.42.42.5(pid=2459) [trial-2366↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2459)] FAIL: nitb_smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (2.5 sec) Error: osmo-nitb_10.42.42.2(pid=2470): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2470) [trial-2366↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2470)] FAIL: esme_connect_policy_closed.py (2.0 sec) Error: osmo-nitb_10.42.42.2(pid=2472): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2472) [trial-2366↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2472)] FAIL: esme_ms_sms_storeforward.py (2.9 sec) Error: osmo-nitb_10.42.42.2(pid=2477): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2477) [trial-2366↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2477)] FAIL: esme_ms_sms_transaction.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=2479): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2479) [trial-2366↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2479)] FAIL: smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (5.2 sec) Error: osmo-hlr_10.42.42.2(pid=2488): Process ended prematurely: osmo-hlr_10.42.42.2(pid=2488) [trial-2366↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2488)] FAIL: esme_connect_policy_closed.py (5.9 sec) Error: osmo-hlr_10.42.42.2(pid=2499): Process ended prematurely: osmo-hlr_10.42.42.2(pid=2499) [trial-2366↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2499)] FAIL: esme_ms_sms_storeforward.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=2511): Process ended prematurely: osmo-stp_10.42.42.5(pid=2511) [trial-2366↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2511)] FAIL: esme_ms_sms_transaction.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=2522): Process ended prematurely: osmo-stp_10.42.42.5(pid=2522) [trial-2366↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2522)] FAIL: encryption (fail: 4) FAIL: register_a5_0_authopt.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=2536): Process ended prematurely: osmo-stp_10.42.42.5(pid=2536) [trial-2366↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2536)] FAIL: register_a5_0_authreq.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=2547): Process ended prematurely: osmo-stp_10.42.42.5(pid=2547) [trial-2366↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2547)] FAIL: register_a5_1_authreq.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=2558): Process ended prematurely: osmo-stp_10.42.42.5(pid=2558) [trial-2366↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2558)] FAIL: register_a5_3_authreq.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=2569): Process ended prematurely: osmo-stp_10.42.42.5(pid=2569) [trial-2366↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2569)] FAIL: 4g:srsenb-rftype@zmq+srsue-rftype@zmq (fail: 7) FAIL: handover.py (20.1 sec) Error: srsepc(pid=2589): Process ended prematurely: srsepc(pid=2589) [trial-2366↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2589)] FAIL: iperf3_bidir.py (19.0 sec) Error: srsepc(pid=2605): Process ended prematurely: srsepc(pid=2605) [trial-2366↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2605)] FAIL: iperf3_dl.py (18.7 sec) Error: srsepc(pid=2621): Process ended prematurely: srsepc(pid=2621) [trial-2366↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2621)] FAIL: iperf3_ul.py (18.9 sec) Error: srsepc(pid=2637): Process ended prematurely: srsepc(pid=2637) [trial-2366↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2637)] FAIL: ping.py (18.6 sec) Error: srsepc(pid=2654): Process ended prematurely: srsepc(pid=2654) [trial-2366↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2654)] FAIL: rrc_idle_mo_ping.py (18.2 sec) Error: srsepc(pid=2670): Process ended prematurely: srsepc(pid=2670) [trial-2366↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2670)] FAIL: rrc_idle_mt_ping.py (18.6 sec) Error: srsepc(pid=2687): Process ended prematurely: srsepc(pid=2687) [trial-2366↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2687)] FAIL: handover_2G:nanobts+bts1-oc2g (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=2701): Process ended prematurely: osmo-stp_10.42.42.5(pid=2701) [trial-2366↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2701)] FAIL: handover_2G:nanobts+bts1-octphy (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=2715): Process ended prematurely: osmo-stp_10.42.42.5(pid=2715) [trial-2366↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2715)] FAIL: handover_2G:nanobts+bts1-trx-lms (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=2729): Process ended prematurely: osmo-stp_10.42.42.5(pid=2729) [trial-2366↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2729)] FAIL: handover_2G:nanobts+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=2743): Process ended prematurely: osmo-stp_10.42.42.5(pid=2743) [trial-2366↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2743)] FAIL: handover_2G:nanobts+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=2758): Process ended prematurely: osmo-stp_10.42.42.5(pid=2758) [trial-2366↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2758)] FAIL: handover_2G:nanobts+bts1-sysmo (fail: 1) FAIL: handover.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=2773): Process ended prematurely: osmo-stp_10.42.42.5(pid=2773) [trial-2366↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2773)] FAIL: handover_2G:nanobts+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=2788): Process ended prematurely: osmo-stp_10.42.42.5(pid=2788) [trial-2366↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2788)] FAIL: handover_2G:nanobts+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=2806): Process ended prematurely: osmo-stp_10.42.42.5(pid=2806) [trial-2366↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2806)] FAIL: handover_2G:oc2g+bts1-octphy (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=2820): Process ended prematurely: osmo-stp_10.42.42.5(pid=2820) [trial-2366↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2820)] FAIL: handover_2G:oc2g+bts1-trx-lms (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=2834): Process ended prematurely: osmo-stp_10.42.42.5(pid=2834) [trial-2366↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2834)] FAIL: handover_2G:oc2g+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=2848): Process ended prematurely: osmo-stp_10.42.42.5(pid=2848) [trial-2366↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2848)] FAIL: handover_2G:oc2g+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=2862): Process ended prematurely: osmo-stp_10.42.42.5(pid=2862) [trial-2366↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2862)] FAIL: handover_2G:oc2g+bts1-sysmo (fail: 1) FAIL: handover.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=2876): Process ended prematurely: osmo-stp_10.42.42.5(pid=2876) [trial-2366↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2876)] FAIL: handover_2G:oc2g+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=2891): Process ended prematurely: osmo-stp_10.42.42.5(pid=2891) [trial-2366↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2891)] FAIL: handover_2G:oc2g+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=2905): Process ended prematurely: osmo-stp_10.42.42.5(pid=2905) [trial-2366↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2905)] FAIL: handover_2G:octphy+bts1-trx-lms (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=2919): Process ended prematurely: osmo-stp_10.42.42.5(pid=2919) [trial-2366↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2919)] FAIL: handover_2G:octphy+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=2933): Process ended prematurely: osmo-stp_10.42.42.5(pid=2933) [trial-2366↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2933)] FAIL: handover_2G:octphy+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=2947): Process ended prematurely: osmo-stp_10.42.42.5(pid=2947) [trial-2366↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2947)] FAIL: handover_2G:octphy+bts1-sysmo (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=2961): Process ended prematurely: osmo-stp_10.42.42.5(pid=2961) [trial-2366↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2961)] FAIL: handover_2G:octphy+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=2975): Process ended prematurely: osmo-stp_10.42.42.5(pid=2975) [trial-2366↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2975)] FAIL: handover_2G:octphy+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=2989): Process ended prematurely: osmo-stp_10.42.42.5(pid=2989) [trial-2366↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2989)] FAIL: handover_2G:trx-lms+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=3003): Process ended prematurely: osmo-stp_10.42.42.5(pid=3003) [trial-2366↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3003)] FAIL: handover_2G:trx-lms+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=3017): Process ended prematurely: osmo-stp_10.42.42.5(pid=3017) [trial-2366↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3017)] FAIL: handover_2G:trx-lms+bts1-sysmo (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=3032): Process ended prematurely: osmo-stp_10.42.42.5(pid=3032) [trial-2366↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3032)] FAIL: handover_2G:trx-lms+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=3046): Process ended prematurely: osmo-stp_10.42.42.5(pid=3046) [trial-2366↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3046)] FAIL: handover_2G:trx-lms+bts1-trx-umtrx (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=3060): Process ended prematurely: osmo-stp_10.42.42.5(pid=3060) [trial-2366↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3060)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=3075): Process ended prematurely: osmo-stp_10.42.42.5(pid=3075) [trial-2366↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3075)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-sysmo (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=3090): Process ended prematurely: osmo-stp_10.42.42.5(pid=3090) [trial-2366↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3090)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=3104): Process ended prematurely: osmo-stp_10.42.42.5(pid=3104) [trial-2366↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3104)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx (fail: 1) FAIL: handover.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=3118): Process ended prematurely: osmo-stp_10.42.42.5(pid=3118) [trial-2366↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3118)] FAIL: handover_2G:trx-sysmocell5000+bts1-sysmo (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=3132): Process ended prematurely: osmo-stp_10.42.42.5(pid=3132) [trial-2366↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3132)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=3146): Process ended prematurely: osmo-stp_10.42.42.5(pid=3146) [trial-2366↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3146)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=3160): Process ended prematurely: osmo-stp_10.42.42.5(pid=3160) [trial-2366↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3160)] FAIL: handover_2G:sysmo+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=3177): Process ended prematurely: osmo-stp_10.42.42.5(pid=3177) [trial-2366↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3177)] FAIL: handover_2G:sysmo+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=3191): Process ended prematurely: osmo-stp_10.42.42.5(pid=3191) [trial-2366↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3191)] FAIL: handover_2G:trx-b200+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=3205): Process ended prematurely: osmo-stp_10.42.42.5(pid=3205) [trial-2366↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3205)] + rm -rf trial-2366/inst + cd trial-2366 + command -v journalctl + [ ! -z /bin/journalctl ] + readlink last_run + journalctl -u ofono -o short-precise --since 2022-12-09 23:11:22 + readlink last_run + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366-run.tgz run.2022-12-09_23-11-33 + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2366-bin.tgz checksums.md5 open5gs.build-8.tgz osmo-bsc.build-17654.tgz osmo-bts-oc2g.build-5531.tgz osmo-bts-sysmo.build-8035.tgz osmo-bts.build-7504.tgz osmo-ggsn.build-6679.tgz osmo-hlr.build-8699.tgz osmo-hnbgw.build-2949.tgz osmo-mgw.build-8944.tgz osmo-msc.build-29262.tgz osmo-nitb.build-12967.tgz osmo-pcu-oc2g.build-3907.tgz osmo-pcu-sysmo.build-5189.tgz osmo-pcu.build-5150.tgz osmo-sgsn.build-30040.tgz osmo-stp.build-9239.tgz osmo-trx.build-4675.tgz osmocom-bb.build-4700.tgz srslte.build-19.tgz + exit 1 Build step 'Execute shell' marked build as failure Archiving artifacts Recording test results [Checks API] No suitable checks publisher found. Sending e-mails to: pespin@sysmocom.de Finished: FAILURE